• *About The Job

• *Mercor

connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include

• *Benchmark**

,

• *General Catalyst**

,

• *Peter Thiel**

,

• *Adam D'Angelo**

,

• *Larry Summers**

, and

• *Jack Dorsey**

.

• *Position:**

Chemistry AI Evaluator

• *Type:
• *Contract
• Compensation:
• $73/hour
• *Location:
• *Remote
• *Role Responsibilities
• Write and refine prompts to guide model behavior in chemistry contexts.
• Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and quantitative reasoning.
• Conduct fact-checking using authoritative public sources and domain knowledge.
• Annotate model responses by identifying strengths, areas of improvement, and inaccuracies.
• Assess clarity, structure, and appropriateness of explanations for different audiences.
• Apply consistent evaluation standards by following clear taxonomies and benchmarks.
• *Qualifications
• *Must-Have
• PhD in Chemistry or a closely related field
• Deep expertise in Organic & Biological Chemistry, Inorganic & Materials Chemistry, Physical & Theoretical Chemistry, or Analytical & Instrumental Chemistry
• Significant experience using large language models (LLMs)
• Excellent writing skills and strong attention to detail
• Experience reviewing or editing technical or academic writing
• *Preferred
• Prior experience with RLHF, model evaluation, or data annotation work
• Experience teaching or explaining chemistry concepts to non-expert audiences
• Familiarity with evaluation rubrics or structured review frameworks
• *Application Process (Takes 20–30 mins to complete)
• Upload resume
• AI interview based on your resume
• Submit form
• Resources & Support
• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
• For any help or support, reach out to: [email protected]
• PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

, Apply To this Job