Mercor is looking for a Bilingual Japanese STEM Expert with experience in biology / physics / chemistry theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in biology / physics / chemistry will ensure the accuracy, rigor, and instructional quality of these test items. You will create and evaluate Japanese / English prompts and responses, ensuring scientific precision while maintaining clear, natural Japanese phrasing and alignment with English where needed.

• Job Details - Design and Optimize STEM-Based Prompts (Bilingual) : Create detailed prompts in Japanese and / or English with multiple constraints and scientific instructions. - Define and Document Evaluation Standards : Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when in Japanese —linguistic clarity and appropriate academic tone. - Conduct Model Testing and Grading (Bilingual) : Run prompts through models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity, comparing Japanese vs. English where needed. - Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability across Japanese-language benchmarks before integration into official benchmarks.
• * * ## Minimum Qualifications - Native-level fluency in Japanese (written) with strong reading / writing ability in English - BS or BA in Biology / Physics / Chemistry - Familiarity with undergraduate-level biology / physics / chemistry topics - Strong writing and critical thinking skills - Ability to work independently and meet deadlines
• * * ## Preferred Qualifications - 2+ years of experience in teaching, research, or an applied STEM discipline field
• * * ## Application & Onboarding Process - Complete an AI-led interview (around 15 minutes ) - If approved, complete a paid assessment focused on writing and rubric creation - Then, if selected, you will be invited to work on the project.
• * * ## More Details About This Role - Expect to contribute at least 20 hours per week - Expect a commitment of around 1 month - You’ll be working in a structured project environment with clear goals and tools

Apply To this Job