Job Description
- Mercor is looking for a **Bilingual Japanese STEM Expert** with experience in **biology / physics / chemistry** theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in **biology / physics / chemistry** will ensure the accuracy, rigor, and instructional quality of these test items. You will create and evaluate **Japanese/English** prompts and responses, ensuring scientific precision while maintaining clear, natural **Japanese** phrasing and alignment with English where needed.
- * *
## **Job Details**
- **Design and Optimize STEM-Based Prompts (Bilingual):** Create detailed prompts in **Japanese** and/or English with multiple constraints and scientific instructions.
- **Define and Document Evaluation Standards:** Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when in **Japanese**—linguistic clarity and appropriate academic tone.
- **Conduct Model Testing and Grading (Bilingual):** Run prompts through models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity, comparing **Japanese vs. English** where needed.
- **Support Benchmarking and Quality Assurance:** Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability across **Japanese-language** benchmarks before integration into official benchmarks.
- * *
## **Minimum Qualifications**
- Native-level fluency in **Japanese (written)** with strong reading/writing ability in English
- BS or BA in **Biology / Physics / Chemistry**
- Familiarity with undergraduate-level **biology / physics / chemistry** topics
- Strong writing and critical thinking skills
- Ability to work independently and meet deadlines
- * *
## **Preferred Qualifications**
- **2+ years** of experience in teaching, research, or an applied STEM discipline field
- * *
## **Application & Onboarding Process**
- Complete an AI-led interview (around **15 minutes**)
- If approved, complete a paid assessment focused on writing and rubric creation
- Then, if selected, you will be invited to work on the project.
- * *
## **More Details About This Role**
- Expect to contribute at least **20 hours per week**
- Expect a commitment of around **1 month**
- You’ll be working in a structured project environment with clear goals and tools
Apply tot his job
Apply To this Job