Job Description
Researcher, AI Evaluation
Full-time | San Francisco | $180K–$300K per year + equity + benefits
About the Company
- The organization develops advanced AI systems that evaluate job performance more effectively than humans. Just as a hiring manager would review resumes, conduct interviews, and make hiring decisions, these processes are automated using large language models (LLMs).
- Trusted by leading AI research labs worldwide
- Achieved $100M+ revenue run rate with 59% month-over-month growth over the past 6 months
- Highly profitable and fast-growing team with an urgent focus on attracting exceptional talent
About the Role
The AI Evaluation Researcher position involves advancing the frontier of model evaluation science to directly influence how AI systems are tested, validated, and improved across the industry. The role provides the opportunity to publish in top conferences, collaborate with world-class researchers, and design benchmarks that deliver measurable economic value.
- Key Responsibilities
- Develop benchmarks that assess the real-world impact and value of AI systems
- Publish LLM evaluation research papers at leading AI conferences
- Investigate data ROI in model development across multi-modality, code, tool-use, and related domains
- Design and validate novel data collection and annotation methods for top AI labs and technology companies
- Qualifications
- PhD or M.S. with 2+ years of experience in Computer Science, Electrical Engineering, Econometrics, or another STEM discipline
- Strong publication record in AI research, dataset creation, or model evaluation
- Deep understanding of LLMs, training datasets, and evaluation methodologies
- Strong foundation in statistics and experience with data annotation workflows
- Excellent communication skills with the ability to present research clearly and persuasively
- Compensation & Benefits
- Salary: $180K–$300K base compensation
- Equity: Significant equity grants
- Relocation & Housing:
- $20K relocation bonus for moving to the Bay Area
- $10K housing bonus for living within 0.5 miles of the office
- Perks:
- $1K monthly meal stipend
- Free Equinox membership
- Comprehensive health insurance
Apply Now
Apply Now