Job Description
Note: The job is a remote job and is open to candidates in USA. Rex.zone is a company focused on AI research, and they are seeking an AI Researcher to support end-to-end research and applied experimentation for modern AI systems. The role involves designing experiments, defining evaluation protocols, and improving evaluation rigor through robust measurement and QA evaluation workflows.
Responsibilities
- Develop and run AI research experiments across NLP, computer vision, and multimodal settings
- Design evaluation harnesses for large language model evaluation, including offline/online metrics
- Define RLHF and preference modeling evaluation protocols (rubrics, sampling plans, inter-rater reliability)
- Partner with data labeling teams to improve training data quality and annotation guidelines compliance
- Perform error analysis, ablation studies, and prompt evaluation to identify failure modes
- Build reproducible pipelines for dataset curation, data labeling audits, and QA evaluation
- Translate research findings into engineering-ready requirements and measurable acceptance criteria
- Support content safety labeling strategy and risk analysis for model outputs
Skills
- AI research and machine learning research fundamentals
- Experience with large language models and model evaluation
- Hands-on RLHF concepts (preference data, reward modeling, evaluation)
- Strong experiment design and statistics basics
- Familiarity with training data quality practices and dataset documentation
- NLP and/or computer vision domain knowledge
- Ability to collaborate cross-functionally with engineering and data operations
Company Overview
Apply To This Job