Job Description
Note: The job is a remote job and is open to candidates in USA. Rex.zone is seeking an Entry Level AI/ML Data Annotation Specialist to support AI/ML development by producing and evaluating high-quality training data for engineering and technology workflows. The role involves data labeling for NLP and computer vision, prompt evaluation for large language model behavior, and ensuring compliance with annotation guidelines.
Responsibilities
- Execute labeling and evaluation tasks across text, image, and multimodal datasets
- Perform named entity recognition, content classification, and content safety labeling
- Review model outputs during large language model evaluation and document edge cases
- Run QA sampling, discrepancy analysis, and track error types to improve training data quality
- Collaborate with remote teams to refine rubrics, guidelines, and acceptance criteria
- Work in structured queues with rubrics, golden sets, and calibration sessions
- Use web-based annotation platforms, spreadsheets, and basic scripting for checks
- Maintain versioned guidelines and inter-annotator agreement targets
Skills
- Strong STEM fundamentals, careful reading, and consistent decision-making
- Basic Python and SQL; attention to detail and clear written communication
- Comfort interpreting structured rubrics and ensuring guidelines compliance
Company Overview
Apply To This Job