Job Description
Dice is the leading career destination for tech experts at every stage of their careers. Our client, ConfigUSA, is seeking the following. Apply via Dice today!
AI / ML Architect – GenAI (LLM & RAG)
Location: Philadelphia, PA (Hybrid – onsite PI meetings once a month / quarter)
Duration: 6+ Months Contract
- AWS SageMaker, Bedrock, S3
- Python
- LLMs
- RAG
- Vector DB (OpenSearch/DynamoDB)
- Role Focus:
- Test LLM & RAG pipelines (prompt accuracy, grounding, hallucination checks)
- Validate ML models (data, features, inference, drift)
- Test AWS ML workflows (training, endpoints, pipelines)
- Ensure governance, auditability, and compliance readiness
- Must-Have:
- 4+ yrs QA/testing (data, ML, or AI systems)
- Hands-on testing of LLM/GenAI applications
- Python for test automation & data validation
- Understanding of model behavior & evaluation metrics
- Nice-to-Have:
- Regulated domains (Insurance / BFS)
Apply Now
Apply Now