Track This Job
Add this job to your tracking list to:
- Monitor application status and updates
- Change status (Applied, Interview, Offer, etc.)
- Add personal notes and comments
- Set reminders for follow-ups
- Track your entire application journey
Save This Job
Add this job to your saved collection to:
- Access easily from your saved jobs dashboard
- Review job details later without searching again
- Compare with other saved opportunities
- Keep a collection of interesting positions
- Receive notifications about saved jobs before they expire
AI-Powered Job Summary
Get a concise overview of key job requirements, responsibilities, and qualifications in seconds.
Pro Tip: Use this feature to quickly decide if a job matches your skills before reading the full description.
In this pivotal role, you will develop and scale automated evaluation and synthetic data generation (SDG) capabilities that underpin safety assessments across multiple languages and markets. You will work closely with language experts and multilingual annotators to validate automated safety approaches, ensuring robustness and reliability across diverse linguistic contexts.
Responsibilities
- Automated Judge Development: Train, fine-tune, and validate automated judge models that can reliably score AI system outputs for safety and policy compliance. Develop calibration and agreement metrics to ensure judges meet human-parity benchmarks.
- Validation Techniques: Design and implement validation frameworks to assess the accuracy, reliability, and cross-linguistic consistency of automated evaluation systems. Develop methods to detect drift, bias, and failure modes in automated judges across markets.
- Synthetic Data Generation: Develop and maintain synthetic data generation pipelines to augment evaluation coverage, stress-test safety boundaries, and support evaluation in low-resource languages. Ensure synthetic data is diverse, representative, and validated against human-generated benchmarks.
- Scalable Analysis & Reporting Automation: Create automated pipelines for analysis and reporting that reduce manual effort, increase reproducibility, and enable rapid cross-market safety assessments. Build tooling that integrates with existing dashboards and reporting workflows.
- 3+ years of experience in an ML engineering or applied ML research role, with hands-on experience building and deploying ML models and pipelines.
- Strong proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face Transformers).
- Experience training, fine-tuning, and evaluating language models and/or classifiers, including prompt engineering and model calibration.
- Experience building automated data processing, evaluation, or monitoring pipelines.
- Comfortable with experiment design and statistical validation of model performance across segmented samples.
- Able to work independently as well as collaboratively with minimal direction.
- Organized, highly attentive to detail, and manages time well.
- Advanced degree (MS/PhD) in Computer Science, Machine Learning, Natural Language Processing, or a related field.
- Experience working in the industry.
- Experience with synthetic data generation techniques, including data augmentation, paraphrasing, and controlled generation methods.
- Experience with multilingual NLP, cross-lingual transfer learning, or low-resource language modeling.
- Familiarity with evaluation-as-a-service architectures or automated red teaming frameworks.
- Experience with large-scale distributed computing (e.g., Spark, Ray, or cloud-based ML platforms).
- Prior experience in AI safety, responsible AI, content moderation, or trust and safety domains.
- Experience with CI/CD integration for ML model validation and deployment.
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
Key Skills
Ranked by relevanceReady to apply?
Join Grid Dynamics and take your career to the next level!
Application takes less than 5 minutes

