ML Model Evaluation Engineer
Triomics - India Office | OnSite
Posted Jul 3, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
ML Model Evaluation Engineer India Office | OnSite GROWTH PATH This is an individual contributor role with strong ownership expectations. High performers may be considered for workstream lead or functional lead responsibilities after approximately 12 months, based on demonstrated ownership, delivery, technical judgment, mentoring, cross-functional influence, and ability to reduce dependency on the Director of ML. ABOUT THE ROLE We are looking for an ML Evaluation Engineer to own model quality, regression testing, release validation, and production impact analysis for clinical AI systems. This role sits between applied ML, clinical data, MLOps, and production operations. Your job is to ensure that every model or workflow release is measurable, stable, and not degrading important clinical behavior. You will maintain evaluation datasets, create hidden test sets, run regression checks, analyze production issues, and produce release-readiness reports. WHAT YOU WILL DO Build and maintain evaluation frameworks for clinical NLP, LLM, RAG, information extraction, and structured abstraction systems. Create and manage hidden test datasets that are not directly visible to model developers, reducing overfitting risk. Define release metrics, regression thresholds, slice-based evaluation, failure-mode tracking, and release/blocker criteria. Compare model versions and identify performance degradation across clinical segments, document types, clients, data sources, labels, and edge cases. Work with Clinical AI Data Specialists to design gold sets, hidden test sets, adjudication workflows, and label quality checks. Work with Research Engineers to understand model changes, expected behavior, and evaluation risks without compromising test-set independence. Work with MLOps/Data Engineering to monitor production behavior, triage bugs, analyze incident
Read the full description at jobs.ashbyhq.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
MLOps & Data Engineer
Triomics - India Office | OnSite
AI/ML ENGINEER
TE Connectivity - BANGALORE, India
Machine Learning Engineer
Cognite - India (Bengaluru)
Senior Machine Learning Engineer
Amgen - India - Hyderabad