Research Engineer, Evals
Variance - San Francisco | OnSite
Posted Mar 31, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- Not verified
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Nov 18, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Research Engineer, Evals San Francisco | OnSite Role At Variance, we are teaching machines to make the hardest judgment calls at scale. That means building AI agents for the high-stakes gray area of risk investigations, fraud, and identity reviews. We're a small, talent-dense team in San Francisco working on a problem at the edge of what AI systems can reliably do: making good decisions in messy, adversarial, real-world environments. We focus on building, high-consequence systems problems where the edge cases matter most. We're looking for a Research Engineer to help define how we measure and improve model quality. You'll build the benchmarks, datasets, tooling, and evaluation loops that tell us whether our systems are actually getting better on the tasks that matter. This role sits at the center of research, product, and engineering. It is about creating rigorous, domain-specific evaluations that reflect real customer workflows, expose meaningful failure modes, and drive the next generation of model and agent improvements. You're a fit if you: Care deeply about craftsmanship and have strong opinions about model quality, measurement, and experimental rigor Want to work on core model and agent behavior, not just surface-level product metrics Are excited by the challenge of defining what “good” looks like in messy, high-stakes environments Think in tight loops: hypothesis, benchmark design, evaluation, failure analysis, iteration Have strong engineering fundamentals and like building robust systems around ambiguous research problems Thrive in environments where success criteria are initially underspecified and need to be sharpened through work Are willing
Read the full description at jobs.ashbyhq.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Software Engineer
Variance - San Francisco | OnSite
Research Engineer
Gauntlet Networks - New York City / San Francisco / Los Angeles / Remote
Machine Learning Research Scientist, Evaluations
Scale AI - San Francisco, CA; Seattle, WA; New York, NY
Research Engineer, RL Frontiers
Etched - San Jose, CA, United States