Research Engineer, Benchmarks
HUD - San Francisco | OnSite | Singapore | Remote (Asia) | Remote (North America)
Posted Jul 13, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- $100K-$230K From the posting source checked Nov 19, 2026
- 401(k) match
- Reported not verified - source URL not recorded; timestamp not recorded
Was this benefit information wrong? Tell us.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Research Engineer, Benchmarks San Francisco | OnSite | Singapore | Remote (Asia) | Remote (North America) About HUD HUD 's mission is to build reliable, fair and open infrastructure for AI data. We want data to be valuable for the people who create it and trustworthy for the labs that train on it. Our team is a quickly growing group of researchers, engineers and operators building the economy that shapes what AI will become. Backed by $16M from top VCs and YC (W25), our marketplace and platform are used by startups, Fortune 500 companies and frontier labs. About the role We're looking for Research Engineers to build high-quality benchmarks for evaluating frontier agents on domain-specific tasks. You'll build benchmarks that are technically rigorous, practically useful, and credible to frontier labs. Responsibilities Own the design, implementation, and quality of HUD's internal agent benchmarks Work with subject-matter experts to define tasks and create domain-specific benchmarks that evaluate agents on realistic workflows Build infrastructure to reliably run models and agents against benchmark tasks Develop metrics and analyses to understand benchmark difficulty, reliability, and failure modes Validate whether benchmark performance correlates with real-world evals, customer needs, and lab expectations Write clear documentation and benchmark reports that make results legible and credible to technical audiences Experience You may be a good fit if you have: Proficiency in Python, Docker, and Linux environments Published papers or written technical blogs on relevant topics such as public benchmarks and their limitations, model failure modes, etc. - please link
Read the full description at jobs.ashbyhq.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Research Engineer (General)
HUD - San Francisco | OnSite | Singapore | Remote (Asia) | Remote (North America)
Research Engineer – Benchmarking
Mercor - San Francisco, California, United States
Research Engineer - Benchmarks
Firecrawl - San Francisco HQ; Toronto Hub | Hybrid | Remote
Research Engineer, Evals
Variance - San Francisco | OnSite