Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
Zyphra - San Francisco, California, United States
Posted Oct 15, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- Not verified
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud San Francisco, California, United States The Role: As a Machine Learning Systems Administrator / DevOps Engineer, you will maintain and build the core infrastructure behind both our model training and our inference cloud. You'll split your time between our large-scale training clusters and the deployments and services that run our models in production on heterogeneous compute, which spans multiple accelerator types and vendors. You'll work closely with our training, inference, and product teams to keep these systems reliable, secure, and fast. You'll also lay the groundwork for workflows that can scale with us. You'll Work Across: Training clusters - Administration and automation of our Linux-based cluster environments - User onboarding/offboarding, access control, and security auditing - Monitoring system resources, job scheduling, and cluster health - Bring-up and validation of new hardware (compute, networking, storage) - Supporting and improving developer workflows (e.g., VSCode remote development, Docker) - Enabling and supporting large-scale training jobs Inference cloud - Deploying, operating, and scaling inference services across heterogeneous accelerators - Managing container orchestration, CI/CD, and rollout pipelines for model deployments - Building observability for production services, including metrics, logging, alerting, and dashboards - Owning service reliability: uptime, incident response, and postmortems - Capacity planning, autoscaling, and utilization/cost tracking across hardware types - Securing production systems through secrets management, network policy, and tenant isolation You'll own critical systems end to end. Your work will directly affect developer productivity, training throughput, and the performance and
Read the full description at jobs.ashbyhq.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Machine Learning Engineer - Inference
Together AI - San Francisco
Machine Learning Engineer
Sift - San Francisco, California | Hybrid | Seattle, Washington | Remote
Machine Learning Software Engineer
Swan - San Francisco, CA, US
ML Ops / Dev Ops Engineer
Zensors - San Francisco | OnSite