Staff Engineer, Distributed Storage & AI Infrastructure
Together AI - San Francisco
Posted Jun 4, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- $250K-$300K From the posting source checked Jun 20, 2026
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
136% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Jun 20, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Staff Engineer, Distributed Storage & AI Infrastructure San Francisco About the Role In this role, you will operate, scale, and optimize multi-petabyte storage systems purpose-built for the world's largest AI training and inference workloads. Storage now sits on the inference critical path as well, so you'll also build the caching and data-movement layers that deliver KV cache and model weights directly into GPU memory at fabric speed. You'll manage and scale high-performance parallel filesystems and object stores, evaluate and integrate cutting-edge technologies such as Vast, Weka, Ceph, and Lustre, and solve the complex engineering challenges of operating at extreme throughput, low-latency data paths, and massive cluster-scale storage operations. You will also build Kubernetes-native storage operators and self-service platforms that provide automated provisioning, strict multi-tenancy, performance isolation, and quota enforcement at cluster scale. Day-to-day, you'll optimize end-to-end data paths for 10-50 GB/s per node, design multi-tier caching architectures, implement intelligent prefetching and model-weight distribution, build KV-cache offload and reuse tiers for inference, and tune parallel filesystems for AI workloads. Responsibilities - Architect and implement the technical strategy and storage roadmap for Together AI, driving high-performance architectural decisions as we scale our GPU fleet. - Engineer and scale multi-petabyte AI/ML storage systems by integrating Vast, Weka, and Ceph while executing deep cost optimization through automated tiering and lifecycle policies. - Develop intelligent caching and tiered storage architectures to achieve extreme IOPS and cluster-wide throughput at GPU scale for training and inference workloads, including GPU-direct (RDMA) delivery of model weights for fast cold
Read the full description at job-boards.greenhouse.io. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Staff Software Engineer - Infrastructure Storage
Lambda - San Francisco Office (Fremont St), San Francisco, California, United States, San Jose Office (First St), Bellevue Office
Staff Software Engineer, Google Distributed Cloud AI Storage
Google - Sunnyvale, CA, USA; +1 more
Staff Network Engineer, Storage
Crusoe - Sunnyvale, CA - US, Sunnyvale, California, United States
Staff AI Infrastructure Engineer
Seekr - Austin, Texas, United States; Reston, Virginia, United States