ML Infrastructure Engineer - New Grad
SambaNova Systems - Austin, Texas, United States; San Jose, California, United States
Posted Oct 27, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Offered From the posting source checked Nov 16, 2026
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- $131K-$197K From the posting source checked Nov 16, 2026
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
41% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Nov 16, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
ML Infrastructure Engineer - New Grad Austin, Texas, United States; San Jose, California, United States SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) - a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value. About the Team The ML Infrastructure team builds and operates the inference stack that serves SambaNova's models on our RDU accelerators. We cover request scheduling, caching, decoding techniques, public APIs, and the accuracy testing that every inference feature must pass before it ships. About the Role As a new grad ML Infrastructure Engineer, you'll write production Python for our inference serving stack, including our vLLM integration and public APIs. You'll help bring features like speculative decoding, prompt caching, and tool calling into production on the RDU, and add accuracy and regression tests that catch problems before customers do. Responsibilities - Implement inference features on the RDU such as speculative decoding, constrained decoding, tool calling, prompt caching, and long-context inference - Adapt vLLM and related serving frameworks to the RDU architecture - Build and maintain endpoints in the public inference API - Write accuracy verification and regression tests for inference features - Debug
Read the full description at sambanova.ai. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Senior ML Infrastructure Engineer
SambaNova Systems - Austin, Texas, United States; San Jose, California, United States
Machine Learning Infrastructure Engineer
Character.AI - Redwood City, CA, Redwood City, California, United States
Senior Core Infrastructure Engineer, AI Infrastructure
Oracle - Nashville, TN, United States, US
ML Infrastructure Engineer, Fauna
Amazon - New York, New York, USA