Senior Director of Engineering - Inference Serving
SambaNova Systems - San Jose, California, United States
Posted Jun 3, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Offered From the posting source checked Jun 20, 2026
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- $245K-$325K From the posting source checked Jun 20, 2026
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
145% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Senior Director of Engineering - Inference Serving San Jose, California, United States SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) - a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value. About the team The SambaStack team builds the inference serving platform enterprises and service providers use to host foundation models on RDU hardware. The platform is cloud-agnostic, and the team owns deployment, orchestration, scaling, and reliability for production inference workloads. About the Role The SambaStack team is seeking an Engineering Director to lead a software engineering team while remaining a hands-on technical contributor. You'll own the growth and effectiveness of your team, the technical quality of their output, and the roadmap for the inference serving platform. You'll continue to design systems and write code on the platform's hardest problems. Responsibilities People & Team Leadership - Lead, grow, and inspire a software team, fostering a culture of technical excellence, collaboration, and continuous improvement - Own hiring for your team: define roles, assess candidates, and build a diverse, high-performing engineering organization - Drive the career development of your engineers through regular 1:1s, meaningful feedback, and clear growth
Read the full description at sambanova.ai. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Inference Systems Performance Architect
SambaNova Systems - San Jose, California, United States
Senior Director, Platform Software Engineering
Oracle - Seattle, WA, United States, US
Senior Backend Engineer, Inference Platform
Together AI - San Francisco
Senior Staff Inference Performance Engineer
d-Matrix - Santa Clara, Santa Clara, Ca, Ca, United States, Remote