Inference Systems Performance Architect
SambaNova Systems - San Jose, California, United States
Posted Aug 16, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Offered From the posting source checked Nov 16, 2026
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- $245K-$325K From the posting source checked Nov 16, 2026
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Role
- Seniority
- Staff Plus From the posting source checked Nov 16, 2026
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Nov 16, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Inference Systems Performance Architect San Jose, California, United States SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) - a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value. About the Team The Inference Systems Performance team answers how fast SambaNova's systems can serve large language models and what it takes to get there. We capture real production traffic, benchmark it faithfully, model and simulate configurations that do not exist yet, and profile the distributed serving pipeline across host, accelerator, and fabric. Our work feeds serving optimization today and hardware and capacity planning for the next generation. We sit close to model optimization, systems, hardware, and product, and the whole company depends on our numbers. About the Role You will be the architect for end-to-end inference performance: how a request moves through tokenization, prefill, decode, and the fabric between them, and how a deployment is sized against customer SLOs. The work has two coupled pillars. One is reproducible workload capture and benchmarking, building replayable representations of real and increasingly agentic traffic so measurements reflect production rather than a naive load script. The other is performance modeling and
Read the full description at sambanova.ai. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Software Architect
SambaNova Systems - San Jose, California, United States
Senior Staff Inference Performance Engineer
d-Matrix - Santa Clara, Santa Clara, Ca, Ca, United States, Remote
Performance Engineer, Inference Systems
Anthropic - San Francisco, CA | New York City, NY | Seattle, WA
Performance Modeling Architect
TensTorrent - Austin, Texas, United States; Santa Clara, California, United States