Principal Architect, AI Inference Networking - NIXL and Dynamo
NVIDIA Corporation - 2 Locations
Posted Nov 13, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified checked Nov 20, 2026
- Salary
- Not verified
- 401(k) match
- Reported from DOL Form 5500 industry filing (not employer-specific)
Was this benefit information wrong? Tell us.
Role
- Seniority
- Principal From the posting source checked Nov 17, 2026
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered Verified - SEC 10-K source checked Nov 17, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Principal Architect, AI Inference Networking - NIXL and Dynamo 2 Locations Inference has become a networking problem. With disaggregated serving, where prefill runs on one set of GPUs, decode on another, and KV cache streams between them, performance depends on how fast you can move tensors between GPUs, across nodes, and in and out of storage. Performance is only half of it. These deployments are elastic, so the data path needs dynamic APIs that let workers join and leave, connections form and tear down, and transfers reroute at runtime without stalling the pipeline. NIXL, NVIDIA's open source Inference Xfer Library, is the layer that solves this, and it sits underneath NVIDIA Dynamo and a growing list of inference engines. China is where some of the world's most demanding inference deployments are being built. We are hiring a senior architect to work directly with the platform teams building them, understanding what breaks at scale and turning that into upstream code and roadmap. You will work daily with core NIXL and Dynamo engineers in Israel and the US. What you'll be doing: Drive NIXL adoption in China, from the first architecture conversation through prototype and benchmark to production rollout and upstream contribution. Profile customer inference stacks and fix what's costing throughput and TTFT: KV cache movement, memory registration, transfer scheduling. Write NIXL backends and plugins, extend Dynamo integrations, and contribute optimizations upstream to NIXL and GPUDirect class data paths. Help define the APIs that make the data path dynamic, supporting elastic scaling,
Read the full description at nvidia.wd5.myworkdayjobs.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives
Amazon - Cupertino, California, USA
Inference Systems Performance Architect
SambaNova Systems - San Jose, California, United States
Member of Technical Staff (AI Inference Engineer)
Perplexity - London, United Kingdom
Member of Technical Staff, Kernel Engineering
Inferact - San Francisco, California, United States