Sr. Software Development Engineer, Inference Team - AWS Neuron
Amazon - Seattle, Washington, USA
Posted Sep 12, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
- Mental health support
- Offered From the posting source checked Nov 16, 2026
- Relocation assistance
- Not verified
- Childcare support
- Offered From the posting source checked Nov 16, 2026
- Learning budget
- Not verified
- Verification
- Not verified checked Nov 20, 2026
- Salary
- $168K-$227K From the posting source checked Nov 16, 2026
- 401(k) match
- Reported from DOL Form 5500 industry filing (not employer-specific)
Was this benefit information wrong? Tell us.
Role
- Seniority
- Senior From the posting source checked Nov 16, 2026
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered Verified - SEC 10-K source checked Nov 16, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Sr. Software Development Engineer, Inference Team - AWS Neuron Seattle, Washington, USA AWS Neuron is the complete software stack for AWS Inferentia and Trainium, AWS purpose-built accelerators for cloud-scale machine learning. This senior software engineering role is part of the Machine Learning Inference Applications team and focuses on delivering high-performance model inference solutions for customer workloads running on Inferentia- and Trainium-powered instances. The engineer will lead the development of core serving technologies within open-source frameworks (such as vLLM and SGLang) to enable customers to serve large-scale inference efficiently on AWS Neuron. The engineer will also drive excellence in inference framework optimization and engineering best practices. The engineer will work closely with model development engineers, performance engineers, compiler engineers, and runtime engineers to ensure end-to-end model performance and deliver production-ready accuracy, scalability, and efficiency across a broad range of models and customer use cases. Key job responsibilities The engineer will lead the customization and optimization of open-source inference frameworks (vLLM, SGLang) on AWS Neuron-including core framework logic such as scheduling and model execution-applying state-of-the-art techniques in kernel development, parallel computation, distributed KV cache, speculative decoding, and systems engineering to deliver best-in-class LLM serving performance. The engineer will also influence the team's technical roadmap by evaluating emerging inference research and translating it into production-ready features, and raise the bar through design leadership and mentorship. This role requires close collaboration across model development, compiler, runtime, and performance engineering teams. About the team Our team is dedicated to supporting new members. We have a
Read the full description at www.amazon.jobs. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Sr. Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron
Amazon - Cupertino, California, USA
Sr. AI Inference Platform Engineer
Apple - Seattle, United States of America
Sr. Software Engineer, Training/Inference (C++)
xAI - Palo Alto, CA
Software Engineer, TPU Compilers
OpenAI - San Francisco, California, United States