Machine Learning Engineer, SageMaker AI Inference
Amazon - Bellevue, Washington, USA
Posted Oct 23, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
- Mental health support
- Offered From the posting source checked Nov 16, 2026
- Relocation assistance
- Not verified
- Childcare support
- Offered From the posting source checked Nov 16, 2026
- Learning budget
- Not verified
- Verification
- Not verified checked Nov 20, 2026
- Salary
- $144K-$194K From the posting source checked Nov 16, 2026
- 401(k) match
- Reported from DOL Form 5500 industry filing (not employer-specific)
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
45% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered Verified - SEC 10-K source checked Nov 16, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Machine Learning Engineer, SageMaker AI Inference Bellevue, Washington, USA Demand for large language model (LLM) inference is growing fast, and the engineers who make it faster and more efficient are shaping the future of AI at Amazon. We are looking for a Software Development Engineer to focus on inference performance optimization, kernel tuning, and LLM serving efficiency. You will work across the full software development lifecycle to design, build, and measure systems that reduce latency and improve throughput for production inference workloads. This is a hands-on engineering role where your work directly translates into better performance for internal teams and, ultimately, for Amazon's customers. If you are an engineer who enjoys profiling bottlenecks, writing high-performance code, and finding elegant solutions to hard systems problems, we want to talk to you. Key job responsibilities - Design and implement kernel-level optimizations and inference pipeline improvements that reduce latency and increase throughput for LLM serving workloads. - Profile, benchmark, and tune model inference performance across hardware and software stacks, identifying bottlenecks and delivering measurable gains. - Write well-organized, maintainable code and participate actively in code reviews, providing constructive feedback to peers and mentoring newer engineers on the team. - Collaborate with applied scientists, ML engineers, and infrastructure teams to translate model requirements into production-ready inference solutions. - Evaluate emerging tools, frameworks, and generative AI techniques for inference optimization, recommending adoption where they improve efficiency or quality. A day in the life You might start your morning reviewing benchmark results from an overnight profiling
Read the full description at www.amazon.jobs. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Senior Machine Learning Engineer, SageMaker Inference
Amazon - Bellevue, Washington, USA
Machine Learning Engineer - Inference
Together AI - San Francisco
AIML - LLM Inference Quality Engineer
Apple - Seattle, United States of America
Software Engineer, TPU Compilers
OpenAI - San Francisco, California, United States