Software Engineer II & Senior Software Engineer - AI Inference and Serving (CoreAI)
Microsoft - Redmond, WA, US
Posted Nov 17, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified checked Nov 20, 2026
- Salary
- $102K-$219K From the posting source
- 401(k) match
- Reported from DOL Form 5500 industry filing (not employer-specific)
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
38% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered Verified - SEC 10-K source
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Software Engineer II & Senior Software Engineer - AI Inference and Serving (CoreAI) Redmond, WA, US Overview Microsoft Foundry helps developers and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference faster, more reliable and more efficient for customers. We are hiring both Software Engineer II and Senior Software Engineers to join our team. As a Software Engineer on the Foundry inference team, you will own a serving component from design to production. Your work will reduce customer latency and improve serving efficiency. Responsibilities Profile execution, memory and dependency bottlenecks. Improve cache-aware routing, admission control, continuous batching or KV-cache management within your area. Validate time-to-first-token, tail latency and cost per token through load and failure testing. Build secure, tenant-isolated systems with automated testing, observability, reliable recovery and safe releases. Participate in operational support and improve services using production feedback. Preserve model quality and numerical correctness. Use reproducible benchmarks to improve throughput, latency and cost. Pursue near-linear throughput scaling where workloads permit, across agreed GPU and node configurations. Build provider-aware serving stacks and integrate with supported training/post-training stacks for OpenAI, Anthropic, Microsoft AI (MAI) and open-source models. Qualifications Required Qualifications: Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Other Qualifications: Ability to meet Microsoft, customer and/or government security screening requirements are required
Read the full description at apply.careers.microsoft.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Software Engineer II & Senior Software Engineer - AI Training Systems (CoreAI)
Microsoft - Redmond, WA, US
Senior Software Engineer, AI Inference Asset Delivery Platform
Apple - Seattle, United States of America
Staff Software Engineer- Foundation Model Inference
Databricks - San Francisco, California
Senior Software Engineer, Internally Deployed Products
ClickUp - United States