Principal Software Engineer - AI Inference and Serving (CoreAI)
Microsoft - Redmond, WA, US
Posted Nov 17, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified checked Nov 20, 2026
- Salary
- $143K-$304K From the posting source
- 401(k) match
- Reported from DOL Form 5500 industry filing (not employer-specific)
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
92% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered Verified - SEC 10-K source
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Principal Software Engineer - AI Inference and Serving (CoreAI) Redmond, WA, US Overview Microsoft Foundry helps developers and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference faster, more reliable and more efficient for customers. As a Principal Software Engineer, you will own an inference service and lead delivery across gateway and runtime boundaries, improving capacity and cost while meeting customer latency and availability expectations. Responsibilities Evaluate prefix caching, prefill/decode disaggregation, speculative decoding, quantization and tensor/expert parallelism. Preserve streaming, cancellation, retries and token-accounting correctness. Lead capacity planning, incident prevention and model onboarding; mentor engineers. Build secure, tenant-isolated systems with automated testing, observability, reliable recovery and safe releases. Participate in operational support and improve services using production feedback. Preserve model quality and numerical correctness. Use reproducible benchmarks to improve throughput, latency and cost. Pursue near-linear throughput scaling where workloads permit, across agreed GPU and node configurations. Build provider-aware serving stacks and integrate with supported training/post-training stacks for OpenAI, Anthropic, Microsoft AI (MAI) and open-source models. Qualifications Required Qualifications: Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Other Qualifications: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position
Read the full description at apply.careers.microsoft.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Principal Software Engineer - AI Training Systems (CoreAI)
Microsoft - Redmond, WA, US
Principal System Software Engineer, AI Inference Execution
d-Matrix - Santa Clara, Santa Clara, Ca, Ca, United States
Principal Systems Software Engineer - AI Inference & Hardware/Software Co-Design
Micron Technology, Inc. - Richardson, TX
AI - Principal Software Engineer
Cohu Inc - United States