FewerJobs.
All jobs

Principal Software Engineer - AI Inference and Serving (CoreAI)

Microsoft - Redmond, WA, US

Posted Nov 17, 2026

Benefits

Parental leave
Not verified
Non-birth-parent leave
Not verified
Family-building benefits
  • Fertility benefits: Not verified
  • Adoption assistance: Not verified
  • Surrogacy assistance: Not verified
Mental health support
Not verified
Relocation assistance
Not verified
Childcare support
Not verified
Learning budget
Not verified
Verification
Not verified checked Nov 20, 2026
Salary
$143K-$304K From the posting source
401(k) match
Reported from DOL Form 5500 industry filing (not employer-specific)

Was this benefit information wrong? Tell us.

Market context

U.S. role benchmark (BLS OEWS)
$116,543 U.S. median for this role
Projected growth (BLS Employment Projections)
+9.8% - Much faster than average

92% above the BLS role benchmark for software engineering aggregate.

Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.

Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.

Role

Role function
Engineering From the posting source
Seniority
Staff Plus From the posting source

Schedule

Shift type
Not verified
Weekend work
Not verified

Company

Equity
Offered Verified - SEC 10-K source

Application

Cover letter
Not verified
Assessment
Not verified
Deadline
Not stated

Where they hire

State eligibility is not yet verified.

About this role

Principal Software Engineer - AI Inference and Serving (CoreAI) Redmond, WA, US Overview Microsoft Foundry helps developers and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference faster, more reliable and more efficient for customers. As a Principal Software Engineer, you will own an inference service and lead delivery across gateway and runtime boundaries, improving capacity and cost while meeting customer latency and availability expectations. Responsibilities Evaluate prefix caching, prefill/decode disaggregation, speculative decoding, quantization and tensor/expert parallelism. Preserve streaming, cancellation, retries and token-accounting correctness. Lead capacity planning, incident prevention and model onboarding; mentor engineers. Build secure, tenant-isolated systems with automated testing, observability, reliable recovery and safe releases. Participate in operational support and improve services using production feedback. Preserve model quality and numerical correctness. Use reproducible benchmarks to improve throughput, latency and cost. Pursue near-linear throughput scaling where workloads permit, across agreed GPU and node configurations. Build provider-aware serving stacks and integrate with supported training/post-training stacks for OpenAI, Anthropic, Microsoft AI (MAI) and open-source models. Qualifications Required Qualifications: Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Other Qualifications: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position

Read the full description at apply.careers.microsoft.com. FewerJobs shows a preview and links to the original posting.

Apply at apply.careers.microsoft.com

Apply link verified; last checked Nov 20, 2026.

What verified means

Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.

Related jobs