FewerJobs.
All jobs

Associate Director/Director, Inference Engineering

Lila Sciences - Cambridge, MA USA; San Francisco, CA USA

Posted Oct 26, 2026

Benefits

Parental leave
Not verified
Non-birth-parent leave
Not verified
Family-building benefits
  • Fertility benefits: Not verified
  • Adoption assistance: Not verified
  • Surrogacy assistance: Not verified
Mental health support
Not verified
Relocation assistance
Not verified
Childcare support
Not verified
Learning budget
Offered From the posting source checked Nov 16, 2026
Verification
Not verified
Salary
$204K-$348K From the posting source checked Nov 16, 2026
401(k) match
Not verified

Was this benefit information wrong? Tell us.

Market context

U.S. role benchmark (BLS OEWS)
$116,543 U.S. median for this role
Projected growth (BLS Employment Projections)
+9.8% - Much faster than average

137% above the BLS role benchmark for software engineering aggregate.

Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.

Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.

Role

Role function
Engineering From the posting source checked Nov 16, 2026
Seniority
Director Plus From the posting source checked Nov 16, 2026

Schedule

Shift type
Not verified
Weekend work
Not verified

Company

Equity
Offered From the posting source checked Nov 16, 2026

Application

Cover letter
Not verified
Assessment
Not verified
Deadline
Not stated

Where they hire

State eligibility is not yet verified.

About this role

Associate Director/Director, Inference Engineering Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA Lila is hiring an Associate Director/Director, Inference Engineering to lead the team responsible for Lila's model serving platform: the inference APIs, serving frameworks, request routing, batching strategies, and deployment systems that bring models reliably to production. You will define how Lila serves models at scale, balancing latency, throughput, quality, and cost, and act as the technical authority connecting research and ML to production-grade serving capabilities. The work spans people leadership, service ownership, cross-functional partnership, and deep technical judgment in modern LLM serving. What You'll Be Building - Own the inference service end to end: API contracts, latency SLAs, throughput guarantees, rate limits - Drive serving architecture decisions: batching, KV cache, speculative decoding, quantization, multi-node deployment - Establish SLOs for latency, throughput, and availability, plus on-call and postmortem practices - Partner with ML, research, and product engineering to make new models production-ready - Build systems for model onboarding, deployment safety, evaluation gates, and observability - Build, mentor, and retain a high-performing engineering team, and own the serving roadmap What You'll Need to Succeed - Deep understanding of the inference stack for large language models, including serving frameworks (e.g., vLLM, TensorRT-LLM, TGI), batching strategies, memory constraints, and latency/throughput tradeoffs - Experience owning a customer- or product-facing API service end to end, including SLAs, incident response, and service reliability in fast-moving environments - Track record hiring, mentoring, and retaining senior technical talent, and scaling engineering organizations through rapid

Read the full description at job-boards.greenhouse.io. FewerJobs shows a preview and links to the original posting.

Apply at job-boards.greenhouse.io

Apply link verified; last checked Nov 20, 2026.

What verified means

Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.

Related jobs