Associate Director/Director, Inference Engineering
Lila Sciences - Cambridge, MA USA; San Francisco, CA USA
Posted Oct 26, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Offered From the posting source checked Nov 16, 2026
- Verification
- Not verified
- Salary
- $204K-$348K From the posting source checked Nov 16, 2026
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
137% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Nov 16, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Associate Director/Director, Inference Engineering Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA Lila is hiring an Associate Director/Director, Inference Engineering to lead the team responsible for Lila's model serving platform: the inference APIs, serving frameworks, request routing, batching strategies, and deployment systems that bring models reliably to production. You will define how Lila serves models at scale, balancing latency, throughput, quality, and cost, and act as the technical authority connecting research and ML to production-grade serving capabilities. The work spans people leadership, service ownership, cross-functional partnership, and deep technical judgment in modern LLM serving. What You'll Be Building - Own the inference service end to end: API contracts, latency SLAs, throughput guarantees, rate limits - Drive serving architecture decisions: batching, KV cache, speculative decoding, quantization, multi-node deployment - Establish SLOs for latency, throughput, and availability, plus on-call and postmortem practices - Partner with ML, research, and product engineering to make new models production-ready - Build systems for model onboarding, deployment safety, evaluation gates, and observability - Build, mentor, and retain a high-performing engineering team, and own the serving roadmap What You'll Need to Succeed - Deep understanding of the inference stack for large language models, including serving frameworks (e.g., vLLM, TensorRT-LLM, TGI), batching strategies, memory constraints, and latency/throughput tradeoffs - Experience owning a customer- or product-facing API service end to end, including SLAs, incident response, and service reliability in fast-moving environments - Track record hiring, mentoring, and retaining senior technical talent, and scaling engineering organizations through rapid
Read the full description at job-boards.greenhouse.io. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Senior Director of Engineering - Inference Serving
SambaNova Systems - San Jose, California, United States
Member of Technical Staff - Inference Systems
Liquid AI - Boston, Cambridge, Massachusetts, United States
Director / Senior Director, AI x Lab Integration
Lila Sciences - Cambridge, MA USA; San Francisco, CA USA
Senior Backend Engineer, Inference Platform
Together AI - San Francisco