ML Engineer
LiteLLM - San Francisco | OnSite
Posted Nov 11, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- Not verified
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Nov 18, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
ML Engineer San Francisco | OnSite LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product. What you will be working on Skills: Python, LLM APIs, FastAPI As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including: System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.) Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases What is our tech stack The tech stack includes Python, FastAPI, Redis, Postgres. Who we are looking for 1-2 years of backend/full-stack experience with production systems Passion for open source and user engagement Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances) Strong work ethic and ability to thrive in small teams Eagerness to talk to users and help solve real problems Why Join LiteLLM?
Read the full description at jobs.ashbyhq.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
AI Engineer
LiteLLM - San Francisco | OnSite
Machine Learning Engineer
Onyx - San Francisco, California, United States
ML Engineer, Platform
Physical Intelligence - San Francisco, California, United States
Machine Learning Engineer, API Multicloud
OpenAI - San Francisco, California, United States