FewerJobs.

Litellm jobs

23 matches, filter-driven and evidence-linked.

Reset
Showing 23 high-confidence listings. 0 additional listings are hidden by default. Show all
23 shown of 23

Benefit evidence

Resolvable source Inferred from posting Unknown provenance
Only verified benefits
  • Senior Security Engineer

    LiteLLM - Remote
    Indexed from Ashby
    2w ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Remote From the posting source Security From the posting source - Senior From the posting source Salary not disclosed

    Senior Security Engineer Remote Senior Security Engineer LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. Our platform gives developers secure, reliable access to LLMs and adjacent services. We're looking for our first Security Engineer to help secure LiteLLM's application, infrastructure, and software-delivery pipeline. About the role This is a hands-on security generalist role with a strong emphasis on application security. You'll spend most of your time reviewing and hardening LiteLLM's Python codebase, identifying new attack surfaces, working directly with engineers to fix vulnerabilities, and making secure development practices part of how we build. You'll also own security work across IT, CI/CD, cloud infrastructure, and the software supply chain. The ideal candidate has built application/product/infrastructure security programs from scratch and genuinely enjoys security outside of work-through CTFs, vulnerability research, open-source projects, or independent experimentation. Responsibilities Application security Conduct deep security reviews of LiteLLM's Python proxy, APIs, authentication systems, and enterprise features. Identify and remediate vulnerabilities involving authentication, authorization, secrets, tenant isolation, injection, and data exposure. Partner directly with engineers throughout design, implementation, code review, and release-not only after code is shipped. Build application-security tooling into the development lifecycle, including SAST, DAST, dependency scanning, and secrets detection. Perform internal red teaming and adversarial testing against LiteLLM's APIs, proxy, and LLM-specific attack surfaces. Threat-model new products and architecture changes before they reach production. Create secure coding guidelines and train engineers on common vulnerabilities and defensive practices. Infrastructure, CI/CD, and supply-chain security Harden LiteLLM's Docker images,

  • Forward Deployed Engineer

    LiteLLM - United States
    Indexed from Ashby
    posted 105 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Unspecified Engineering From the posting source - Mid From the posting source Salary not disclosed Unknown provenance 401(k) reported

    Forward Deployed Engineer United States LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Forward Deployed Engineer to help customers leverage the leading OSS AI gateway. About the Role We're looking for a Forward Deployed Engineer to own customer success @ LiteLLM. You will work with our most important accounts, and be responsible for meeting them regularly, helping with their rollouts, and unblocking them with any feature requests/bugs they might face. This is a customer facing role, where the customer is developers. If you enjoy solving technical problems, and helping developers see success this is a great role for you. Responsibilities Own the 30 most important accounts at LiteLLM, and drive them to success Serve as the technical point of contact for these accounts - in charge of making sure their issues are done, communicating regularly with the customer. Prevent churn-risk by proactively identifying risk, improving and driving usage, and ensuring customers are renewal-ready. Your work here is critical to the company's overall success. Drive product roadmap, by surfacing larger technical gaps/opportunities to the product team. What We're Looking For Technical depth and real familiarity with the LiteLLM product surface Obsessed with customers and making them successful with the product Obsessed with solving root causes rather than patching over problems Excellent customer-facing communication (clear writing, calm execution) + high responsiveness (Slack-first) High autonomy

  • Founding Developer Relations

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    posted 112 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Other - Mid From the posting source Salary not disclosed Equity Unknown provenance 401(k) reported

    Founding Developer Relations San Francisco | OnSite LiteLLM is the open-source AI gateway used by developers and enterprises to access, manage, and govern LLMs through a unified interface. Teams use LiteLLM to route requests across model providers, control spend, monitor usage, implement security policies, and reliably operate AI applications in production. We are looking for our first Developer Relations hire to help more developers discover LiteLLM, understand what they can build with it, and successfully deploy it in production. Why We're Hiring LiteLLM has a large and growing technical community. Developers discover the project through GitHub, documentation, search, technical content, and recommendations from other engineers. But discovering LiteLLM is only the beginning. Developers need to quickly understand how LiteLLM fits into their stack, see credible examples of it solving real problems, and get from their first request to a production deployment. They also need clear ways to share feedback, contribute to the project, and learn about new capabilities. You will help us build that developer journey. This is LiteLLM's first dedicated Developer Relations role. You will establish how we educate developers, engage with the community, support product launches, and turn developer feedback into better documentation, examples, and product decisions. What This Job Actually Is This is a hands-on technical individual-contributor role. You will spend much of your time building with LiteLLM and turning what you learn into resources that help other developers succeed. You should be equally comfortable opening a code editor, explaining an infrastructure concept, and talking with developers

  • Forward Deployed Engineer (New Grad)

    LiteLLM - United States
    Indexed from Ashby
    posted 97 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Unspecified Other - Entry From the posting source Salary not disclosed Unknown provenance 401(k) reported

    Forward Deployed Engineer (New Grad) United States LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Forward Deployed Engineer (New Grad) to help our customers succeed with the leading OSS AI gateway. About the Role We're looking for a Forward Deployed Engineer (New Grad) to help drive our customers to success, primarily through customer calls and interactions in our support queue. Because LiteLLM is a developer tool, this person needs to be technical. You'll dig into our customers' issues, understand them deeply, and unblock them. The core of this role is simple: work the queue, address tickets, and make our customers successful with the product. We're looking for someone who is obsessed with getting to the root cause of problems rather than applying surface-level fixes. The best people in this role understand the real depth of a problem before they solve it. Responsibilities - Own the support queue and work through tickets to drive customers to success - Diagnose customer issues and solve for the root cause, not just the symptom - Reproduce customer issues in their specific environments - Submit pull requests for bug fixes and improvements where needed - Act as the technical voice of the customer back to engineering What We're Looking For - A computer science degree from a top university (mandatory) - Strong technical fundamentals and eagerness to

  • Technical Account Manager

    LiteLLM - United States | San Francisco
    Indexed from Ashby
    posted 104 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Unspecified Sales From the posting source - Mid From the posting source Salary not disclosed Unknown provenance 401(k) reported

    Technical Account Manager United States | San Francisco LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Technical Account Manager to help customers leverage the leading OSS AI gateway. About the Role We're looking for a Technical Account Manager to own customer success @ LiteLLM. You will work with our most important accounts, and be responsible for meeting them regularly, helping with their rollouts, and unblocking them with any feature requests/bugs they might face. This is a customer facing role, where the customer is developers. If you enjoy solving technical problems, and helping developers see success this is a great role for you. Responsibilities Own the 30 most important accounts at LiteLLM, and drive them to success Serve as the technical point of contact for these accounts - in charge of making sure their issues are done, communicating regularly with the customer. Prevent churn-risk by proactively identifying risk, improving and driving usage, and ensuring customers are renewal-ready. Your work here is critical to the company's overall success. Drive product roadmap, by surfacing larger technical gaps/opportunities to the product team. What We're Looking For Technical depth and real familiarity with the LiteLLM product surface Obsessed with customers and making them successful with the product Obsessed with solving root causes rather than patching over problems Excellent customer-facing communication (clear writing, calm execution) + high responsiveness

  • Account Executive

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    posted 85 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Sales From the posting source - Mid From the posting source Salary not disclosed

    Account Executive San Francisco | OnSite LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. About the role We're looking for an Account Executive with experience selling developer tools, such as GitLab or Datadog, to large enterprises with more than 1,000 employees. You'll own the sales cycle from qualified opportunity through close, including discovery, demos, proposals, negotiation, and procurement. You'll work closely with LiteLLM's founders, technical team, and existing sales team to win enterprise customers and help scale a repeatable sales motion. Key Responsibilities Own the sales process: Manage qualified opportunities from discovery through close. Drive revenue: Consistently meet or exceed your ARR quota. Lead enterprise deals: Navigate technical evaluations, security reviews, procurement, and contract negotiations. Maintain a rigorous pipeline: Keep opportunities, next steps, and forecasts accurate and up to date. Improve the sales motion: Help refine our discovery, demos, messaging, and deal processes as the team grows. Represent the customer: Share recurring objections, product requests, and market feedback with the product and engineering teams. Ensure a strong handoff: Partner with the post-sales team to transition new customers successfully. Qualifications 2-4+ years of experience in full-cycle B2B sales, ideally in SaaS or tech startups. Experience selling to regulated industries (e.g. insurance, financial services) is a strong plus. Proven track record of meeting or exceeding quota. Excellent communication and storytelling skills, with the ability to tailor messaging to diverse

  • Staff Engineer, AI

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    1w ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Engineering From the posting source - Staff Plus From the posting source Salary not disclosed Equity

    Staff Engineer, AI San Francisco | OnSite LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We've grown ARR 6x in the last year to nearly $30M with a team of 20, and developers use LiteLLM to call 100+ LLM providers through one API. We're looking for a Staff Engineer to lead our unified API team and make sure every new model and provider works with LiteLLM on day one. About the role This is a hands-on technical lead role. You'll own how LiteLLM unifies LLM APIs across the OpenAI and Anthropic specs, lead the engineers who build it, and set the bar for what good looks like. Every week a provider ships something new: a new API, a new modality, a new feature. The promise of LiteLLM is that it works with all of them on day one. Your job is to keep that promise: new endpoints ship on day one, open source translation issues go down, and developers can count on LiteLLM to keep up. You'll lead our open source pod, where most issues are LLM translation issues. You'll report to the CEO, and later to our Head of Engineering. This role is in person in San Francisco. We help with relocation and support H-1B transfers. Responsibilities Lead the unified API team and own new model, endpoint, and provider rollouts end to end. Design provider-agnostic features at the gateway level, such as session management for non-OpenAI models. Triage open source issues

  • Product Engineer

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    posted 133 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Engineering From the posting source - Mid From the posting source Salary not disclosed Equity

    Product Engineer San Francisco | OnSite Product Engineer LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product. We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day. About the Role This isn't a traditional product management role, and it isn't a traditional software engineering role. You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product. If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here. Responsibilities Build new product features from concept to production. Work directly with customers to understand pain points and validate solutions. Ship quickly while maintaining a high quality bar. Prototype new ideas and iterate based on user feedback. Own major product areas and continuously improve them over time. Design backend APIs and services using Python and FastAPI. Build intuitive developer experiences across our API, dashboard, and CLI. Collaborate directly with the founders on product direction and technical decisions. Help define and build LiteLLM's second major product. What We're Looking For Bachelor's or Master's degree in Computer Science or a related field. Strong

  • Head of CS and Support

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    1w ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Other - Senior From the posting source Salary not disclosed

    Head of CS and Support San Francisco | OnSite LiteLLM is the leading open-source AI gateway, with 60k+ GitHub stars and a rapidly growing developer community. We help companies put AI into production with the reliability, security, and cost controls that enterprise infrastructure demands. LiteLLM's revenue has grown 6x in the past year and is approaching $30M. Our software is used by 50% of the Fortune 500, with paying customers including NVIDIA, Netflix, NASA, IBM, Adobe, AT&T, and multiple departments of the US government. We've achieved this with a small, talent-dense team. We're building the infrastructure layer that powers enterprise AI adoption and are looking for exceptional people to help us scale. As Head of Customer Success, you'll report directly to the CEO, build the team, and shape how we support and grow those relationships, with substantial responsibility from day one. Head of Customer Success & Support We're hiring a Head of Customer Success & Support to own both customer success and customer support at LiteLLM. You'll be responsible for two critical outcomes: Customer Success: Ensure customers successfully deploy LiteLLM, expand adoption across their organizations, and expand their usage with us. Build proactive relationships with customers, understand their goals, and identify risks before they become problems. Customer Support: Ensure customers get fast and reliable technical assistance when something goes wrong. Own everything from support response quality and production escalations to the engineering handoff process and confirmed resolution of customer issues. Reporting directly to the CEO, you'll initially lead a 3-person

  • AI Engineer

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    posted 113 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Engineering From the posting source - Mid From the posting source Salary not disclosed Equity

    AI Engineer San Francisco | OnSite LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product. What you will be working on Skills: Python, LLM APIs, FastAPI As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including: System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.) Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases What is our tech stack The tech stack includes Python, FastAPI, Redis, Postgres. Who we are looking for 1-2 years of backend/full-stack experience with production systems Passion for open source and user engagement Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances) Strong work ethic and ability to thrive in small teams Eagerness to talk to users and help solve real problems Why Join LiteLLM?

  • ML Engineer

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    1w ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Engineering From the posting source - Mid From the posting source Salary not disclosed Equity

    ML Engineer San Francisco | OnSite LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product. What you will be working on Skills: Python, LLM APIs, FastAPI As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including: System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.) Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases What is our tech stack The tech stack includes Python, FastAPI, Redis, Postgres. Who we are looking for 1-2 years of backend/full-stack experience with production systems Passion for open source and user engagement Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances) Strong work ethic and ability to thrive in small teams Eagerness to talk to users and help solve real problems Why Join LiteLLM?

  • Senior Security Operations / Detection Engineer

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    2w ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Security From the posting source - Senior From the posting source Salary not disclosed

    Senior Security Operations / Detection Engineer San Francisco | OnSite LiteLLM is an open-source AI Gateway that gives developers a unified interface to LLM providers. We're looking for a Senior Security Operations / Detection Engineer to build and own detection and response across our infrastructure. About the role You'll own what we can see and how we respond: log pipelines, detections, runbooks, alert handling, and incident coordination. This is a hands-on individual contributor role reporting to our security lead. You'll work directly with engineering to build and operate a detection and response function suited to a small company. San Francisco is preferred. You'll own your roadmap, build and run the tooling yourself, and lead incidents with incomplete information. Strong written communication is essential: you'll coordinate independently with engineers, customers, and vendors across time zones. Responsibilities Build and maintain security log pipelines and document coverage gaps. Build, validate, and tune detections across cloud infrastructure, CI systems, identity providers, and internal services. Manage detections as code, with clear documentation and ongoing maintenance. Write and maintain a runbook for every alert. Define severity-based alert response SLAs and own performance against them. Lead incidents from investigation and containment through recovery and follow-up. Produce clear incident timelines, reports, and recommendations. Measure and improve time to detect and contain threats. Automate detection of unexpected identity and access changes and drive remediation. Prioritize improvements based on risk and the needs of a small engineering organization. What we're looking for 5+ years of relevant experience. Experience building a

  • Senior Support Engineer, EMEA and APAC

    LiteLLM - India | Remote
    Indexed from Ashby
    posted 136 days ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Remote From the posting source Customer Success From the posting source - Senior From the posting source Salary not disclosed Unknown provenance 401(k) reported

    Senior Support Engineer, EMEA and APAC India | Remote LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix and NASA. Our platform gives developers secure, reliable access to LLMs and adjacent services. We're looking for a Senior Support Engineer to help lead support for the leading open source AI gateway. About the Role We're looking for a Senior Support Engineer based in EMEA or APAC to own our support queue in those time zones and drive our customers to success. LiteLLM is a developer tool, so this person needs to be technical. You'll dig into our customers' issues, understand them deeply and unblock them. The core of this role is simple: work the queue, address tickets and make our customers successful with the product. We're looking for someone obsessed with getting to the root cause of problems rather than applying surface fixes. The best people in this role understand the real depth of a problem before they solve it. Responsibilities Own the support queue for EMEA and APAC customers and drive them to success Diagnose customer issues and solve for the root cause, not just the symptom Reproduce customer issues in their specific environments Submit pull requests for bug fixes and improvements where needed Act as the technical voice of the customer back to engineering What We're Looking For Technical depth and real familiarity with the LiteLLM product Obsessed with customers and making them successful with the product Obsessed with solving root causes rather

  • Senior Security Engineer, Product & Platform

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    2w ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Security From the posting source - Senior From the posting source Salary not disclosed

    Senior Security Engineer, Product & Platform San Francisco | OnSite LiteLLM is an open-source AI Gateway that gives developers a unified interface to LLM providers. We're looking for a Senior Security Engineer to secure our application, infrastructure, and software delivery pipeline. About the role This is a hands-on individual contributor role reporting to our security lead. You'll work directly with engineers to review and harden LiteLLM's Python codebase, secure releases, and make security part of how we build. San Francisco is preferred, but not required. You'll own your roadmap, implement improvements yourself, and make day-to-day decisions independently. You should be comfortable prioritizing competing risks and explaining the tradeoffs behind your decisions. The ideal candidate has built and owned a product, platform, or infrastructure security program and knows how to turn security findings into lasting engineering improvements. Responsibilities Review and harden LiteLLM's Python codebase, fixing vulnerabilities and addressing their underlying causes. Review sensitive pull requests and architecture changes before they reach production. Harden our build and release pipeline, including GitHub Actions permissions, workload identity, signing, and credential handling. Build and maintain automated controls for secrets detection, credential management, and software release integrity. Review cloud architecture, IAM, secrets management, and workload identity, and implement security improvements. Build guardrails and secure defaults that fit how engineers work. Document our security architecture, decisions, and operating practices. Own delivery and ongoing maintenance of product and pipeline security improvements. What we're looking for 7+ years of relevant experience, including independent ownership of a security scope. Experience

  • Staff Engineer, Systems and Reliability

    LiteLLM - San Francisco | OnSite
    Indexed from Ashby
    1w ago

    Why we showed this

    Description: "litellm"Employer: "litellm"
    +2
    Onsite - 5d office From the posting source Engineering From the posting source - Staff Plus From the posting source Salary not disclosed Equity

    Staff Engineer, Systems and Reliability San Francisco | OnSite LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We've grown ARR 6x in the last year to nearly $30M with a team of 20, and thousands of companies run production AI through LiteLLM across 100+ provider integrations. We're looking for a Staff Engineer to own the stability and reliability of the gateway. About the role This is a hands-on staff role. You'll find the components behind our regressions and security issues, and refactor or rewrite them so the same problem doesn't come back in 20 places. You'll raise the quality of the codebase through your own code and review, not process documents. LiteLLM is mission-critical infrastructure for our customers. When it breaks, their AI products break. You'll make sure that happens less, and that we know before they do. You'll work with our security and infrastructure team and report to the CEO, and later to our Head of Engineering. This role is in person in San Francisco. We help with relocation and support H-1B transfers. Responsibilities Find the root causes of regressions and security issues and fix the patterns that create them. Lead refactors, rewrites, and migrations of core product code on a system our customers can't afford to have go down. Decide what makes our test suite worth trusting, and build it. Keep CI and releases fast and trustworthy with a large open source contributor base. Review the code paths that matter

  • Principal AI Platform Engineer

    Abbott Laboratories - United States - Illinois - Abbott Park
    Indexed from Workday Benefit evidence checked May 7, 2026 Comp disclosed in posting
    2w ago

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Unspecified Engineering From the posting source - Principal From the posting source Resolvable source Verified parental leave: 8 wksource Resolvable source Verified non-birth-parent leave: 8 wksource $149K-$299K From the posting source Equity Inferred from posting 401(k) reported

    Principal AI Platform Engineer United States - Illinois - Abbott Park Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 122,000 colleagues serve people in more than 160 countries. JOB DESCRIPTION: The Opportunity A hands-on technical leadership role accountable for the architecture, engineering, and reliability of Abbott's enterprise AI Platform: the control plane and paved road that let teams build, deploy, and operate enterprise GenAI and agentic systems safely and quickly. This role is the technical counterpart to the Product Manager, AI Platform and partners with AI Product Managers, AI/Agentic Engineering, Applied Data Science, security, and division engineering teams. The role is Director-mapped and begins as a player-coach, with responsibility to grow and lead a platform engineering team. What You'll Do • Define and evolve the reference architecture for the AI control plane, paved-road services, SDKs, templates, and developer experience. • Design and build a model gateway that supports multi-provider routing, failover, quota and rate limiting, tenant isolation, key management, token accounting, and cost allocation (e.g., a LiteLLM-style gateway over Azure OpenAI, Amazon Bedrock, or Vertex AI). • Deliver a GenAI runtime for model serving, retrieval-augmented generation, context and memory stores, vector and hybrid search, sandboxed tool or code execution, secrets brokering, and MCP-style tool interoperability. • Own the technical design of model, agent, prompt, and tool

  • AI & Data Science Engineer

    DXC Technology - ITA - MI - CERNUSCO SUL NAVIGLIO
    Indexed from Workday Benefit evidence checked Nov 20, 2026
    posted 32 days ago

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Unspecified Engineering From the posting source - Mid From the posting source Salary not disclosed Equity Inferred from posting 401(k) reported

    AI & Data Science Engineer ITA - MI - CERNUSCO SUL NAVIGLIO Job Description: DXC Technology is looking for a Data Scientist to support AI and Generative AI projects , contributing to practical solutions and improving business processes through ML models, NLP and intelligent automation, within the Data & AI team based in Milan. Key Responsibilities Contribute to the design and implementation of AI solutions, including machine learning models, NLP, and computer vision applications Collaborate with senior team members to understand client requirements and translate them into practical AI solutions Support the direct relationship with clients/stakeholders for requirements gathering and solution validation Support pre-sales activities, including preparing technical materials and contributing to client presentations Stay up to date on AI trends and emerging technologies, applying knowledge to support solution development Contribute to maintaining best practices and methodologies within the AI & Data Science team Take part in AI solution projects, gaining hands-on experience in real client environments and progressively growing in autonomy. Requirements Proven experience in Gen AI projects . Ability to translate business requirements into practical AI solutions, including design and implementation . Deep expertise in core Generative AI technologies, including Retrieval-Augmented Generation (RAG), Prompt Engineering, Observability, and AI Guardrails. Extensive experience with enterprise-grade GenAI development frameworks and platforms, including LangChain , LangGraph , LiteLLM , and Langfuse . Proven experience in addressing AI governance, GDPR, and EU AI Act compliance requirements throughout the AI solution lifecycle. Good knowledge of machine learning frameworks and libraries (Python, TensorFlow, PyTorch ,

  • Senior Software Engineer (EU)

    Invert - Europe | Remote
    Indexed from Ashby
    posted 465 days ago

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Remote From the posting source Engineering From the posting source - Senior From the posting source Salary not disclosed Inferred from posting Unlimited PTO Equity

    Senior Software Engineer (EU) Europe | Remote What We're Building Drug development is one of the most data-intensive endeavors in human history. Yet scientists spend more time finding and cleaning data than actually using it, slowing down drugs that should reach patients faster and more affordably. Biopharma has seen billions invested in software. Almost none of it was built for the scientists actually running experiments. Bioprocess data is high-frequency, multi-source, and inconsistent. It's spread across dozens of systems that are rarely connected or clean. We make it usable. On top of that, our AI agent gives scientists something they've never had: the ability to query their full experimental history, catch deviations in real time, and make decisions that inform million-dollar manufacturing outcomes. We think carefully about model behavior, reliability, and what it means for AI to be trustworthy in a regulated industry. Every engineer here owns that problem. This is a place for builders - people who want to own hard problems, ship fast, and work with others who hold themselves to a high bar. The Role You will be joining one of our European engineering teams to tackle hard engineering problems that will help our customers do their critical science. We build with: Backend: Python, FastAPI, PostgreSQL Frontend: Next.js,TypeScript,Tailwind, Vercel Infrastructure: Terraform, AWS AI: Bedrock, Modal, LiteLLM Streaming data: Kinesis, Greengrass As a Senior Software Engineer, you will work closely with your peers on engineering and the product team to ship new features, maintain existing ones, and push our

  • DS - ARCHITECTE IA

    Orange - SALA EL JADIDA,MOROCCO
    Indexed from Phenom People
    yesterday

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Unspecified Other - Mid From the posting source Salary not disclosed

    DS - ARCHITECTE IA SALA EL JADIDA,MOROCCO About us Join us at Orange Business!We are a network and digital integrator that understands the entire value chain of the digital world, freeing our customers to focus on the strategic initiatives that shape their business.Every day, you will collaborate with a team dedicated to providing consistent, sustainable global solutions, no matter where our customers operate. With over 30,000 employees across Asia, the Americas, Africa, and Europe, we offer a dynamic environment to develop and perfect your skills in a field filled with exciting challenges and opportunities. About the role Contexte du poste Dans le cadre du déploiement et de l'évolution de notre plateforme d'intelligence artificielle, nous sommes à la recherche d'un(e) Architecte IA / GenAI confirmé(e). La personne contribuera à la définition de l'architecture cible, à la cohérence des composants de la plateforme et à la mise en place des principes de gouvernance associés. Elle interviendra en lien avec les équipes IT, les équipes métiers, les Business Units et les instances de gouvernance, notamment les comités de Design Authority. Missions principales • Finaliser le déploiement et assurer la cohérence de la plateforme IA, reposant notamment sur LiteLLM, Azure AI Foundry, Langfuse, MLflow et n8n.• Concevoir, documenter et maintenir l'architecture cible de la plateforme IA.• Définir et mettre en œuvre les principes de gouvernance IA couvrant l'architecture, la sécurité, la conformité et l'éthique.• Participer aux comités de Design Authority et formuler des avis d'architecture sur les solutions IA.• Accompagner les Business Units dans

  • Assistant Manager

    EXL Service - Noida, Uttar Pradesh, India
    Indexed from Oracle Recruiting Cloud
    posted 196 days ago

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Unspecified Operations From the posting source - Senior From the posting source Salary not disclosed Equity

    Assistant Manager Noida, Uttar Pradesh, India Navigator is an enterprise-grade solution management and knowledge platform built on FastAPI, DynamoDB, and S3, deployed on AWS EKS. The role involves building scalable APIs, integrating AI/LLM capabilities via an AI Gateway, and contributing to a platform that serves multiple business units across the organization. This is a hands-on development role with exposure to cloud-native architecture, DevSecOps practices, and modern AI integration patterns. The ideal candidate writes clean, production-grade Python code and is comfortable owning features end-to-end - from schema design to deployment. Key Responsibilities API Development Design, develop, and maintain RESTful APIs using Python and FastAPI. Implement RBAC-based access control, input validation, and secure coding practices (OWASP Top 10). Build pagination, filtering, and search capabilities across DynamoDB-backed services. Write clean, testable code with unit and integration test coverage (target 80%+). Data Layer & Storage Design and optimize DynamoDB table schemas, GSIs, and access patterns for high-throughput workloads. Integrate with AWS S3 for blob storage (file uploads, solution assets, icons). Implement data migration scripts and backfill utilities as the schema evolves. AI/LLM Integration Integrate with AI Gateway (LiteLLM-based) for LLM-powered features - summarization, classification, recommendations. Implement prompt engineering patterns, token tracking, and response caching. Build guardrails, content filtering, and cost control mechanisms for AI API consumption. DevOps & Infrastructure Containerize applications using Docker; deploy to AWS EKS (Kubernetes). Maintain CI/CD pipelines (Jenkins) including security gates (Prisma Cloud, SonarQube, Fortify). Manage environment-specific configurations across Dev, UAT, and Production. Observability & Security Implement structured logging (structlog)

  • AI & Data Science Consultant

    DXC Technology - ITA - RM - ROME
    Indexed from Workday Benefit evidence checked Nov 20, 2026
    posted 32 days ago

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Unspecified Data From the posting source - Mid From the posting source Salary not disclosed Equity Inferred from posting 401(k) reported

    AI & Data Science Consultant ITA - RM - ROME Job Description: DXC Technology is looking for a Data Scientist Consultant to support AI and Generative AI projects , contributing to practical solutions and improving business processes through ML models, NLP and intelligent automation, within the Data & AI team based in Rome. Key Responsibilities Contribute to the design and implementation of AI solutions, including machine learning models, NLP, and computer vision applications. Collaborate with senior team members to understand client requirements and translate them into practical AI solutions. Support the direct relationship with clients/stakeholders for requirements gathering and solution validation. Support pre-sales activities, including preparing technical materials and contributing to client presentations. Stay up to date on AI trends and emerging technologies, applying knowledge to support solution development. Contribute to maintaining best practices and methodologies within the AI & Data Science team. Take part in AI solution projects, gaining hands-on experience in real client environments and progressively growing in autonomy. Requirements Proven experience in Gen AI projects . Ability to translate business requirements into practical AI solutions, including design and implementation . Deep expertise in core Generative AI technologies, including Retrieval-Augmented Generation (RAG), Prompt Engineering, Observability, and AI Guardrails. Extensive experience with enterprise-grade GenAI development frameworks and platforms, including LangChain , LangGraph , LiteLLM , and Langfuse . Proven experience in addressing AI governance, GDPR, and EU AI Act compliance requirements throughout the AI solution lifecycle. Good knowledge of machine learning frameworks and libraries (Python, TensorFlow, PyTorch , Scikit-learn,

  • Staff Software Engineer (AI Backend Services)

    Pfizer - 2 Locations
    Indexed from Workday Benefit evidence checked May 7, 2026
    3 days ago

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Unspecified Engineering From the posting source - Staff Plus From the posting source Resolvable source Verified parental leave: 12 wksource Resolvable source Verified non-birth-parent leave: 12 wksource Salary not disclosed Equity Inferred from posting 401(k) reported

    Staff Software Engineer (AI Backend Services) 2 Locations ROLE DESCRIPTION The AI Backend Python Engineer (Staff) will provide technical leadership and define the architecture for backend systems that power the next generation of generative AI applications and large language model (LLM) integrations. This role focuses on driving strategic technical direction, designing platform-level solutions using Python, FastAPI, and AWS, and influencing engineering practices across the organization. KEY RESPONSIBILITIES Define technical strategy and architecture for Python-based AI backend platforms (on FastAPI) that support LLM integration, generative AI pipelines, and AI agent orchestration Architect scalable, reliable, and secure systems on AWS infrastructure (Lambda, EKS) that serve as the foundation for multiple teams Drive technical decisions that impact organization-wide engineering practices and platform capabilities Design and champion AI system observability using LangChain, Langfuse, and litellm Establish engineering standards for monitoring, logging, observability, and operational excellence across AI backend services Lead cross-functional initiatives to optimize performance, security, and scalability of large-scale AI applications Mentor and technically guide engineers at all levels, elevating team capabilities through code reviews, architecture reviews, and technical leadership Identify technical debt, performance bottlenecks, and architectural limitations; drive long-term solutions Collaborate with engineering leadership, product, and other stakeholders to align technical strategy with business objectives Influence technology choices, design patterns, and best practices across the AI Software & Operations department Represent the team in organization-wide technical discussions and drive adoption of innovative solutions BASIC QUALIFICATIONS 7+ years of professional software engineering experience with extensive backend and distributed systems expertise Deep expert-level proficiency

  • Senior Software Engineer (North America)

    Invert - Remote | Canada | United States
    Indexed from Ashby
    posted 465 days ago

    Why we showed this

    Description: "litellm"Description: semantic match
    +1
    Remote From the posting source Engineering From the posting source - Senior From the posting source Salary not disclosed Inferred from posting Unlimited PTO Equity

    Senior Software Engineer (North America) Remote | Canada | United States What We're Building Drug development is one of the most data-intensive endeavors in human history. Yet scientists spend more time finding and cleaning data than actually using it, slowing down drugs that should reach patients faster and more affordably. Biopharma has seen billions invested in software. Almost none of it was built for the scientists actually running experiments. Bioprocess data is high-frequency, multi-source, and inconsistent. It's spread across dozens of systems that are rarely connected or clean. We make it usable. On top of that, our AI agent gives scientists something they've never had: the ability to query their full experimental history, catch deviations in real time, and make decisions that inform million-dollar manufacturing outcomes. We think carefully about model behavior, reliability, and what it means for AI to be trustworthy in a regulated industry. Every engineer here owns that problem. This is a place for builders - people who want to own hard problems, ship fast, and work with others who hold themselves to a high bar. The Role You will be joining one of our North American engineering teams to tackle hard engineering problems that will help our customers do their critical science. We build with: Backend: Python, FastAPI, PostgreSQL Frontend: Next.js,TypeScript,Tailwind, Vercel Infrastructure: Terraform, AWS AI: Bedrock, Modal, LiteLLM Streaming data: Kinesis, Greengrass As a Senior Software Engineer, you will work closely with your peers on engineering and the product team to ship new features, maintain

Take this list with you

Download the 23 matching jobs in any format - read offline, archive, or hand to an AI assistant with your resume to find the best fits.

Or email it to me instead

The AI-ready prompt is a pre-written question you can paste into Claude, ChatGPT, Gemini, or Perplexity along with your resume. We never see your resume; this happens in your AI client of choice.

AI agent reading directly? Same data lives at /api/jobs.json?q=LiteLLM. See /llms.txt and /api/openapi.json for the full schema.