Litellm jobs

Solutions Architect Remote LiteLLM is the open-source AI gateway powering production AI traffic for NASA, Adobe, Netflix, Stripe, Nvidia, and many other Fortune 500s. We provide a unified API across 100+ LLM providers and act as the enterprise control plane for AI traffic. We're a YC W23 company with tens of thousands of GitHub stars and growing fast. ABOUT THE ROLE We're looking for a Solutions Architect to collaborate with our key customers, helping them successfully deploy and scale LiteLLM in production. You'll work directly with customers with primarily pre-sales, along with some post-sales, conducting demos, responding on complex architecture issues, and ensuring that our customers extract maximum value from the platform. This role is ideal for someone who thrives in dynamic, customer-facing environments, enjoys solving customer challenges in real-time, and can translate customer needs into actionable product improvements. RESPONSIBILITIES - Design, implement, and optimize solutions for our customers in pre-sales and post-sales capacities. - Collaborate with customers to identify business needs and tailor product integrations. - Partner closely with engineering and product teams to drive roadmap and deliver mission-critical features. - Serve as a technical and domain expert, bridging the gap between AI innovation and client requirements. - Build and document best practices and solution templates for rapid deployment. REQUIREMENTS - 3+ years of experience in sales engineering, solution engineering, technical consulting, or related roles in high-growth startups or tech companies. - Strong experience working with a developer audience, selling a technical product - Strong technical background; experience with

Developer Evangelist San Francisco | OnSite LiteLLM is the world's most popular AI Gateway used by the largest companies (Adobe, Netflix, NASA, etc.) in the world to give their developers access to LLMs and adjacent services (MCP's, Vector Stores, etc.). WHY DO COMPANIES USE LITELLM ENTERPRISE Companies use LiteLLM Enterprise once they put LiteLLM into production and need enterprise features like Prometheus metrics (production monitoring) and need to give LLM access to a large number of people with SSO (secure sign on) or JWT (JSON Web Tokens). WHAT YOU WILL BE WORKING ON We are looking for someone who is passionate about AI and developer infrastructure that can cultivate a thriving developer community around our product. You will define and drive the strategy for building the developer community. You will work regularly with customers and business team to define requirements and articulate them to our technical team. You will engage with our customers in both technical pre-sales and post-sales capacities, ensuring they are happy and engaged with our product. WHAT YOU WILL DO - Engage in technical conversations in our development community - with both existing and prospective customers. - Generate blog posts and other content to build our user community to get developers to discover and use our product - Provide world-class customer support for our enterprise customers and for our open source customers via forums, email, social networks and wherever else technical questions arise. - Meet with developers at hackathons, meetups, conferences and other events, both local and

Head of Strategy and Operations San Francisco | OnSite ABOUT LITELLM LiteLLM is the open-source AI gateway powering production AI traffic for NASA, Adobe, Netflix, Stripe, Nvidia, and many other Fortune 500s. We provide a unified API across 100+ LLM providers and act as the enterprise control plane for AI traffic. We're a YC W23 company with tens of thousands of GitHub stars and growing fast. As we scale, our enterprise customers expect support that matches the criticality of the workloads they run on us. We need someone to own that. ABOUT THE ROLE We are looking for a Head of Strategy and Operations to help define and accelerate our company internally. This role sits at the intersection of engineering, operations, and go-to-market. We are looking for a high-judgment, highly hands-on operator who is equally comfortable setting high-level strategy and rolling up your sleeves to get things done. We have proven product-market fit, have grown beyond 10M ARR and are fully profitable. We are seeking an experienced, data-driven and process-driven Head of Strategy of Operations to build our operational rigor and culture from the ground up and then iterate. You will build, implement and enforce the processes needed to smoothly scale an AI startup company. You will have immediate and direct impact. RESPONSIBILITIES - Build our sales and customer success playbook and systems from the ground up and create a company culture around it - Focus on sales efficiency, pipeline health, pricing, and revenue forecasting - Define and enforce external

Backend Engineer San Francisco | OnSite Backend Engineer LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale. About The Role You'll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features. Responsibilities - Build and scale our product, ensuring performance, reliability, and continuous improvement. - Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tables - Build and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / Agents - Identify and fix areas where silent failures occur in guardrail creation, registration, and policy application-ensuring robust error handling and transparency to end users - Work with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systems - Enhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to

Senior Machine Learning Engineer - Applied AI & LLMs (x/f/m) Paris, Paris, France Your Impact We are looking for a Senior Machine Learning Engineer to join the ML Engineering team in Patient Solutions . Your mission will be to improve how people access quality care and manage their health over time by building and leading AI and ML systems that create real, measurable impact. You will work in a feature team developing intelligent patient-facing solutions, from smart practitioner discovery to long-term care management, playing a key technical role in shaping how we scale our AI capabilities across Europe. Working in the tech team at Doctolib means building innovative products and features to improve the daily lives of care teams and patients. What you'll do Your responsibilities include but are not limited to: - Design and implement ML and AI solutions aligned with patient product goals, covering search, retrieval, and personalized care pathways - Build and maintain large-scale retrieval pipelines, including hybrid search, embedding systems, vector databases, and multi-stage re-ranking architectures - Develop, fine-tune, and evaluate LLM and VLM models using techniques such as knowledge distillation, Mixture-of-Experts (MoE) architectures, and prompt engineering - Build and orchestrate agentic AI systems, integrating external data and capabilities through tools and MCP-based integrations - Define metrics aligned with product goals, run controlled end-to-end experiments using W&B, MLFlow, or Braintrust, and communicate findings to guide product and technical decisions - Deploy solutions to production in collaboration with our ML platform team, ensuring reliability, observability, and performance

Senior Software Engineer II - (AI Core Platform) Remote, United States As a Senior Software Engineer II at Aledade, we maintain, improve, and expand our web application and data pipelines. We're looking for engineers who know that writing new code is not always the solution to a problem, but when technological changes are needed they create secure, maintainable, performant, correct, scalable, and stable solutions to the complex and unique challenges in our corner of the healthcare industry. They embrace strategies that minimize risk, leaning towards observability, alerting, metrics, high test coverage, and frequent releases that incrementally build value. As a Senior Software Engineer II at Aledade, we maintain, improve, and expand our web application and data pipelines. We're looking for engineers who know that writing new code is not always the solution to a problem, but when technological changes are needed they create secure, maintainable, performant, correct, scalable, and stable solutions to the complex and unique challenges in our corner of the healthcare industry. They embrace strategies that minimize risk, leaning towards observability, alerting, metrics, high test coverage, and frequent releases that incrementally build value. Primary Duties: - Develop and implement scalable and performant solutions. - Partner, as a peer, with Engineering Managers, Product Managers, and stakeholders throughout Aledade to develop and execute technical roadmaps using Agile processes. - Mentor and coach more junior engineers including thorough pull request reviews for other developers and be receptive to critical feedback on your own work. Minimum Qualifications: - BS/BTech (or higher) in

AI Application Engineer I Lisbon, Estremadura, Portugal Your opportunity At Mollie, we're on a mission to make payments and money management effortless for every business in Europe. Today, we serve more than 300,000 businesses across Europe with an all-in-one solution that simplifies payments and money management. And we're a 850-strong team of product, finance, support, commerce, and engineering specialists working across Europe - from Lisbon to London. In this role, you will help design, build, integrate, and scale AI-powered applications and workflows that create direct impact across the business. You will work closely with Machine Learning Engineers as well as with Application Engineers across different Domains and Teams, to deliver pragmatic agentic AI solutions for both internal users and Mollie customers. The focus of the role is not model research or training deep learning systems from scratch. Instead, your core focus will be on these application-level activities. This role is a strong fit for a flexible engineer who views Artificial Intelligence as a tool, not a replacement, and who is capable of learning in a rapidly changing environment. What you will be doing: - Develop agent-based and workflow-driven solutions with modern AI orchestration tools, across both low-code and code-first approaches - Design and develop SDKs, reusable frameworks, and internal toolkits that enable teams to rapidly build and deploy agentic AI solutions - Use and extend open-source AI tooling such as LibreChat, LiteLLM, browser-based automation tools, and related components - Build and customise the frontend interfaces of AI-powered tools and platforms,

Senior Infrastructure Engineer (Core Infra, US) New York, New York; Palo Alto, California About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise MCP and trusted by 50% of the Fortune 500, Workato's cloud-native architecture connects every application, data source, and process to power real-time orchestration at scale. With enterprise-grade security and continuous innovation at its core, Workato provides the trusted foundation for organizations to automate with confidence and operationalize AI across the business. To learn more, visit www.workato.com Why join us? Ultimately, Workato believes in fostering a flexible, trust-oriented culture that empowers everyone to take full ownership of their roles . We are driven by innovation and looking for team players who want to actively build our company. But, we also believe in balancing productivity with self-care . That's why we offer all of our employees a vibrant and dynamic work environment along with a multitude of benefits they can enjoy inside and outside of their work lives. If this sounds right up your alley, please submit an application. We look forward to getting to know you! Also, feel free to check out why: - Business Insider named us an “enterprise startup to bet your career on” - Forbes' Cloud 100 recognized us as one of the top 100 private cloud companies in the world - Deloitte Tech Fast 500 ranked us as the 17th fastest growing tech company

Senior Software Engineer - Enterprise AI Bangalore About Rubrik and the team Rubrik is on a mission to secure the world's data. With our Zero Trust Data Security™ platform, we help organizations achieve business resilience against cyberattacks, malicious insiders, and operational disruptions. Rubrik protects data wherever it lives-across enterprise, cloud, and SaaS-and delivers data observability, orchestration, and recovery at scale. The Information Technology team at Rubrik influences business processes, employee experience, and technologies to scale our organization to $1B+. This team creates operational efficiency across the company by centralizing the management of Infrastructure, Technology, and Data. The IT team ensures all stages of the software development lifecycle in a secured environment and scrutinizes the deployment of proper processes along with governance. They champion Rubrik on Rubrik and are the first customers of the Engineering teams at Rubrik. We're transforming global infrastructure, and we're looking for bold thinkers and builders to join us. If you're passionate about making an impact and shaping the future of cloud and platform infrastructure-we'd love to hear from you. About the Role The Enterprise AI team is Rubrik's internal AI enablement engine. We evaluate where AI can make a real difference, build the platforms and patterns that make adoption easy, and help engineering teams across the organization work smarter and faster. We operate at the intersection of applied AI, distributed systems, and enterprise operations - our job is to make Rubrik more efficient, one AI-powered workflow at a time. This is a high-impact, high-autonomy team where

Senior Software Engineer (MLAI services) Sofia, Bulgaria About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise MCP and trusted by 50% of the Fortune 500, Workato's cloud-native architecture connects every application, data source, and process to power real-time orchestration at scale. With enterprise-grade security and continuous innovation at its core, Workato provides the trusted foundation for organizations to automate with confidence and operationalize AI across the business. To learn more, visit www.workato.com Why join us? Ultimately, Workato believes in fostering a flexible, trust-oriented culture that empowers everyone to take full ownership of their roles . We are driven by innovation and looking for team players who want to actively build our company. But, we also believe in balancing productivity with self-care . That's why we offer all of our employees a vibrant and dynamic work environment along with a multitude of benefits they can enjoy inside and outside of their work lives. If this sounds right up your alley, please submit an application. We look forward to getting to know you! Also, feel free to check out why: - Business Insider named us an “enterprise startup to bet your career on” - Forbes' Cloud 100 recognized us as one of the top 100 private cloud companies in the world - Deloitte Tech Fast 500 ranked us as the 17th fastest growing tech company in the Bay Area, and 96th

Senior Software Engineer - Agentic AI Wroclaw About airSlate airSlate is a global SaaS technology company that develops no-code workflow automation, electronic signature, and document management solutions. Our award-winning products - SignNow, pdfFiller, DocHub, altaFlow, Instapage, and US Legal Forms - serve over hundreds of millions of users and more than one million customers worldwide, helping organizations of every size digitize processes, improve efficiency, and transform how they work. We're in an exciting phase of growth and transformation, with teammates in more than 20 countries across three continents and main hubs in the United States, Poland, Romania, Ukraine and Philippines. At airSlate, we're building value for customers and a culture where growth and innovation go hand in hand. We're looking for people eager to shape products, scale a company, and thrive in a fast-moving environment. About SignNow team: We are a passionate and ambitious team of 100+ people on a mission to succeed with our award-winning signature solution - SignNow. SignNow empowers over 28 million people at companies across the world to move fast with everything they need to send and eSign their documents. Increase productivity with document workflows, impress customers, and save money while maximizing ROI with SignNow. And now we are looking for a Senior AI Engineer to focus on building AI capabilities from the ground up in a greenfield environment, helping shape the foundations of how intelligence is embedded into the product. You will design and implement production-grade agentic workflows, pipelines, and AI-powered product experiences, going beyond

Software Engineer Arlington, VA At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to Work, we offer a collaborative and caring community where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more. Join us to drive positive, lasting change that moves missions and the government forward! The work As a Software Engineer in this role, you will drive the development of distributed backend services and robust APIs that form the backbone of a modern Hub-and-Spoke architecture. Your work will directly support the acceleration of operational AI adoption, enabling mission applications, enterprise AI governance, agentic AI systems, and scalable software delivery Key responsibilities: - Design, develop, and maintain backend microservices and distributed systems to support enterprise AI operations - You will be responsible for building and maintaining microservices that integrate seamlessly with cloud-native platforms, ensuring continuous monitoring and high reliability across all operational workflowsBuild and optimize APIs and event-driven architectures for scalable and reliable data flow - Develop Kubernetes-native and cloud-native applications for robust, production-grade deployments - Integrate and leverage technologies such as Rust, Go,

Senior Software Engineer (EU) Europe | Remote WHAT WE'RE BUILDING Drug development is one of the most data-intensive endeavors in human history. Yet scientists spend more time finding and cleaning data than actually using it, slowing down drugs that should reach patients faster and more affordably. Biopharma has seen billions invested in software. Almost none of it was built for the scientists actually running experiments. Bioprocess data is high-frequency, multi-source, and inconsistent. It's spread across dozens of systems that are rarely connected or clean. We make it usable. On top of that, our AI agent gives scientists something they've never had: the ability to query their full experimental history, catch deviations in real time, and make decisions that inform million-dollar manufacturing outcomes. We think carefully about model behavior, reliability, and what it means for AI to be trustworthy in a regulated industry. Every engineer here owns that problem. This is a place for builders - people who want to own hard problems, ship fast, and work with others who hold themselves to a high bar. THE ROLE You will be joining one of our European engineering teams to tackle hard engineering problems that will help our customers do their critical science. We build with: - Backend: Python, FastAPI, PostgreSQL - Frontend: Next.js,TypeScript,Tailwind, Vercel - Infrastructure: Terraform, AWS - AI: Bedrock, Modal, LiteLLM - Streaming data: Kinesis, Greengrass As a Senior Software Engineer, you will work closely with your peers on engineering and the product team to ship new features, maintain

Product Partnerships Manager San Francisco, California, United States Who Are We? Postman is the world's leading API platform, used by more than 45 million+ developers and 500,000 organizations, including 98% of the Fortune 500. Postman is helping developers and professionals across the globe build the API-first world by simplifying each step of the API lifecycle and streamlining collaboration-enabling users to create better APIs, faster. The company is headquartered in San Francisco and has offices in Boston, New York, Austin, Tokyo, London, and Bangalore - where Postman was founded. Postman is privately held, with funding from Battery Ventures, BOND, Coatue, CRV, Insight Partners, and Nexus Venture Partners. Learn more at postman.com or connect with Postman on X via @getpostman. P.S: We highly recommend reading The "API-First World" graphic novel to understand the bigger picture and our vision at Postman. The Opportunity Postman is hiring a Product Partnerships Manager to own a portfolio of high-impact product partnerships - the people, the integrations, the launches, and the metrics that come out the other side. You'll report to the Director, Product Partnerships, and operate as a hands-on IC owning 2-3 named partnerships across the AI infrastructure, MCP, IDE, SDK generation, or platform partner categories. You'll work with R&D to build the integrations, GTM to launch them, and the partner directly to keep the relationship moving. You'll be measured on what your partnerships actually do for Postman users - installs, MAU , satisfaction, joint pipeline, partner-attributed revenue, and the depth of the integration itself. This

Senior Software Engineer (North America) Remote | United States | Canada WHAT WE'RE BUILDING Drug development is one of the most data-intensive endeavors in human history. Yet scientists spend more time finding and cleaning data than actually using it, slowing down drugs that should reach patients faster and more affordably. Biopharma has seen billions invested in software. Almost none of it was built for the scientists actually running experiments. Bioprocess data is high-frequency, multi-source, and inconsistent. It's spread across dozens of systems that are rarely connected or clean. We make it usable. On top of that, our AI agent gives scientists something they've never had: the ability to query their full experimental history, catch deviations in real time, and make decisions that inform million-dollar manufacturing outcomes. We think carefully about model behavior, reliability, and what it means for AI to be trustworthy in a regulated industry. Every engineer here owns that problem. This is a place for builders - people who want to own hard problems, ship fast, and work with others who hold themselves to a high bar. THE ROLE You will be joining one of our North American engineering teams to tackle hard engineering problems that will help our customers do their critical science. We build with: - Backend: Python, FastAPI, PostgreSQL - Frontend: Next.js,TypeScript,Tailwind, Vercel - Infrastructure: Terraform, AWS - AI: Bedrock, Modal, LiteLLM - Streaming data: Kinesis, Greengrass As a Senior Software Engineer, you will work closely with your peers on engineering and the product team

Senior Software Engineer, AI Platform & Agents Any location, Canada About us Coalition is the world's first Active Insurance provider designed to help prevent digital risk before it strikes. Founded in 2017, Coalition combines comprehensive insurance coverage and innovative cybersecurity tools to help businesses manage and mitigate potential cyberattacks. Opportunities to make an impact with bold thinking are real-and happening daily at Coalition. About the role We are hiring a Senior Software Engineer to lead the development of our internal AI platform and orchestration components, helping us accelerate the deployment of intelligent Agents and RAG pipelines across the organization. You will own the core infrastructure and SDKs that bridge the gap between raw LLM capabilities and production-grade applications, turning complex AI research and data into seamless, scalable tools for our engineering teams. Your work will directly enable us to automate sophisticated workflows and deliver smarter, AI-driven products to our users. You'll be a key architect and builder of our internal AI platform, designing components that power various AI Agents and Retrieval-Augmented Generation (RAG) pipelines. You prioritize ensuring that complex logic branches and AI workflows are well-understood, tested, and focused on engineering excellence. You will build APIs and services that are highly intuitive to consume, ensuring our internal teams can seamlessly integrate AI capabilities into their workflows. Responsibilities - AI Platform Engineering: Build and maintain the core infrastructure, services, and SDKs that empower the rest of the company to leverage LLMs and Agentic workflows. - Scientific Collaboration: Partner closely with Applied