Scale AI jobs

Staff AI Engineer TORONTO, Ontario, Canada Join our team as a Senior Staff AI Engineer and lead the design and deployment of enterprise-scale AI platforms. Drive innovation in API and LLM integration, infrastructure, and security at scale. Collaborate with top talent to shape the future of AI at RBC. Grow your career with cutting-edge technology and impactful projects.

Principal Engineer - AI Networking Seattle, WA, United States Oracle is seeking a Principal Software Engineer (IC4) to join our AI Networking team and help build the high-performance communication infrastructure that powers large-scale AI and HPC workloads. This role focuses on developing RDMA-based software, collective communication libraries, networking services, congestion management solutions, and distributed systems that enable efficient scaling across large GPU clusters. In this role, you will help develop the networking and communication technologies that underpin Oracle's AI infrastructure. Your work will directly influence the performance, scalability, and reliability of large-scale GPU clusters running advanced AI training and inference workloads, while giving you the opportunity to work on some of the most challenging networking and distributed systems problems in the industry.

Principal AI Engineer Navi Mumbai, Mahārāshtra, India Exciting opportunity for a Principal AI Engineer to lead the architecture and scaling of enterprise-grade AI platforms. Drive innovation in LLMs, ML inference, and cloud-native solutions, collaborating with cross-functional teams to deliver impactful AI products for global ESG assessments. Join us to shape the future of AI engineering at scale.

Sr. Staff AI Research TLM - AI Systems Mountain View, California; San Francisco, California Principal Research Scientist - Scaling P-1227 About Databricks AI At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development, by building and running the world's best data and AI platform. The Databricks AI Research organization enables companies to develop AI models and agents using their own data, with technologies ranging from post-training open source LLMs to developing advanced multi-agent architectures. Databricks AI is committed to the belief that a company's AI models and agents are just as valuable as any other core IP, and that high-quality AI should be available to all. About the Scaling Research Team The Databricks AI Scaling team focuses on pushing the boundaries of large language model (LLM) training and inference efficiency beyond what is required to support existing models. The team explores novel avenues for scaling and efficiency improvements across algorithms, systems, and infrastructure, requiring researchers who can both drive independent research agendas and dive deep into low‑level implementation details with engineering partners. Role Summary As a Principal Research Scientist - Scaling, you will lead a team of world‑class researchers and engineers to advance the state of the art in large‑scale machine learning, focusing on post-training, RL and inference efficiency, optimization, and scaling. You will define and execute a research roadmap that advances the Databricks AI platform and delivers tangible improvements to how customers train, serve, and adapt

Senior Principal Engineer - AI Networking Seattle, WA, United States Oracle is seeking a highly experienced Lead Principal Software Engineer (IC5) to help define and build the next generation of AI networking infrastructure powering large-scale GPU clusters and distributed AI training platforms. This role focuses on high-performance networking, RDMA-based services, collective communication libraries, congestion management, resiliency, and software platforms that enable efficient operation of large-scale AI workloads. In this role, you will help build the networking and communication foundation for Oracle's AI infrastructure, enabling efficient scaling of cutting-edge AI workloads across large GPU clusters. Your work will directly influence the performance, reliability, and scalability of systems powering some of the industry's largest AI deployments.

Principal Research Scientist – Scaling San Francisco, California Principal Research Scientist - Scaling P-1227 About Databricks AI At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development, by building and running the world's best data and AI platform. The Databricks AI Research organization enables companies to develop AI models and agents using their own data, with technologies ranging from post-training open source LLMs to developing advanced multi-agent architectures. Databricks AI is committed to the belief that a company's AI models and agents are just as valuable as any other core IP, and that high-quality AI should be available to all. About the Scaling Research Team The Databricks AI Scaling team focuses on pushing the boundaries of large language model (LLM) training and inference efficiency beyond what is required to support existing models. The team explores novel avenues for scaling and efficiency improvements across algorithms, systems, and infrastructure, requiring researchers who can both drive independent research agendas and dive deep into low‑level implementation details with engineering partners. Role Summary As a Principal Research Scientist - Scaling, you will lead a team of world‑class researchers and engineers to advance the state of the art in large‑scale machine learning, focusing on post-training, RL and inference efficiency, optimization, and scaling. You will define and execute a research roadmap that advances the Databricks AI platform and delivers tangible improvements to how customers train, serve, and adapt LLMs at scale, working closely with

Senior / Staff Machine Learning Research Scientist, Agents San Francisco, CA; Seattle, WA; New York, NY About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations. About the ACE team The Agent Capabilities & Environments (ACE) team, part of Scale's Research organization, brings together customer-facing Researchers and Applied AI Engineers. Our core mission includes research on agent environments and RL reward signals, benchmarking autonomous agent performance across real-world scenarios and environments, creating robust data programs to improve Large Language Models (LLMs) agentic capabilities and building foundational tools and frameworks for evaluating models as agents. ACE focuses on autonomous agents that dynamically interact with diverse external environments, including code repositories, GUI interfaces, browsers, and more. About This Role This role is at the intersection of cutting-edge AI research and practical application, with a focus on studying the data types essential for building state-of-the-art agents, such as browser and SWE agents. The ideal candidate will explore the data landscape needed to advance intelligent, adaptable AI agents, guiding the data strategy at Scale to

Strategist, Saudi Arabia Riyadh, Saudi Arabia Scale's rapidly growing Global Public Sector team is focused on using AI to address critical challenges facing the public sector around the world. Our core work consists of: - Building custom AI applications that will impact millions of citizens and government employees - Generating high-quality training data for custom LLMs - Upskilling and AI advisory services to spread the impact of AI As a Strategist, you'll be responsible for growing the Global Public Sector business unit and partnering with technical stakeholders to identify and win major opportunities in the public sector and selected accounts across the GCC. You will develop and execute on a go to market strategy for customer acquisition, navigating a dynamic and often unstructured environment to make impactful decisions. This is a technical role that requires the following: - A deep interest in AI and data and the ability to articulate technical concepts in simple, precise language - Experience successfully navigating and partnering with governments and senior stakeholders across the GCC - Working cross-functionally with Scale Leadership, Product, Marketing, Legal, Finance, Operations, and Compliance to ensure customer success - An ability to earn trust and develop close relationships with key decision-makers and influencers within accounts - An ability to uncover business challenges, shape and scope how AI can address these challenges, and build business cases to show the impact and value of Scale's offerings At Scale, we're not just building AI solutions-we're enabling the public sector to transform their operations and

Strategist, Abu Dhabi Abu Dhabi, UAE Scale's rapidly growing Global Public Sector team is focused on using AI to address critical challenges facing the public sector around the world. Our core work consists of: - Building custom AI applications that will impact millions of citizens and government employees - Generating high-quality training data for custom LLMs - Upskilling and AI advisory services to spread the impact of AI As a Strategist, you'll be responsible for growing the Global Public Sector business unit and partnering with technical stakeholders to identify and win major opportunities in the public sector and selected accounts across the GCC. You will develop and execute on a go to market strategy for customer acquisition, navigating a dynamic and often unstructured environment to make impactful decisions. This is a technical role that requires the following: - A deep interest in AI and data and the ability to articulate technical concepts in simple, precise language - Experience successfully navigating and partnering with governments and senior stakeholders across the GCC (in near term Qatar, mid-term UAE & KSA) - Working cross-functionally with Scale Leadership, Product, Marketing, Legal, Finance, Operations, and Compliance to ensure customer success - An ability to earn trust and develop close relationships with key decision-makers and influencers within accounts - An ability to uncover business challenges, shape and scope how AI can address these challenges, and build business cases to show the impact and value of Scale's offerings At Scale, we're not just building AI solutions-we're enabling

Senior Staff AI-Native Software Engineer – Agentic Systems Santa Clara, CALIFORNIA, United States Company Description: It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone-freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow- helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started. Join us to put AI to work for people. Job Description: AI Engineering and Delivery is the customer-obsessed engineering group building the agentic AI and enterprise-scale search systems that power Now Assist, AI Agents, and the AI-driven experiences our customers rely on every day. We build AI as foundational platform infrastructure - prioritizing robustness, performance, safety, and real-world customer impact at scale. About the Team AI Engineering and Delivery is the customer-obsessed engineering group building the agentic AI and enterprise-scale search systems that power Now Assist, AI Agents, and the AI-driven experiences our customers rely on every day. We build AI as foundational platform infrastructure - prioritizing robustness, performance, safety, and real-world customer impact at scale. Types of problems you'll get to work on You will design, build, and operate production-grade agentic AI systems embedded across ServiceNow's

Software Engineer, Enterprise AI New York, NY; San Francisco, CA Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will be responsible for owning large new areas within our product, working across backend, frontend, and interacting with LLMs and ML models. You will solve hard engineering problems in scalability and reliability. You will: - Own large new areas within our product - Work across backend, frontend, and interacting with LLMs and ML models - Deliver experiments at a high velocity and level of quality to engage our customers - Work across the entire product lifecycle from conceptualization through production - Be able, and willing, to multi-task and learn new technologies quickly Ideally you'd have: - 4+ years of full-time engineering experience, post-graduation - Experience scaling products at hyper growth startups - Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies - Proficient in Python or Javascript/Typescript, and SQL - Experience with Kubernetes - Experience with major cloud providers (AWS, Azure, GCP) Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum

Distributed Systems Cluster Security Software – Engineering Lead Sunnyvale, CA Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs. Cerebras' current customers include top model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras , to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference. Thanks to the groundbreaking wafer-scale architecture, Cerebras Inference offers the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. About The Role In this role, you will be the security czar for the Cerebras's AI cluster product. Such AI clusters have 100's of Wafer-scale accelerator systems, 1000's of high-end servers, and several 1000's of networking ports including switches. Plus, there will be network attached storage, all in a large-scale datacenter. You will ensure that Cerebras's large-scale AI clusters are secured through first-principles, best practices, security-first based engineering. Cerebras cluster involves complex HW components, networking and a vertically integrated cluster management software

Senior Software Engineer, GenAI San Francisco, CA; New York, NY About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations. About Data Engine Our Generative AI Data Engine powers the world's most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI. Our Approach As part of the interview process, you'll be considered for opportunities across several teams within the GenAI Engineering organization, based on your interests, expertise, and business needs. Potential team placements include Allocation, Growth, Frontier Data, Trust & Safety, Pay, Operator, or Tasking Experience. Together, these teams power Scale's AI data operations - from building high-impact datasets that push the boundaries of LLM capabilities, to optimizing contributor onboarding and incentives, to safeguarding data integrity through advanced trust, safety, and security measures. They work at the intersection of ML, operations, and analytics to ensure we deliver the highest-quality data

Engineering Manager, Global Public Sector London, UK Scale's rapidly growing International Public Sector team is focused on using AI to address critical challenges facing the public sector around the world. Our core work consists of: - Creating custom AI applications that will impact millions of citizens - Generating high-quality training data for national LLMs - Upskilling and advisory services to spread the impact of AI Our Scale Generative AI Platform (SGP) powers production-grade GenAI applications with foundational services, APIs, and infrastructure that accelerate adoption across industries. As more of these applications move from prototype to production, we are investing heavily in the core platform that enables this scale. We are looking for a technical and strategic Engineering Manager to lead our Engineering efforts Internationally to power custom applications we build for our public sector clients. At Scale, we're not just building AI solutions-we're enabling the public sector to transform their operations and better serve citizens through cutting-edge technology. If you're ready to shape the future of AI in the public sector and be a founding member of our team, we'd love to hear from you. You will: - Manage the engineering team and drive technical delivery. - Design, build, and optimize backend services for advanced AI-driven applications, focusing on AI agents, evaluation tooling, and automation. - Comfortable working cross functionally, whether that be internal or external customers - Work across the entire product lifecycle from conceptualization through production - Build features end-to-end, system design, debugging and testing - Deliver experiments

Scaled Enterprise Account Executive, Industries New York City, NY; San Francisco, CA About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Scaled Enterprise team is a high-velocity sales motion built to bring frontier AI to a broad set of enterprise accounts. We're focused on reaching new customers efficiently, turning first conversations into real, expanding partnerships, and building the playbook for how Anthropic shows up at scale. As a Scaled Enterprise Account Executive, you'll own a book of enterprise accounts and the full revenue outcome for each. You'll generate your own pipeline, run a high-velocity sales cycle from first conversation through close, and develop a clear point of view on where Claude creates value in each account. You'll work closely with Product, Applied AI, and GTM to learn what's working at scale and feed it back into the playbook we're building from the ground up. This is a role for someone who thrives in hypergrowth, gets energy from breaking into new enterprise accounts, and wants to help build the scaled motion at Anthropic - not inherit one. Responsibilities - Own all revenue outcomes for a book of enterprise accounts, driving new logo acquisition and early expansion across multiple use cases - Generate the

Applied AI/ML Scientist UAE Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs. Cerebras' current customers include top model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras , to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference. Thanks to the groundbreaking wafer-scale architecture, Cerebras Inference offers the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. About The Role As an Applied AI Scientist in the FieldML team, you will be responsible for developing and customizing large language models and more broadly large-scale deep learning models to solve specific customer problems. You won't just advise; you will build. You will bridge the gap between state-of-the-art research and real-world applications by helping customers harness the power of the Cerebras Wafer-Scale Engine (WSE) for their AI initiatives. We are looking for experienced AI Scientists who are passionate about the "applied" side of machine learning - those

Infrastructure Software Engineer, Enterprise GenAI San Francisco, CA; New York, NY Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our core infrastructure in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail. What You'll Do: - Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers - Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs) - Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs. - Deliver experiments at a high velocity and level of quality to engage our customers - Work across the entire product lifecycle from conceptualization through production - Be able, and willing, to multi-task and learn new technologies quickly What We're Looking For: - 4+ years of full-time engineering experience, post-graduation - Experience scaling products at hyper growth startups - Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies - Proficient in Python or Javascript/Typescript, and SQL - Experience with Kubernetes - Experience

AI Deployment Strategist, Healthcare & Life Sciences San Francisco, CA; New York, NY At Scale, we believe AI will dramatically improve the world, and our mission is to accelerate the development of AI. As Senior Deployment Strategist, Enterprise AI, you will work closely with Scale's Enterprise AI business unit leadership team to execute on our vision to be the partner of choice for AI solutions across healthcare and life sciences, from leading health systems to pharmaceutical and life sciences organizations. With a deep focus on Generative AI and Large Language Model (LLM) applications for large enterprises, you will be working at the leading edge of AI innovation and driving business impact. In this leadership role, you will own the design and delivery of cutting-edge solutions for the world's largest enterprises. The ideal candidate is a highly motivated individual who is able to combine meticulous planning & organization, analytical rigor, an obsessive focus on customer relationships and outcomes, and an empathetic interpersonal style. You have a demonstrated ability to lead AI projects and initiatives, establish credibility with internal and customer C-Suite stakeholders, and are comfortable rolling up your sleeves to tackle a variety of challenges. If you want to work on the most ambitious Generative AI innovation in the world and have some fun while doing it, we'd love to hear from you! You will: - Partner with Head of Solutions Delivery, VP/GM of Enterprise AI, and other leaders to design and deploy the highest priority AI solutions for the world's

Frontier Agent Engineering Manager Berlin, Germany; London, UK At Scale AI, we are not just building AI tools. We are pioneering the next era of enterprise AI . As businesses rush to harness the potential of Generative AI, Scale is leading the way, transforming workflows, automating complex processes, and driving real-world impact for the world's largest enterprises and government organizations. Our Scale Generative AI Platform (SGP) powers production-grade GenAI applications with foundational services, APIs, and infrastructure that accelerate adoption across industries. As more of these applications go into production, we are expanding our Forward Deployed Engineering (FDE) team to drive hands-on innovation where it matters most: in our customers' environments. We are looking for a technical and strategic Engineering Manager to lead our European FDE team. This is a high-ownership role at a pivotal moment. You will be responsible for delivering high-impact GenAI solutions in production , leading a team that works directly with customers, and ensuring we solve real problems with clarity, speed, and excellence. Why this role is unique: - Right place, right time: We are moving from prototypes to production at scale. Our FDE team is on the front lines of this transition, helping customers adopt AI faster and with more confidence. - Customer-first mindset: You will foster a culture of deep customer empathy and practical problem-solving. From scoping use cases to shipping solutions, your team will be responsible for every step of the delivery lifecycle. - Strategic influence: The lessons from forward-deployed efforts directly inform our

Senior Software Engineer, AI Runtime Mountain View, California; San Francisco, California P-1428 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Training and customizing state-of-the-art AI models is one of the most demanding workloads in computing, and it sits at the heart of Databricks' Mosaic AI mission. AI Runtime (AIR) is our managed platform for large-scale GPU training and fine-tuning. It gives customers on-demand access to fleets of the latest accelerators and a serverless experience that hides the complexity of provisioning, scheduling, and orchestrating multi-node jobs, with the resilience to keep training running for days or weeks across thousands of GPUs. AIR powers the full spectrum of custom training, from fine-tuning open models to pre-training frontier-scale foundation models, for some of the most sophisticated AI teams in the world. As a Senior Software Engineer for AI Runtime, you will play a critical role in building and scaling the systems that make large-scale training fast, reliable, and effortless. You will drive the architecture and evolution of the managed GPU training stack, spanning scheduling and capacity, distributed training performance, fault tolerance, and the developer experience of launching and operating jobs at scale. Beyond hands-on contributions to core systems, you will help shape

Staff Software Engineer, AI Runtime Mountain View, California; San Francisco, California P-1930 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Training and customizing state-of-the-art AI models is one of the most demanding workloads in computing, and it sits at the heart of Databricks' Mosaic AI mission. AI Runtime (AIR) is our managed platform for large-scale GPU training and fine-tuning. It gives customers on-demand access to fleets of the latest accelerators and a serverless experience that hides the complexity of provisioning, scheduling, and orchestrating multi-node jobs, with the resilience to keep training running for days or weeks across thousands of GPUs. AIR powers the full spectrum of custom training, from fine-tuning open models to pre-training frontier-scale foundation models, for some of the most sophisticated AI teams in the world. As a Staff Software Engineer for AI Runtime, you will play a critical role in building and scaling the systems that make large-scale training fast, reliable, and effortless. You will drive the architecture and evolution of the managed GPU training stack, spanning scheduling and capacity, distributed training performance, fault tolerance, and the developer experience of launching and operating jobs at scale. Beyond hands-on contributions to core systems, you will help define

Lead Counsel, Global Public Sector Dubai, UAE; London, UK Come join our growing legal team to work on the most exciting issues at the leading edge of AI! At Scale AI, we are powering the leading AI models and pioneering the next era of advanced AI systems for the world's largest enterprises and forward-thinking governments. You will join a solutions-oriented legal team in a place where a healthy culture meets high standards and the ambition to shape the future of AI. You will help grow Scale's Global Public Sector business across Europe, the Middle East, and Asia. While work variety is guaranteed, in your role you will primarily help build and deploy a range of Generative and Agentic AI systems that deliver real-world impact for governments and public sector entities. We are looking for a relentlessly curious, open-minded, and action-oriented commercial attorney who has fun negotiating complex agreements and can optimise risk - all while being a great teammate. If you enjoy solving novel challenges while continuously learning and building strong relationships, we'd love to hear from you! You will: - Drive Scale AI's international expansion by enabling market entry and operations outside the US, particularly in support of the Global Public Sector team - Draft, review, and negotiate a wide range of commercial agreements with global entities, including Sovereign AI deals, master services agreements, and bespoke software development agreements - Manage complex public tenders as a prime, subcontractor, or consortium partner - Counsel on privacy and emerging regulatory requirements

Machine Learning Engineer - Inference San Francisco About the Role Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models models and ensuring they run efficiently and effectively at scale. If you are passionate about AI inference, PyTorch, and developing high-performance systems, we want to hear from you. This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions. Join us in shaping the future at Together AI! Responsibilities - Design and build the production systems that power the Together AI inference engine, enabling reliability and performance at scale. - Develop and optimize runtime inference services for large-scale AI applications. - Collaborate with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world. - Conduct design and code reviews to ensure high standards of quality. - Create services, tools, and developer documentation to support the inference engine. - Implement robust and fault-tolerant systems for data ingestion and processing. Requirements - 3+ years of experience writing high-performance, well-tested, production-quality code. - Proficiency with Python and PyTorch. - Demonstrated experience in building high performance libraries and tooling. - Excellent understanding of low-level operating systems concepts including multi-threading, memory management, networking, storage, performance, and scale. - Preferred: Knowledge of existing AI inference systems such as TGI, vLLM, TensorRT-LLM, Optimum - Preferred: Knowledge of AI inference

Forward Deployed Engineer, GenAI San Francisco, CA; New York, NY About Scale AI At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI) and building upon our prior model evaluation work with enterprise customers and governments to deepen our capabilities and offerings for public and private evaluations. About Data Engine Our Generative AI Data Engine powers the world's most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we produce is some of the most critical work for how humanity will interact with AI. About Our FDE Team Generating high-quality data is the core problem our business solves. We aim to make producing and delivering high-quality data seamless and efficient for operators and customers. Our Team is building customer and operator-specific infrastructure to provide high-quality data with low turnaround time. You'll be exposed to the cutting edge of the Generative AI industry while directly interfacing with the leading model-building organizations in the space, including the top AI research labs and government agencies. Join us in shaping the future of Artificial General Intelligence. As a Forward Deployed Engineer, you'll be at the forefront of providing