Kernel jobs

Machine Learning Performance Engineer, Annapurna Labs Tel Aviv-Yafo, Tel Aviv, ISR Our team is responsible for the AWS Neuron software stack, which powers Generative AI and other advanced ML workloads on AWS's custom-built ML accelerators - Inferentia and Trainium. These accelerators deliver best-in-class performance and cost-efficiency for ML inference and training in the cloud. We're building a new core group of engineers in TLV (Tel Aviv) to drive innovation in ML systems performance and software. As a Machine Learning Performance Engineer, you'll help shape the direction of the team from the ground up and work on: Optimizing system performance across the entire ML software stack Analyzing high-performance ML workloads running on Annapurna hardware Developing high-performance kernels for critical ML operations Enhancing the Neuron SDK to improve developer experience and system capabilities Collaborating across Compiler, Frameworks, and Hardware teams to maximize end-to-end performance As part of the Performance Engineering Team, you'll contribute to projects involving instruction scheduling, memory management, parallelism, kernel optimization, and compiler enhancements to maximize end-to-end performance. This is a unique opportunity to be at the intersection of ML and systems within AWS, helping to build the future of AI infrastructure - right here in Tel Aviv. Key job responsibilities Our engineers collaborate across diverse teams, projects, and environments to have a firsthand impact on our global customer base. You will: Solve challenging technical problems, often ones not solved before, at every layer of the stack. Design, implement, test, deploy and maintain innovative software solutions to transform service performance,

NPI Engineer, Embedded Firmware and Software, Emerging Accelerator Software Sunnyvale, CA, USA Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Accel Platforms and Lab Team's mission is to empower Google's accelerator roadmap by engineering foundational hardware (PCIe, fabric, IOMMU) and low-level software (kernel, firmware). We provide reliable, secure, and efficient accelerator-to-host connectivity to enable cutting-edge use cases. The team is also responsible for onboarding new types of domain-specific accelerators into Google data centers. As a Staff Software Engineer on the Emerging Accelerator System team, you will have influence well beyond yourself, solving complex challenges in low-level software and hardware interaction. Your role is critical to Google's accelerator roadmap. The AI and Infrastructure team is redefining what's possible. We empower Google

Senior Machine Learning Engineer San Jose posted: Posted 25 Days Ago

Software Development Engineer - AI/ML, Amazon Neuron, Multimodal Inference Seattle, Washington, USA The Annapurna Labs team at Amazonbuilds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The Inference Enablement and Acceleration team is at the forefront of running a wide range of models and supporting novel architecture alongside maximizing their performance for AWS's custom ML accelerators. Working across the stack from PyTorch till the hardware-software boundary, our engineers build systematic infrastructure, innovate new methods and create high-performance kernels for ML functions, ensuring every compute unit is fine tuned for optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration. As part of the broader Neuron organization, our team works across multiple technology layers - from frameworks and kernels and collaborate with compiler to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection

2026 University Graduate - Machine Learning Engineer Seattle posted: Posted 30+ Days Ago

Principal Machine Learning Engineer 3 Locations posted: Posted 7 Days Ago

Senior ML Software Engineer, Data Plane Tel Aviv-Yafo, Tel Aviv, ISR The MLIL DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration. Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models. This is a ground-up effort with rapidly evolving hardware and software. We need a senior IC who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack. Key job responsibilities - Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference. - Implement and validate LLM architectures (decoder-only, mixture-of-experts) end-to-end - from PyTorch model definition through distributed execution on custom hardware. - Integrate custom accelerator backends into open-source ML serving frameworks (vLLM, PyTorch), including scheduler extensions, memory management, and model parallelism. - Build and maintain test infrastructure for model correctness validation across CPU, GPU, simulator, and hardware targets. - Profile and optimize inference workloads - identify bottlenecks, instrument critical paths, and drive latency and throughput improvements from simulation through hardware bringup. - Own features end-to-end: from design through implementation, testing, and

Senior Software Development Engineer, AI Data Platform United States, US Oracle's Forward Deployed Engineer (FDE) team is hiring a Senior Software Development Engineer - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle's Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Strong data engineering, HPC, and data science experience. Spark, PySpark, Delta Lake, Parquet, Feature Extraction, MLOps, Flink, with a deep understanding of the distributed systems techniques that make these services work. Full stack development experience. This includes web app development, RESTful APIs, SSE, all the way to deploying your solution. Design, implement, and maintain scalable software components and services that support AI/ML workloads. Build APIs, SDKs, and automation frameworks to streamline the adoption of Oracle AI Data Platform and Gen AI services. Optimize performance, scalability, and reliability of distributed data/AI systems. Collaborate with cross-functional teams (engineering, product, and field) to solve complex technical challenges. Participate in code reviews, testing, and CI/CD to ensure high-quality deliverables. Document technical designs and contribute to knowledge-sharing (e.g., blogs, internal docs, demos). Continuously explore new tools, frameworks, and best practices in AI, cloud, and data engineering. Primary Skills: Experience with LLMs and agentic frameworks (e.g., MCP, LangChain, CrewAI, Semantic Kernel).

Computer Scientist 2 (C++) Noida posted: Posted 4 Days Ago

Software Dev Engineer, EC2 Nitro Seattle, Washington, USA Do you want to shape the future of virtualized (SDN) networking in one of the world's biggest public clouds? The Amazon Elastic Compute Cloud (EC2) Nitro Dataplane team owns the packet pipeline that runs right beneath all our customer's EC2 VPC instances, adding features like firewalls (security groups), routing, billing and monitoring as we touch every single packet on every single host across our worldwide fleet in more than 30 regions. Our vision is to combine the performance of bare metal networking while maintaining all the benefits of the cloud, including delivering features not possible on bare metal leading to true Software Defined Networking (SDN). We continue to grow, and are looking for kernel/embedded C programmers who can deliver ultra-high performance for our EC2 customers - our goal is to be processing many millions of packets per second on embedded CPU cores. This requires both being able to implement highly optimized data structures, but also low level tuning to our hardware. If you have good experience in C/C++ or Rust, and a passion for systems software engineering such as kernel or embedded software development, then this is a unique opportunity to join us in building the platform which is the basis for all new EC2 VPC features in the years to come. You can have an immediate impact for all of our customers including internal customers such as AWS Lambda, and external customers that run on Amazon EC2 as we deploy new

Lead Engineer – Embedded Software Development (M/F/D) PL-PDK-WARSAW-ALEJA KRAKOWSKA 110/114 BLD 3014613 posted: Posted Today

Senior Software Engineer, EC2 Nitro Seattle, Washington, USA Do you want to shape the future of virtualized (SDN) networking in one of the world's biggest public clouds? The Amazon Elastic Compute Cloud (EC2) Nitro Dataplane team owns the packet pipeline that runs right beneath all our customer's EC2 VPC instances, adding features like firewalls (security groups), routing, billing and monitoring as we touch every single packet on every single host across our worldwide fleet in more than 30 regions. Our vision is to combine the performance of bare metal networking while maintaining all the benefits of the cloud, including delivering features not possible on bare metal leading to true Software Defined Networking (SDN). We continue to grow, and are looking for kernel/embedded C programmers who can deliver ultra-high performance for our EC2 customers - our goal is to be processing many millions of packets per second on embedded CPU cores. This requires both being able to implement highly optimized data structures, but also low level tuning to our hardware. If you have good experience in C/C++ or Rust, and a passion for systems software engineering such as kernel or embedded software development, then this is a unique opportunity to join us in building the platform which is the basis for all new EC2 VPC features in the years to come. You can have an immediate impact for all of our customers including internal customers such as AWS Lambda, and external customers that run on Amazon EC2 as we deploy new

Senior Machine Learning Engineer 3 Locations posted: Posted 30+ Days Ago

Software Development Engineer, Data Plane, Network Product Development Cupertino, California, USA AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. Amazon Web Services is looking for Software Development Engineers to develop state of the art Linux based networking platforms. You will join a team of engineers developing embedded routing platforms that enable one of the world's largest and complex networks. We are seeking engineers with a demonstrated track record of designing and implementing Linux-based solutions on embedded devices, ideally for networking products. We want people who are passionate about changing the way data center networking is done. Plenty of complexity and scope for your next challenge! Why

Machine Learning Hardware Architect, Google Cloud Silicon Tel Aviv, Israel; +1 more In this role, you'll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You'll be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems. In this role, you will own and lead the architecture of the Google Edge AI accelerators. You will work with the Google AI community and with external partners. You will combine the latest innovations in Machine Learning and integrated circuits to create advanced hardware acceleration solutions for Machine Learning training and inference. The AI and Infrastructure team is redefining what's possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on

Principal Software Engineer, AWS Lambda Experience Dublin, IRL Are you passionate about building the foundational systems that power serverless computing for millions of customers worldwide? AWS Lambda is looking for a Principal Engineer to join our Lambda Experience team in Dublin, Ireland, where you will define the technical vision and drive the architecture for the Lambda execution environment, the system that execute customer code across the globe. AWS Lambda is one of the fastest-growing services in AWS and sits at the heart of serverless computing. The Lambda execution environment is responsible for securely launching and managing the compute environment where customer code runs. This includes the orchestration of microVM-based isolation using Firecracker, the management of execution environments, and the runtime interfaces that bridge customer code with the Lambda platform. The systems you will work on process millions of invocations per second, operate across multiple AWS Regions, and must deliver consistently low latency while maintaining the highest standards of security and isolation. As a Principal Engineer on this team, you will own the long-term technical strategy for the Lambda execution environment, working at the intersection of systems programming, virtualization, and cloud infrastructure. You will design and build the next generation of execution environment management, tackle challenges in cold start optimization, resource scheduling, and multi-tenant isolation, and drive the evolution of our Rust and Linux kernel-level components so that, among other things, they are ready to carry our customers' next generation workloads, including agentic ones. You will operate as both a hands-on

Machine Learning Engineer - Evergreen Bucharest posted: Posted 30+ Days Ago

Sr. Software Development Engineer, Annapurna Labs Seattle, Washington, USA In this role you will be responsible for leading a technical team which is critical in providing profiling and optimization tools for the Neuron ML accelerators fleet. You will work closely with the hardware and software teams to ensure the right tools are available for performance profiling of large ML workloads, identifying bottlenecks and automatically providing improvement recommendations. Neuron Core Tools develops and maintains a family of profiling software and provides ability for performance engineers to develop and improve custom kernels that would impact efficiency of large workloads. Key job responsibilities * Provide technical leadership to the Neuron Core Tools team * Work closely with the frameworks and compiler teams. * Collect requirements from various other teams including training, inference and runtime. * Collaborate with the compiler performance team to ensure timely release of the core performance tools. * Anticipate future needs based on the product roadmap and develop necessary tools to increase efficiency in large scale compute. About the team Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we're building an environment that celebrates knowledge-sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects that help our team members develop your engineering expertise so you feel empowered to take on more complex tasks in the future. Diverse Experiences AWS values diverse experiences. Even

Senior Associate, Cloud FinOps Engineer Greece-Thessaloniki Chortiatis posted: Posted 2 Days Ago

Software Development Engineer, Neuron Foundation Tools Seattle, Washington, USA AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. As the Software Development Engineer for the Neuron Foundation Tools Team, you will be responsible for working alongside a team of engineers to develop and maintain high-performance monitoring and profiling tools for machine learning applications and AI accelerators. You will work on design, development, and deployment of the Neuron Profiler and other Neuron Tools. The profiler plays a crucial role to internal and external customers in optimizing AI workloads across hardware platforms such as Trainium and Inferentia devices, by providing deep insights into performance bottlenecks and system behavior. Improving performance of ML Kernels and ML Frameworks. In this role, you will manage the full development life cycle of the Neuron Profiler/Tools toolchain, ensuring scalability, reliability, and usability. You will collaborate with cross-functional teams to ensure that the our C++ compiler and runtime generates key information so customers can understand and optimize the performance of our custom hardware. Additionally, you will drive innovations that allow the profiler to support multiple frameworks, such as PyTorch, JAX, and XLA. A successful candidate will have an established background in building AI/ML and performance analysis tools. Experience with ML-specific profiler tools (like PyTorch Profiler or TensorFlow Profiler) is highly desirable, along with direct customer-facing experience and a strong motivation to achieve results. A day in the life day in the

Computer Scientist 2 (C++) Noida posted: Posted 30+ Days Ago

Senior Software Development Engineer, EC2 VPC San Diego, California, USA The primary location for this position is San Diego, CA. Do you want to shape the future of virtualized (SDN) networking in the world's biggest public cloud? The Amazon Elastic Compute Cloud (EC2) VPC Packet Pipeline team owns the packet pipeline that runs right beneath all our customer's EC2 VPC instances, adding features like firewalling (security groups), billing and monitoring as we touch every single packet on every single host across our massive worldwide fleet. Our vision is to combine the performance of bare metal networking while maintaining all the benefits of the cloud, including delivering features not possible on bare metal i.e. true Software Defined Networking (SDN). We are growing fast, and are looking for kernel/embedded C leaders who can deliver ultra high performance - our goal is to be processing millions of packets per second on a CPU core. This requires both being able to implement highly optimized data structures, but also low level (including by hand assembly and vectorizing) tuning to our hardware. If you have good experience in C/C++, and a passion for systems software engineering such as kernel or embedded development, then this is a unique opportunity to join us at day one of building the platform which is the basis for all new EC2 VPC features in the years to come. Your responsibilities will include: - Being the lead engineer on a small team, mentoring junior engineers, ensuring the right development practices are followed.

Linux PKI Enterprise Systems Engineer Huntsville, AL posted: Posted 30+ Days Ago

Software Engineer, EC2 Nitro Seattle, Washington, USA Do you want to shape the future of virtualized (SDN) networking in one of the world's biggest public clouds? The Amazon Elastic Compute Cloud (EC2) Nitro Dataplane team owns the packet pipeline that runs right beneath all our customer's EC2 VPC instances, adding features like firewalls (security groups), routing, billing and monitoring as we touch every single packet on every single host across our worldwide fleet in more than 30 regions. Our vision is to combine the performance of bare metal networking while maintaining all the benefits of the cloud, including delivering features not possible on bare metal leading to true Software Defined Networking (SDN). We continue to grow, and are looking for kernel/embedded C programmers who can deliver ultra-high performance for our EC2 customers - our goal is to be processing many millions of packets per second on embedded CPU cores. This requires both being able to implement highly optimized data structures, but also low level tuning to our hardware. If you have good experience in C/C++ or Rust, and a passion for systems software engineering such as kernel or embedded software development, then this is a unique opportunity to join us in building the platform which is the basis for all new EC2 VPC features in the years to come. You can have an immediate impact for all of our customers including internal customers such as AWS Lambda, and external customers that run on Amazon EC2 as we deploy new features