Spark jobs

Engineering Operation Technician, AWS Data Center team Sparks, Nevada, USA Join our dynamic team and become a critical guardian of technological infrastructure! As a Data Center Engineering Technician, you'll play a pivotal role in maintaining the heartbeat of mission-critical technology infrastructure, ensuring seamless operations that power global digital experiences. Your expertise will directly contribute to maintaining an extraordinary 99.999% uptime, keeping the digital world running smoothly and efficiently. Engineering Technicians are Amazon's front line when it comes to hands-on electrical and mechanical equipment troubleshooting. They will maintain, operate, and troubleshoot, Data Center Operation's Mission Critical Facilities, which includes stand-by diesel generators and related fuel systems, as well as three phase electrical systems such as: switch gear, UPSs, PDUs, wet cell batteries and associated systems, CRAC, centrifugal chillers, cooling towers/water chemical system, air handlers and associated systems, pumps, & motors. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to

Data Engineer India - Hyderabad posted: Posted 2 Days Ago

Senior Applied Scientist, Measurement, Ad Tech, and Data Science (MADS) Toronto, Ontario, CAN The Measurement, Ad Tech, and Data Science (MADS) team at Amazon Ads is at the forefront of developing innovative solutions that help tens of millions of advertisers understand the value of their ad spend while prioritizing customer privacy and measurement quality. The Media Planning Science team, part of broader MADS team, develops and implements models that deliver insights and recommendations for strategic media planning and measurement across Amazon Advertising's product portfolio. Our mission is to help advertisers create and execute plans that meet their objectives while providing accurate measurement tools. We work on a multitude of problem statements that encompass Reach and Frequency, Budget Planning Optimization, and Recommendations. Our models leverage both heuristic and machine learning approaches including deep learning techniques, with insights delivered through agent-based tools and APIs that integrate seamlessly into user interfaces and programmatic systems to ensure optimal advertising outcomes. As a Senior Applied Scientist on the team, you will be at the forefront of innovation, developing media planning solutions end-to-end from inception to production. You will set the technical vision and innovate on behalf of our customers. You will propose, design, analyze, and productionize models to provide novel measurement insights to our customers. You will partner with engineering to deploy these solutions into production. You will work with key stakeholders from various business teams to enable advertisers to act upon those metrics. Key job responsibilities * Lead the development of media planning models

Lead Systems Services Engineer GB-SO-NAILSEA-2 HIGH STREET posted: Posted 30+ Days Ago

Senior Applied Scientist, Alexa Ads Bengaluru, Karnataka, IND Alexa+ is the world's best Generative AI powered personal assistant / agent for consumers, and is becoming the conversational AI interface for Amazon services with the launch of Alexa for Shopping on Amazon.com and Amazon mobile app. At Alexa Ads, we are creating industry's first and most advanced Agentic Advertising products to drive Agentic Commerce. We are seeking an Applied Scientist to join our newly expanding team in India focused on Alexa Agentic/Conversational Ads and Personalization. In this role, you will build machine learning models that seamlessly and naturally integrate relevant advertising into the Alexa experience while deeply personalizing user interactions. You will work closely with other scientists, engineers, and product managers to take models from conception to production. Key job responsibilities Design, develop, and evaluate innovative deep learning and GenAI models for natural language processing (NLP), recommendation systems, and personalization. Conduct hands-on data analysis and build scalable ML pipelines. Design and run A/B experiments to measure the impact of new models on customer experience and ad performance. Collaborate with software development engineers to deploy models into high-scale, real-time production environments. About the team We are building a new science team in Bangalore to solve some of the most impactful problems in computational advertising. This isn't about tweaking existing models as we are rethinking how ads are ranked, priced, and personalized across voice-first and screen-first surfaces. These are problems that don't have textbook solutions. Key points to note about the team: 🧪

Software Development Engineer II - Advertising, Amazon, Reporting API Toronto, Ontario, CAN Are you passionate about Big Data and Distributed Systems to build customer trust and grow new business? Interested in building new state-of-the-art products at Petabyte scale? Global advertisers rely on our team's performance insights to drive future investment in Amazon's Advertising Platform and improve the relevance of ads shown to customers. We're looking for strong Software Engineers that can build upon technologies such as Elasticsearch, Spark, Hive and Presto, as well as AWS services like Elastic Map Reduce (EMR), Redshift, Kinesis and DynamoDB to deliver next generation of our Reporting API platform. If this sounds interesting we'd love to hear from you! Amazon is investing heavily in building a world class advertising business and we are at the forefront of that explosive growth. We deliver campaign reporting for all of Amazon advertising and produce analytics and reporting data that are used by advertisers to grow their business every day. We process billions of ad impressions, clicks, and conversion events daily and we invent and evolve our event-driven architectures with AWS to manage the large scale of our data growth. As campaign reporting product owners, we are also breaking fresh ground to create world-class analytics products. We are highly motivated, collaborative and fun-loving with an entrepreneurial spirit and agile bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities. We start with the

Data Architecture – Advisor I Berkeley Heights, New Jersey posted: Posted Today

Sr. Applied Scientist, Private Brands Intelligence - SCIT Science Vancouver, British Columbia, CAN The Private Brands team is looking for a Sr. Applied Scientist to join the team in building science solutions at scale. Our team applies Optimization, Machine Learning, Statistics, Causal Inference, and Econometrics/Economics to derive actionable insights about the complex economy of Amazon's retail business and develop Statistical Models and Algorithms to drive strategic business decisions and improve operations. We are an interdisciplinary team of Scientists, Engineers, and Economists. Key job responsibilities You will work with business leaders, scientists, and economists to translate business and functional requirements into concrete deliverables, including the design, development, testing, and deployment of highly scalable optimization solutions and ML models. This is a unique, high visibility opportunity for someone who wants to have business impact, dive deep into large-scale problems, enable measurable actions on the consumer economy, and work closely with scientists and economists. As a Sr Scientist, you bring business and industry context to science and technology decisions. You set the standard for scientific excellence and make decisions that affect the way we build and integrate algorithms. Your solutions are exemplary in terms of algorithm design, clarity, model structure, efficiency, and extensibility. You tackle intrinsically hard problems, acquiring expertise as needed. You decompose complex problems into straightforward solutions. We are particularly interested in candidates with experience in Operations Research and predictive models and working with distributed systems. Academic and/or practical background in Operations Research, Machine Learning and Reinforcement Learning are particularly relevant

JOIN OUR TALENT COMMUNITY JOIN OUR TALENT COMMUNITY

Senior Applied Scientist, Ad Measurements Science New York, New York, USA The Ads Measurement Science team in the Measurement, Ad Tech, and Data Science (MADS) team of Amazon Ads serves a centralized role developing solutions for a multitude of performance measurement products. We create solutions which measure the comprehensive impact of advertiser's ad spend, including sales impacts both online and offline and across timescales, and provide actionable insights that enable our advertisers to optimize their media portfolios. We also own the science solutions for AI tools that unlock new insights and automate high-effort customer workflows, such as custom query and report generation based on natural language user requests. We leverage a host of scientific technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision. As a Senior Applied Scientist on the team, you will be at the forefront of innovation, developing measurement solutions end-to-end from inception to production. You will set the technical vision and innovate on behalf of our customers. You will propose, design, analyze, and productionize models to provide novel measurement insights to our customers. You will partner with engineering to deploy these solutions into production. You will work with key stakeholders from various business teams to enable advertisers to act upon those metrics. Key job responsibilities * Lead the development of ad measurement models and solutions that address the full spectrum of an advertiser's investment, focusing on scalable and efficient methodologies. * Collaborate closely with cross-functional teams including engineering,

Lead Power Systems & Test Engineer Leicester posted: Posted 11 Days Ago

Applied Scientist, Agentic Automated Reasoning London, England, GBR The Agentic Automated Reasoning Group is building the next generation of software verification tools combining advances in artificial intelligence, the computational capacity of the cloud, and our deep expertise in the domain. Join us if you want to be a part of this transformational endeavor. The Strata team (https://github.com/strata-org) is seeking an applied scientist with broad interest and expertise in model checking, interactive theorem proving, programming language semantics, and generative AI. You will combine your expertise with that of your coworkers to build new tools that solve code analysis problems previously considered beyond reach. Our application areas span all the way from Infrastructure as Code to high-performance cryptography written in assembly code, while our methods span from interactive theorem proving to automated test generation. Each day, hundreds of thousands of developers make billions of transactions worldwide on AWS. They harness the power of the cloud to enable innovative applications, websites, and businesses. Using automated reasoning technology and mathematical proofs, AWS allows customers to answer questions about security, availability, durability, and functional correctness. We call this provable security, absolute assurance in security of the cloud and in the cloud. https://aws.amazon.com/security/provable-security/ Key job responsibilities - Work with customer teams to understand the nature of their software and the properties they need to establish of it. - Identify tools and methods capable of addressing the verification needs of customers, including any novel analysis capabilities required. - Use techniques spanning property-based testing to model checkers, and

Senior ABAP Platform Engineer - SAP Big Data Fabric Services (BDFS) Country Brazil | Internal Posting Location São Leopoldo We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging - but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. PURPOSE AND OBJECTIVES Join an innovative, collaborative development environment and help build secure data access and connectivity capabilities as part of SAP's Big Data Fabric Services (BDFS).We are looking for a Senior Platform Engineer who can contribute across design, implementation, operability, and technical problem-solving in the SAP Data Accelerator and broader BDFS context.We do not work as data scientists analyzing or extracting data directly. We build the platform capabilities that make this possible.## THE PRODUCTSAP Data Accelerator focuses on secure partner connectivity and access to SAP business data across SAP ERP and LoB applications in on-premise, private cloud, and public cloud landscapes.This work sits within the broader BDFS portfolio, which enables SAP Lines of Business and customers to enter the world of big data more easily. BDFS delivers platform capabilities such as Apache Spark as a service, multi-language data

Machine Learning Engineer 2 Locations posted: Posted 4 Days Ago

Sr. Software Development Engineer, Measurement, Ad Tech, and Data Science Santa Monica, California, USA Do you want to architect systems that process petabytes of data and power advertising decisions for millions of advertisers worldwide? Are you energized by solving hard distributed systems problems at a scale few companies ever reach? This is your opportunity. Amazon Advertising operates one of the largest big data platforms on the planet - processing trillions of events daily across display, search, native, and video surfaces on every device. We're looking for a Senior Software Development Engineer to lead the design and delivery of our next-generation measurement and reporting infrastructure - the backbone that enables advertisers to understand, attribute, and optimize their spend across Amazon's full advertising suite. You will define the technical direction for critical data systems, driving architectural decisions that balance scale, latency, cost, and extensibility. You'll leverage technologies like Spark, Flink, and Java alongside AWS services - EMR, Kinesis, DynamoDB, Bedrock, and more - to build pipelines and platforms that serve diverse consumers at Amazon scale. You'll own the end-to-end lifecycle: from whiteboarding system designs in ambiguous problem spaces to shipping production systems that handle billions of requests with high availability. The ideal candidate has a proven track record of delivering highly distributed systems at scale, with deep expertise in platform design patterns - including SDKs, libraries, APIs, and versioning strategies that enable teams across the organization to build on your foundations. You are operationally excellent, technically rigorous, and thrive when partnering across

Sr Machine Learning Engineer- ML Infrastructure & Data Platforms 2 Locations posted: Posted 30+ Days Ago

Senior Applied Scientist, Amazon Shopping Personalization New York, New York, USA Are you a scientist interested in pushing the state of the art in machine learning and recommendation systems? Are you interested in working on novel ideas that can positively impact millions of customers? Do you wish you had access to large datasets and tremendous computational resources? Answer yes to any of these questions and you will be a great fit for our team at Amazon. As an Senior Applied Scientist in our team, you will be responsible for the research, design, and development of new AI technologies for Personalization. You will adopt or invent new machine learning and analytical techniques in the realm of recommendations and large language models. You will collaborate with scientists, engineers, and product partners locally and abroad. Your work will include inventing, experimenting with, and launching new features, products and systems. Key job responsibilities - Using Amazon's large-scale computing resources, you will ask research questions about customer behavior, build state-of-the-art models to optimize the shopping experience, and run these models directly on the retail website. - Develop AI solutions for Recommendation systems using Deep learning, LLMs, Reinforcement Learning, distillation, and Optimization methods; - Work closely with engineers and product managers to design, implement and launch AI solutions end-to-end; - Design and conduct offline and online (A/B) experiments to evaluate proposed solutions based on in-depth data analyses; - Effectively communicate technical and non-technical ideas with teammates and stakeholders; - Stay up-to-date with advancements and the latest

Data Architect India - Hyderabad posted: Posted 30+ Days Ago

Sr. Applied Scientist, Trust CX Innovations&AI Policy Bengaluru, Karnataka, IND Alexa+ is Amazon's next-generation, AI-powered assistant. Building on the original Alexa, it uses generative AI to deliver a more conversational, personalized, and effective experience. The Trust CX Innovations team is looking for an Applied Scientist with strong background in Generative AI space to build solutions that help in upholding customer trust for Alexa+. A Senior Applied Scientist in Trust CX innovations, you will be at the forefront of developing innovative solutions to critical challenges in AI trust and privacy. You'll lead research in trust-preserving machine learning techniques. We are working on revolutionizing the way Amazonians work and collaborate. You will help us achieve new heights of productivity through the power of advanced generative AI technologies. We are looking for a leader with strong technical experiences a passion for building scientific driven solutions in a fast-paced environment. You should have good understanding of Artificial Intelligence (AI), Natural Language Understanding (NLU), Machine Learning (ML), Dialog Management, Automatic Speech Recognition (ASR), and Audio Signal Processing where to apply them in different business cases. You will be joining a select group of people making history producing one of the most highly rated products in Amazon's history, so if you are looking for a challenging and innovative role where you can solve important problems while growing as a leader, this may be the place for you. Key job responsibilities • Lead research initiatives in generative AI, focusing on LLMs, multimodal models, and frontier AI capabilities

Senior Data Automation Engineer 8 Locations posted: Posted 11 Days Ago

Sr. Applied Science , AWS Agentic AI Santa Clara, California, USA Come join the AWS AI science team in building the next generation models for intelligent automation. AWS, the world-leading provider of cloud services, has fostered the creation and growth of countless new businesses, and is a positive force for good. Our customers bring problems that will give Applied Scientists like you endless opportunities to see your research have a positive and immediate impact in the world. You will have the opportunity to partner with technology and business teams to solve real-world problems, have access to virtually endless data and computational resources, and to world-class engineers and developers that can help bring your ideas into the world. As part of the team, we expect that you will develop innovative solutions to hard problems, and publish your findings at peer reviewed conferences and workshops. We are looking for world class researchers with experience in one or more of the following areas - autonomous agents, API orchestration, Planning, large multimodal models (especially vision-language models), reinforcement learning (RL) and sequential decision making. About the team Agentic AI drives innovation at the forefront of artificial intelligence, enabling customers to transform their businesses through cutting-edge AI solutions. We build and deliver the foundational AI services that power the future of cloud computing, helping organizations harness the potential of AI to solve their most complex challenges. Join our dynamic team of AI/ML practitioners, applied scientists, software engineers, and solution architects who work backwards from customer needs

Data Steward India - Hyderabad posted: Posted 30+ Days Ago

Researcher/ML Engineer San Jose posted: Posted 24 Days Ago

Software Dev Engineer III, Ads AI Core Infra Bengaluru, Karnataka, IND Would you like to build highly available, scalable and distributed engineering systems for one of the largest data lakes in Amazon? Does Petabyte scale excite you? Spektr Datalake team is the central data lake for Advertising unifying Petabytes of data generated across the Ads pipeline such as campaigns, ad-serving, billing, clicks, impressions and more and into a single scalable repository. This is used across the organization to drive hundreds of thousands of complex queries for analysis, measurement and reporting decisions for our customers. The data lake enables customers such as data engineers, business analysts, ML engineers, research scientists, economists and data experts to collect what they need via world-class self-service tools. Spektr Data Lake team in Ads AI Core Infra org has a mission to provide unified experience for easy discovery and access to privacy compliant data that helps advertising business teams quickly generate insights and meet the data needs of Ads AI models with a vision to 'build the world's best & most cost efficient analytics platform'. A Sr SDE on this team has a unique opportunity to create tech strategies, design and innovate solutions for this scale, delivering robust and scalable services built over Java leveraging AWS services as well as innovate with big data technologies like Spark, EMR, Athena and more. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth. Key job responsibilities