Spark jobs

Senior Machine Learning Engineer 3 Locations posted: Posted 30+ Days Ago

Research Engineer, Electric Power System Niskayuna posted: Posted 30+ Days Ago

Sr. Applied Scientist, SSG Science Bengaluru, Karnataka, IND Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like the Kindle family of products, Fire Tablets, Fire TV, Health Wellness, Amazon Echo & Astro products. This is an exciting opportunity to join Amazon in developing state-of-the-art techniques that bring Gen AI on edge for our consumer products. We are looking for exceptional scientists to join our Applied Science team and help develop the next generation of edge models, and optimize them while doing co-designed with custom ML HW based on a revolutionary architecture. Work hard. Have Fun. Make History. Key job responsibilities What will you do? - Quantize, prune, distill, finetune Gen AI models to optimize for edge platforms - Fundamentally understand Amazon's underlying Neural Edge Engine to invent optimization techniques - Analyze deep learning workloads and provide guidance to map them to Amazon's Neural Edge Engine - Use first principles of Information Theory, Scientific Computing, Deep Learning Theory, Non Equilibrium Thermodynamics - Train custom Gen AI models that beat SOTA and paves path for developing production models - Collaborate closely with compiler engineers, fellow Applied Scientists, Hardware Architects and product teams to build the best ML-centric solutions for our devices - Publish in open source and present on Amazon's behalf at key ML conferences - NeurIPS, ICLR, MLSys. Basic Qualifications: - 3+ years of building machine learning models for business application experience - PhD, or Master's degree and 6+ years of applied research experience

ASIC Engineer II, Cloud-Scale Machine Learning Acceleration team Cupertino, California, USA Utility Computing (UC) AWS Utility Computing (UC) provides product innovations - from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services. Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago-even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world. About AWS Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't

Data Scientist II, AWS Managed Operations Intelligence (MOI) - Data Science Arlington, Virginia, USA Amazon Web Services (AWS) is the world leader in providing a highly reliable, scalable, low-cost infrastructure platform in the cloud that powers hundreds of thousands of businesses in 190 countries around the world! Passionate about building, owning and operating massively scalable systems? Want to make a billion-dollar impact? If so, we have an exciting opportunity for you. The AWS Managed Operations (MO) organization was founded in April 2023, with the objective to reduce operational load and toil through long-term engineering projects. MO is building the best-in-class engineering and operations team that will own the day-to-day operations for AWS Regions; improving the availability, reliability, latency, performance and efficiency to operate AWS regions. The AWS Managed Operations Intelligence (MOI) Team is looking for a Data Scientist to lead the research and thought leadership to drive our data and insight strategy for AWS. You will be expected to serve as a Full Stack Data Scientist. You will be responsible for driving data-driven transformation across the organization. In this role, you will be responsible for the end-to-end data science lifecycle, from data exploration, ETL, model development and data visualization. You will leverage a diverse set of tools and technologies, including general analytical frameworks (Spark, Airflow, etc.), AI frameworks (Hugging Face, etc.) and various machine learning frameworks, to tackle complex business problems. Your analytics research will provide direction on the technology strategy of the Managed Operations organization. Your Decision Science artifacts

Data Scientist II - AMZ27351.1 San Francisco, California, USA Employer: Amazon Web Services, Inc. Position: Data Scientist II - AMZ27351.1 Location: San Francisco, CA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. (40 hours / week, 8:00am-5:00pm, Salary Range $175425 - $212800) Amazon.com is an Equal Opportunity - Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation Basic Qualifications: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience

Senior Data Engineer Lead 2 Locations posted: Posted 30+ Days Ago

Senior Applied Scientist, Entertainment Devices & Grocery Experiences (EDGE) Ads New York, New York, USA We are seeking an Senior Applied Scientist for our Entertainment Devices & Grocery Experiences (EDGE) Ads team. This team addresses challenging content and ads optimization problem related to how advertisements are priced, selected, allocated and shown to customers on Amazon devices including Prime Video, Fire TV, Alexa, Fire Tablet and Amazon Stores. As Senior Applied Scientist, you will be responsible for improving advertising performance and delivering innovative advertising experiences for display and video ads on Amazon Devices. We are innovating for the next generation of conversational ads and agentic ai driven ads experience. This team leads initiatives to improve advertising fundamentals such as relevance, coverage, CTR, and CPSU (cost per sign up for streaming services) which in turn increase advertising revenue across Amazon's devices worldwide. You will own the scoping, implementation, and launch of science based ad solutions and experiences specifically for these entertainment focused environments. Key job responsibilities - Gain a comprehensive understanding of the customer lifecycle journey with Amazon Ads, and develop sophisticated models to optimize various conversion KPIs for enhanced marketing effectiveness. - Develop scalable data processing pipelines and architectures to ingest, transform, and enrich Customer data from various sources (Retail, Prime Video, FireTV, Alexa+ and AppStore). - Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production; work closely with product managers and engineers to launch your models to customers. - Drive innovation within your team and

Senior Data Scientist 2 Locations posted: Posted 30+ Days Ago

Sr. Applied Scientist, Selling Partner Communities (SPC) Seattle, Washington, USA The Selling Partner Communities (SPC) organization is dedicated to ensuring every Selling Partner (SP) achieves satisfaction with their Amazon selling experience. SPC serves as a vital bridge between sellers/vendors and Amazon, creating and managing platforms where they can connect, share knowledge, and receive help. The team's mission encompasses listening to SP feedback, advocating for experience improvements, and empowering SPs through effective, relevant, and timely communications that demonstrate Amazon's commitment to building lasting partnerships. We are seeking a Sr. Applied Scientist to join our Communities team. The successful candidate is a skilled scientist capable of putting theory into practice through experimentation and invention, leveraging science techniques and implementing systems to work on massive datasets in an effort to tackle never-before-solved problems. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. Key job responsibilities The Senior Applied Scientist in the Selling Partner Communities (SPC) organization plays a crucial role in developing and implementing advanced AI and machine learning solutions to enhance the selling partner experience on Amazon. This role requires strong ownership of all technical aspects throughout the full project lifecycle, while partnering closely with the business to define requirements and exercise good judgment in balancing speed and complexity. As a senior AS on our team you will: - Handle challenging problems that directly impact millions of selling partners - Independently collect and analyze data - Design,

Data Scientist India - Hyderabad posted: Posted 30+ Days Ago

Senior Applied Scientist, Amazon Leo Data Science Platform Redmond, Washington, USA Amazon Leo is Amazon's low Earth orbit satellite network. Our mission is to deliver fast, reliable internet connectivity to customers beyond the reach of existing networks. From individual households to schools, hospitals, businesses, and government agencies, Amazon Leo will serve people and organizations operating in locations without reliable connectivity. The Role As a Senior Applied Scientist in Project Leo, you'll be leading us in making critical and time sensitive decisions that impact customers. You'll use your machine learning expertise to build solutions that can scale and solve the business problem, and your engineering experience to build systems that take those solutions to production; it's an exciting opportunity to apply data science to help improve fraud detection accuracy, inference, and customer experience monitoring activity. It's fast paced, data driven, and impactful. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities The position requires hands-on expertise in Analytics to identify and isolate issues, Statistical Modeling and traditional Machine Learning, the ability to write queries to aid in data extraction, and the ability to productionalize models. This role is a self sufficient scientist that can source data, build and evaluate models, and ultimately take those models and rules to deployment. You should have excellent communication skills and be able

Director, ML Engineering San Jose posted: Posted 3 Days Ago

Data Scientist II - AMZ26888.1 Mountain View, California, USA Employer: Amazon Web Services, Inc. Position: Data Scientist II Location: Mountain View, CA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. (40 hours / week, 8:00am-5:00pm, Salary Range $157300 - $212800) Amazon.com is an Equal Opportunity - Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation Basic Qualifications: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience in the

Senior Developer - Cloud Storage (Ceph / Software-Defined Storage) Region Europe | Country Slovakia | Internal Posting Location Bratislava We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging - but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. This is growth, not replacement. We're not just offering a job, we're inviting you to shape the future of cloud-native infrastructure at SAP and in all of Europe. Make your mark, invite others, and discover #SAPEUAICloudCareers. Let's build what's next, together. IronCore Project is SAP's next generation Open Source Cloud Infrastructure based on Kubernetes. Within the IronCore team we manage physical servers, storage and network infrastructure with Kubernetes controllers - providing a modern Cloud infrastructure as a Service to SAP developers and customers. IronCore uses a modern Software Defined Everything approach as well as hardware offloading capabilities to provide a flexible, yet performant base layer for application deployments. IronCore team days are filled with design thinking, passionate discussions and coding around network, Linux, storage, Kubernetes and virtualization. Joining our team means being part of a dynamic, supportive environment where

Data Scientist II - AMZ9658237 New York, New York, USA MULTIPLE POSITIONS AVAILABLE Employer: AMAZON ADVERTISING LLC Offered Position: Data Scientist II Job Location: New York, New York Job Number: AMZ9658237 Position Responsibilities: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. 40 hours / week, 8:00am-5:00pm, Salary Range $169,541/year to $207,500/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For

System Engineer, Messaging and Streaming Team Thames Valley, Berkshire, GBR Would you like to help implement innovative cloud computing solutions and solve the most complex technical problems? Are you excited by the prospect of building and running the world's largest cloud computing infrastructure to provide a better world for future generations? Amazon Web Services (AWS) builds and operates some of the largest internet infrastructure on the planet; providing companies of all sizes with an infrastructure web services platform in the cloud. With AWS, customers provision compute power, storage, database, and other cloud resources as their business demands them. To meet the growing demand for AWS Services around the globe, we need exceptionally motivated people who are driven by learning and innovation. AWS Utility Computing (UC) provides product innovations - from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services. If you join us you'll be part of a world-class team in a dynamic environment that has the entrepreneurial feel of a start-up. As a member of the team providing EC2 services you will be delivering foundational capability that benefits all customers! This is an opportunity

Senior Applied Scientist, Japan Prime & Marketing Tokyo, JPN The Japan Prime & Marketing team drives customer growth and engagement for Amazon Japan. Our applied science team combine advanced machine learning with deep business understanding to deliver experiences that delight customers and grow the Prime membership base in one of Amazon's most dynamic and competitive marketplaces. We are seeking a Senior Applied Scientist to lead the science for personalization and customer growth initiatives across Japan Points, promotional campaigns, and Prime membership engagement. You will own end-to-end science solutions - from problem formulation and data analysis through model development, A/B testing, and production deployment - that directly impact millions of Japanese customers. This is a high-visibility role where you will define the science roadmap, influence business strategy with data-driven insights, and collaborate with product, engineering, economics, and marketing teams across Japan and globally. Key job responsibilities - Define and execute the science roadmap for personalization, points optimization, promotions targeting, and customer growth within Japan Prime & Marketing - Design and develop machine learning models for customer segmentation, lifetime value prediction, churn propensity, and next-best-action recommendation to drive Prime acquisition and retention - Build optimization frameworks for Japan Points allocation, promotional offer targeting, and budget efficiency that maximize long-term customer value rather than short-term engagement - Apply causal inference, experimentation design, and econometric methods to measure the incremental impact of points, promotions, and marketing interventions - Develop personalization systems that tailor offers, messaging, and incentive structures to individual customer preferences and lifecycle

Electrical Engineer 3 Locations posted: Posted 30+ Days Ago

Engineering Operations Technician, AWS Data Center team Sparks, Nevada, USA Join our dynamic team and become a critical guardian of technological infrastructure! As a Data Center Engineering Technician, you'll play a pivotal role in maintaining the heartbeat of mission-critical technology infrastructure, ensuring seamless operations that power global digital experiences. Your expertise will directly contribute to maintaining an extraordinary 99.999% uptime, keeping the digital world running smoothly and efficiently. Engineering Technicians are Amazon's front line when it comes to hands-on electrical and mechanical equipment troubleshooting. They will maintain, operate, and troubleshoot, Data Center Operation's Mission Critical Facilities, which includes stand-by diesel generators and related fuel systems, as well as three phase electrical systems such as: switch gear, UPSs, PDUs, wet cell batteries and associated systems, CRAC, centrifugal chillers, cooling towers/water chemical system, air handlers and associated systems, pumps, & motors. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to

Global Ultrasound Hardware Engineering Leader 2 Locations posted: Posted 30+ Days Ago

Senior Data Scientist Singapore posted: Posted Today

Senior Business Intelligence Engineer, EU Stores CX Analytics & Automation Madrid, Community of Madrid, ESP This position can be based in either Madrid or Berlin. Are you passionate about using data to create shopping experiences that feel genuinely personal? We're looking for a Senior Business Intelligence Engineer to lead the way we build and scale personalised recommendations for millions of customers across ten European marketplaces. In this role, you'll sit at an exciting intersection of business intelligence, data engineering, and data science. You'll build on top of Amazon's world-class personalisation infrastructure - consuming real-time customer intent signals, blending them with large-scale EU retail data and engagement metrics, and applying custom processors and matching models to surface the right product at the right moment. Think complement strategies that inspire follow-on purchases, discovery strategies that introduce customers to new categories, and inspiration experiences that tap into individual browsing and purchase patterns - all layered on top of centralised recommendation systems and enriched with EU-specific intelligence that you build and own. This is more than a traditional data role. On the data science side, you'll develop custom models using Python and Spark to understand customer-product affinity at scale, applying techniques like embeddings modelling and customer persona matching to power EU-specific personalisation strategies built on top of Amazon's global recommendation infrastructure. On the engineering side, you'll build and deploy the internal tooling that puts these capabilities directly in the hands of marketing teams - writing production-grade Python services, building serverless infrastructure with AWS Lambda

Data Scientist II - AMZ9890779 Palo Alto, California, USA MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Data Scientist II Job Location: Palo Alto, California Job Number: AMZ9890779 Position Responsibilities: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. 40 hours / week, 8:00am-5:00pm, Salary Range: $174,826/year to $212,800/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information,