Spark jobs

Digital Asset Librarian India - Hyderabad posted: Posted 30+ Days Ago

Sr Applied Scientist III, Supply Chain Optimization Technologies - SCAIL New York, New York, USA Our team is at the forefront of machine learning research. Led by scientists including Dean Foster, the team is dedicated to developing innovative RL algorithms and applying them to complex, real-world challenges in Amazon's global inventory and supply chain network. Our focus is not just on advancing theoretical knowledge but also on implementing these insights to optimize operations and enhance customer satisfaction. We foster a collaborative environment where exploration of new ideas and tackling complex problems is encouraged. The supply chain spans a wide range of operations,managing decisions that impact billions of dollars worth of inventory. For scientists passionate about impactful research in machine learning and AI, our team offers a dynamic and fulfilling environment to make a tangible difference in the field and Amazon's operations. Key job responsibilities - Design, implement, and evaluate innovative models, agents, and software prototypes. - Collaborate with a team of experienced scientists to drive technological advancements. - Develop innovative solutions to complex business problems in collaboration with partner teams. - Contribute to Amazon's global science community through collaboration and publication of ground-breaking research. - Engage in research projects that contribute to the wider scientific community, sharing findings through publications in top-tier journals and conferences. A day in the life A day in the life As a part of our team, you will be working alongside thought leaders like Dean Foster, contributing to academic research and complex, real-world applications. Your

Sr. Data Engineer 9 Locations posted: Posted 30+ Days Ago

AI Engineer, Advanced Solutions Lab, Google Cloud Chicago, IL, USA; +2 more The AI Engineer role within the Advanced Solutions Lab (ASL) focuses on delivering and evolving a sophisticated Machine Learning and Generative AI curriculum for global participants. Operating in an immersive environment, you will work directly with customers to apply innovative AI solutions to high-impact business challenges and specific industry use cases. You will lead the daily educational journey for participants while continuously improving the program by integrating internal Google expertise and recommending the best open-source frameworks and models. Beyond these core duties, you will actively participate in the broader Google ML community through research collaboration, engineering projects, and strategic initiatives that shape the future of AI.Google Cloud accelerates every organization's ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $152000 - $222000 (USD) + 15% bonus target + bonus + equity + benefits Learn more about benefits at Google . Drive the Advanced Solutions Lab by delivering content, identifying machine learning (ML) experts across Google to support specific sessions, and providing ongoing curriculum enhancements. Lead and support customers' machine learning projects from framing to implementation in the Advanced Solutions Lab. Design

Associate Data Engineer India - Hyderabad posted: Posted 2 Days Ago

Software Development Engineer, Measurement, Ad Tech, and Data Science (MADS) Santa Monica, California, USA Are you passionate about Big Data and distributed systems? Do you thrive on building state-of-the-art products at petabyte scale? Join a team of world-class engineers and industry-leading experts operating one of the largest big data platforms for advertising at Amazon scale. We are seeking an experienced Software Development Engineer to build the next generation of advertising measurement and reporting systems. You will leverage open-source technologies such as Spark and Java, alongside AWS services including EMR, Kinesis, DynamoDB, and Bedrock to deliver solutions that serve a wide set of users across Amazon's full advertising suite - spanning display, search, native, and video on all devices. The ideal candidate brings a proven track record of delivering highly distributed systems at scale, with deep expertise in design patterns including SDKs, libraries, and versioning strategies. You are operationally excellent, experienced in collaborating across multiple teams, and ready to build the infrastructure that powers advertising insights at Amazon scale. Key job responsibilities - Demonstrate strong engineering fundamentals and apply real-world experience to solve complex technical challenges - Showcase diverse architectural approaches and design patterns in technical designs - Think big and stay informed about industry standards and emerging trends in the Ad Tech space - Communicate effectively across all leadership levels, both verbally and in writing - Lead deep technical discussions with senior engineers, collaborating to solve challenging problems - Quickly grasp new systems and provide valuable technical consultation to stakeholders

Associate - Talent Lifecycle Delivery Services India - Hyderabad posted: Posted 30+ Days Ago

Software Development Engineer, Measurement, Ad Tech, and Data Science (MADS), Measurement, Ad Tech, and Data Science (MADS) Toronto, Ontario, CAN Are you a data-driven problem solver passionate about building scalable systems that drive customer trust and business growth? Join our innovative MADS Ads Data systems in Toronto, where we're expanding to meet increasing customer demand. We provide a secure, privacy-safe, and cloud-based environment for advertisers to perform advanced analytics across multiple data sets and generate actionable insights. Our services ingest and process billions of behavioral signals daily, making speed, scale, and accuracy critical to our success. You'll work in exciting computer science domains, managing massive-scale streaming systems, applying machine learning and data science expertise using Big Data (e.g. Spark) technology to drive optimizations and insights. We're seeking experienced, motivated software engineers with a proven track record in data engineering and scalable web services. If you're passionate about developing analytical solutions to solve complex business problems and driving results that impact Amazon's business, this is the right opportunity for you. The ideal candidate is innovative, with excellent problem-solving, analytical, and technical skills. You're comfortable working on Linux systems and have a deep understanding of agile software development. You excel at building exceptional customer relationships, uncovering the true requirements behind feature requests, and simplifying complex problems to tackle challenges. Join our team and be part of a dynamic and collaborative environment where you can make a significant impact on Amazon's advertising solutions. Basic Qualifications: - 3+ years of non-internship professional software development

Specialist Data Analytics India - Hyderabad posted: Posted Yesterday

Senior Applied Scientist, Amazon AWS Agentic AI, AWS AI Fundamental Research Santa Clara, California, USA Amazon is looking for a passionate, talented, and inventive Applied Scientist with a strong machine learning background to help build industry-leading technology in generative AI and foundational models. As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in generative AI. Your work will directly impact millions of our customers in the form of products and services that make use of speech, vision and language technology. You will gain hands on experience with Amazon's heterogeneous speech, text, image and structured data sources, and large-scale computing resources to accelerate advances in machine learning and foundation models. More specifically, you will have the opportunity to impact millions of our customers by researching and building innovative solutions using Agentic AI. Agentic AI drives innovation at the forefront of artificial intelligence, enabling customers to transform their businesses through generative AI solutions. We build and deliver the foundational AI services that power the future of cloud computing, helping organizations harness the potential of AI to solve their most complex challenges. Join our dynamic team of AI/ML practitioners and applied scientists who work backwards from customer needs to create novel technologies. If you're passionate about shaping the future of AI while making a meaningful impact for customers worldwide, we want to hear from you. Key job responsibilities The Senior Applied Scientist will lead the

Data Engineer India - Hyderabad posted: Posted 5 Days Ago

Data Platform Engineer Bucharest posted: Posted Yesterday

Data Engineer-1 Year Contract, ATE Data Engineering Team Beijing, CHN Amazon ATE (Analytics Technology and Engineering) team is seeking for a contractor Data Engineer of deep expertise in creation and management of datasets. The role is responsible to build data analytical solutions that will address increasingly complex business questions, as an expert at implementing and operating stable, scalable data flow solutions from production systems into end-user facing applications/reports; working on developing solutions that provide some of the unique challenges of space, size and speed; implementing data analytics using cutting edge analytics patterns and technologies that are inclusive of but not limited to various AWS Offerings -Redshift, S3 and RDS.; working with partner teams to create dashboards for our customers. Basic Qualifications: - 1+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines - Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala) - Experience with one or more scripting language (e.g., Python, KornShell) Preferred Qualifications: - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR - Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Data Scientist II - AMZ27022.1 San Diego, California, USA Employer: Amazon Web Services, Inc. Position: Data Scientist II - AMZ27022.1 Location: San Diego, CA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. (40 hours / week, 8:00am-5:00pm, Salary Range $136000 - $184000) Amazon.com is an Equal Opportunity - Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation Basic Qualifications: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience

2026 University Graduate - Machine Learning Engineer Seattle posted: Posted 30+ Days Ago

Software Development Engineer, Amazon Data Firehose East Palo Alto, California, USA Come build the future of data streaming with the Amazon Data Firehose (ADF) team! Amazon Data Firehose is a fully managed service for capturing, transforming, and delivering streaming data to destinations like Amazon S3, S3 Tables, Redshift, Splunk, and OpenSearch Service. It automatically scales to handle incoming data, requires no application to be written, and can perform transformations before delivery, such as format conversion or dynamic partitioning. Firehose works with billions of events and petabytes of data each day in support of many thousands of customers running mission-critical real-time applications. We are looking for a Software Development Engineer for the Amazon Data Firehose Team. The team owns all aspects of the Firehose service, including requirements, architecture, design & development, quality assurance, deployment and operations. As an engineer in this team, you will learn the ins and outs of building a highly available, scalable, distributed and secure system that uses all the modern cloud computing paradigms, techniques and tools. The ideal candidate has experience designing large-scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses skills to innovate, design and solve problems at scale. Ideally you have an in-depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark, Apache Flink, or Apache Storm. Your responsibilities will include collaborating with other engineers to build a large scale AWS service, and work with senior leaders

Sr. Associate Data Scientist India - Hyderabad posted: Posted Yesterday

[REMOTE] Principal Software Engineer – Healthcare Analytics & AI United States, US At Oracle Health, we're building the future of healthcare - cloud-native Healthcare Solutions with AI at their core, designed to operate at nation-scale. Our mission is to transform how hospitals and physicians work - enabling better patient care while ensuring accurate, timely reimbursement. We are modernizing Electronic Health Record and Revenue Cycle Management systems using LLMs and AI agents, helping clinicians focus more on patients and less on administrative burden. We're looking for highly skilled AI engineers to design and build high-scale, cloud-based data processing pipelines that ingest, transform, and analyze massive volumes of healthcare data with low latency, powering business insights and analytics across EHR and RCM systems. You will leverage LLMs, AI agents, and modern data platforms to solve problems like clinical decision support, revenue optimization, and workflow automation while using AI-assisted development tools to accelerate delivery. Key Responsibilities • Design and develop scalable data pipelines and AI-driven workflows. • Build LLM/agent-based solutions for business use cases (revenue leakage, readmissions, automation). • Own end-to-end features from data ingestion through transformation and on to insights. • Optimize systems for performance, scale, and low latency. • Mentor junior engineers and contribute to design decisions. Qualifications: • BS/MS in in Computer Science or equivalent. • 8+ years of relevant software engineering experience. • Strong software engineering skills in Python/Java. • Strong knowledge of SQL. • Deep expertise in data engineering: ETL, data transformation, data modeling (Spark, SQL) • Experience

Data Center Plant Engineer, Electrical Haskell, TX, USA The Data Center team designs and operates some of the most sophisticated electrical engineering, mechanical engineering and HVAC systems in the world. Facilities Technicians at Google data centers operate, monitor and support physical facilities conditions. Some of these duties will include heating and cooling of air and water, power supply, generators, UPS systems, electrical distribution and control and monitoring systems. You regularly help inspect, maintain and repair various data center systems such as piping and non-critical electrical or mechanical system components). You provide daily assistance to senior technicians as you read blueprints/schematics, conduct tours of systems and assess their working order. As a master of exceptional practices, you develop creative approaches to reducing operational costs while improving overall data center efficiency. You ensure that environmental and safety standards are consistently met, identifying problems and making repairs quickly In emergency situations or abnormal conditions, you manage data center performance issues and outages to minimize the recovery time from failures. The AI and Infrastructure team is redefining what's possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams

SDE II, Aurora Blue Green Deployment, Aurora Blue Green Deployment Dublin, IRL Looking to be part of a team building hyper-scale database services in the cloud? Do you want to revolutionize the way people manage vast volumes of data in the cloud where you have direct and immediate impact on hundreds of thousands of users who use AWS database services? Aurora is a distributed, fault-tolerant database service, leveraging a self-healing storage system which performs up to five times faster than standard MySQL databases and three times faster than standard PostgreSQL databases. Aurora is one of the fastest-growing AWS services, with business and engineering decisions having a widespread impact across many of the world's fastest growing businesses! Our customers depend on the performance of our services to scale and support their mission-critical workloads. Operating much like a start-up, we have a very flat organizational structure and a casual office vibe, but leverage all the resources and stability of being the largest cloud provider. We are looking for Software Development Engineers who have built software and shipped products. You should be passionate about optimizing the software development experience at a very large scale, using your strong technical skills and motivation to achieve results. You are naturally enthusiastic about learning new technologies and industry trends and are excited by the idea of solving hard technical challenges. Come, join us in reinventing database systems for the cloud! Aurora is a part of AWS Utility Computing (UC) which provides product innovations - from foundational services

Sr Manager Research Science, Last Mile Science and Analytics Bengaluru, Karnataka, IND Have you ever wondered how that Amazon box with the smile arrives so quickly, where it came from, and how much it cost Amazon to deliver? The WW Amazon Logistics, Business Analytics team manages the delivery of tens of millions of products every week to Amazon's customers, achieving on-time delivery in a cost-effective manner. We are seeking an enthusiastic, customer-obsessed Sr. Manager Research Science with strong analytical skills to join our team. This role is crucial in optimizing Amazon's vast delivery network and will have significant impact on the customer experience, particularly in the final phase of delivery. As a Sr. Manager Research Science, you will: 1. Address business challenges through building compelling cases and using data to influence change across the organization 2. Develop input and assumptions based on preexisting models to estimate costs and savings opportunities associated with varying levels of network growth and operations 3. Create metrics to measure business performance, identify root causes and trends, and prescribe action plans 4. Manage multiple high-impact projects simultaneously 5. Work with technology teams and product managers to develop new tools and systems supporting business growth 6. Communicate with and support various internal stakeholders and external audiences 7. Implement scheduling solutions, improve metrics, and develop scalable processes and tools The ideal candidate will have: - Extensive experience in operations research and data-driven decision making - Strong analytical and problem-solving skills - Robust program management and research science skills

Senior Member of Technical Staff - US Citizenship Required United States, US We're looking for highly skilled AI engineers to design and build high-scale, cloud-based data processing pipelines that ingest, transform, and analyze massive volumes of healthcare data with low latency, powering business insights and analytics across EHR and RCM systems. You will leverage LLMs, AI agents, and modern data platforms to solve problems like clinical decision support, revenue optimization, and workflow automation while using AI-assisted development tools to accelerate delivery. Responsibilities As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or operating systems. Provide technical leadership to other software developers. Specify, design and implement modest changes to existing software architecture to meet changing needs. Key Responsibilities Build and enhance data pipelines, ETL workflows, and transformations. Contribute to LLM/agent-based features and analytics use cases. Work with EHR/RCM datasets and support KPI/dashboard development. Learn and apply best practices in cloud, data engineering, and LLMOps. Mandatory Qualifications: BS/MS in in Computer Science or equivalent. 5+ years of relevant software engineering experience. Strong software engineering skills in Python/Java. Strong knowledge of SQL. Deep expertise in data engineering: ETL, data transformation, data modeling (Spark, SQL) Experience building high-scale distributed data systems. Cloud experience (OCI/AWS/Azure). Experience with creating major new functionality in a software system all the way from design, through development and testing to production deployment. Experience with collaborating across multiple functional areas to develop

Lead Engineer - Electric Machines Niskayuna posted: Posted 30+ Days Ago

Sr. Applied Scientist, Prime Video - Personalization and Discovery Science Seattle, Washington, USA Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports - including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video technologist, you'll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You'll get to work on projects that are fast-paced, challenging, and varied. You'll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We'll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! We are looking for a self-motivated, passionate and resourceful Applied Scientist to bring diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. You will