Spark jobs

Senior Applied Scientist, FinAuto Bengaluru, Karnataka, IND Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon's customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for FinAuto. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon's historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish

Data Engineer India - Hyderabad posted: Posted 30+ Days Ago

ML / Data Engineer – Data Science Enablement India - Hyderabad posted: Posted 30+ Days Ago

Big Data Engineer III Chennai, Tamil Nadu, IND Amazon's Profit Intelligence is seeking a talented Big Data Engineer to join the Profit Intelligence team. We develop software solutions that are revolutionizing Amazon business intelligence through advanced algorithms running on big data technologies. The ideal candidate thrives in a fast-paced environment and relishes working with petabytes of extremely complex and dynamic data. In this role you will be part of a team of high caliber data and software engineers to build data pipelines using big data technologies such as Apache Spark, Hive/Hadoop, and distributed query engines. You should be passionate about working with big data and have the aptitude to incorporate new technologies and evaluate them critically. You must possess excellent business and communication skills and be able to work with business owners to analyze requirements and build solutions. You are a self-starter, has a proven track record of dealing with ambiguity and working in a fast-paced, highly dynamic environment. Working experience of any one of the programming languages such as Java, C#, Scala, etc. is a big plus. Key job responsibilities Interface with PMs, business customers, and software developers to understand requirements and implement solutions Collaborate with both Retail Finance and central FP&A teams to understand the interdependence and deliverables Design, develop, and operate highly-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms with AWS technologies Recognize and adopt best practices in data processing, reporting, and analysis: data integrity, test design, analysis, validation, and documentation Keep up

Senior Applied Scientist, Sponsored Products and Brands Seattle, Washington, USA The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through industry leading generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising! The Amazon Sponsored Products and Brands is looking for a talented Sr. Applied Scientist to join the Global Optimization science team at the forefront of advertising technology innovation. We are working backwards from emerging markets to reimagine Amazon's advertising stack from the ground up, leveraging multilingual and multi-modal GenAI technologies - including semantic hash designs, LLMs, and more - to deliver solutions that scale to non-US marketplaces from day one. This is your opportunity to be part of a small, high-impact team that prototypes, invents, and ships state-of-the-art solutions that will define the future of digital advertising. The ideal candidate combines entrepreneurial drive with deep technical expertise, thriving in ambiguous, fast-moving environments where you define the path forward

Data Engineer India - Hyderabad posted: Posted 8 Days Ago

Senior Applied Scientist, Special Projects Seattle, Washington, USA Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company's Think Big leadership principle to the limits. If you're interested in innovating at scale to address big challenges in the world, this is the team for you. As a Senior Applied Scientist on our team, you will focus on building state-of-the-art ML models for healthcare. Our team rewards curiosity while maintaining a laser-focus in bringing products to market. Competitive candidates are responsive, flexible, and able to succeed within an open, collaborative, entrepreneurial, startup-like environment. At the forefront of both academic and applied research in this product area, you have the opportunity to work together with a diverse and talented team of scientists, engineers, and product managers and collaborate with other teams. This role offers a unique opportunity to work on projects that could fundamentally transform healthcare outcomes. Key job responsibilities In this role, you will: • Design and implement novel AI/ML solutions for complex healthcare challenges • Drive advancements in machine learning and data science • Balance theoretical knowledge with practical implementation • Work closely with customers and partners to understand their requirements • Navigate ambiguity and create clarity in early-stage product development • Collaborate with cross-functional teams while fostering innovation in a collaborative work environment to deliver impactful solutions • Establish best practices for ML experimentation, evaluation, development and deployment • Partner with leadership to define roadmap

Data Engineer India - Hyderabad posted: Posted 3 Days Ago

Sr. Software Development Engineer, EMR East Palo Alto, California, USA Do you enjoy working on large-scale distributed systems? Do you want to influence how the world interacts with and analyzes large data sets across a number of industries and use cases? Amazon EMR provides a managed framework that makes it easy, fast, and cost-effective to process vast amounts of data across dynamically scalable Amazon EC2 instances using popular distributed Hadoop frameworks such as Apache Spark, HBase, Presto, and Flink, and interact with data in other AWS data stores such as Amazon S3 and Amazon DynamoDB. Our customers in a variety of industries - eg: real estate, travel, finance and gaming - use EMR to process and interact with their vast datasets to fulfill existing and uncover new business needs. We are looking for talented engineers to help us develop innovative features for EMR to enable an interactive, secure and seamless experience for our growing customer base. One such feature is our next-generation cluster and work management system designed with an emphasis on speed, reliability and security. We'll trust you to design and implement critical high performance, large scale services and libraries in collaboration with other internal development teams to solve key business problems with minimal technical supervision. We'll be looking to you to evangelize SDLC best practices across the organization, help refine operational procedures and workflows, and influence architectural decisions to achieve our technical and business goals. In this role, you will have the opportunity to collaborate with and learn

Machine Learning Engineer, Adobe Firefly Services 2 Locations posted: Posted 30+ Days Ago

ASIC Power Engineer, ML Accelerators Sunnyvale, CA, USA In this role, you'll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You'll be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems. As an ASIC Design Engineer, you will be part of a team developing ASICs used to accelerate computation in data centers. You will have dynamic, multi-faceted responsibilities in areas such as project definition, design, and implementation. You will participate in the design, architecture, documentation, and implementation of the next generation of data center accelerators. The AI and Infrastructure team is redefining what's possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development

Facility Manager Sparks, Nevada, USA Join our dynamic team and become a critical technical leader who ensures the heartbeat of our global infrastructure remains strong and resilient. In this pivotal role, you'll be the guardian of our data center operations, driving reliability and performance while optimizing operational efficiency across complex technical environments. Data Center Facility Manger role acts as Amazon's front line when it comes to hands-on electrical and mechanical equipment troubleshooting. They will maintain, operate, and troubleshoot mission-critical data center facility equipment including electrical support equipment such as stand-by diesel generators and related fuel systems, 3 phase electrical systems that include but not limited to switchgear, UPS units, PDUs, and wet cell batteries and associated systems. Mechanical equipment includes CRAC units, centrifugal chillers, cooling towers/water chemical systems, air handlers and associated systems, pumps, and motors. Additional support equipment is included in the scope of the role which includes fire suppression systems, building automation systems, and general facilities equipment. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network

Lead Power Systems Engineering Busan posted: Posted 2 Days Ago

Senior Applied Scientist, International Machine Learning Bengaluru, Karnataka, IND Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon's customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon's historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various

Software Dev Engineer II, Ads AI Core Infra Seattle, Washington, USA Would you like to build highly available, scalable and distributed engineering systems for one of the largest data lakes in Amazon? Does Petabyte scale excite you? The Analytics & Data Management (ADM) team in Ads AI Core Infra owns the central datalake for Advertising unifying Petabytes of data generated across the Ads pipeline such as campaigns, ad-serving, billing, clicks, impressions and more and into a single scalable repository. This is used across the organization to drive hundreds of thousands of complex queries for analysis, measurement and reporting decisions for our customers. The data lake enables customers such as data engineers, business analysts, ML engineers, research scientists, economists and data experts to collect what they need via world-class self-service tools. ADM is building the next version of its data lake for 5x growth. An SDE on the ADM team has a unique opportunity to design and innovate solutions for this scale, delivering robust and scalable microservices built over Java and AWS as well as innovate with big data technologies like Spark, EMR, Athena and more. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth. Key job responsibilities - Engage with key decision makers such as Product & Program Managers to understand customer requirements and brainstorm on solutions - Design, code and deploy components and micro-services for the core job management pipeline - Ensure testability, maintanability and low

IoT Quality Engineer USA - Pennsylvania - Green Tree posted: Posted 30+ Days Ago

Senior AI Expert Software Engineer – Healthcare Analytics United States, US About the Role At Oracle Health, we're building the future of healthcare - cloud-native Healthcare Solutions with AI at their core, designed to operate at nation-scale. Our mission is to transform how hospitals and physicians work - enabling better patient care while ensuring accurate, timely reimbursement. We are modernizing Electronic Health Record and Revenue Cycle Management systems using LLMs and AI agents, helping clinicians focus more on patients and less on administrative burden. We're looking for highly skilled AI engineers to design and build high-scale, cloud-based data processing pipelines that ingest, transform, and analyze massive volumes of healthcare data with low latency, powering business insights and analytics across EHR and RCM systems. You will leverage LLMs, AI agents, and modern data platforms to solve problems like clinical decision support, revenue optimization, and workflow automation while using AI-assisted development tools to accelerate delivery. Key Responsibilities • Build and enhance data pipelines, ETL workflows, and transformations. • Contribute to LLM/agent-based features and analytics use cases. • Work with EHR/RCM datasets and support KPI/dashboard development. • Learn and apply best practices in cloud, data engineering, and LLMOps. Mandatory Qualifications: • BS/MS in in Computer Science or equivalent. • 5+ years of relevant software engineering experience. • Strong software engineering skills in Python/Java. • Strong knowledge of SQL. • Deep expertise in data engineering: ETL, data transformation, data modeling (Spark, SQL) • Experience building high-scale distributed data systems. • Cloud experience (OCI/AWS/Azure). •

Data Center Project Buyer 11 Locations posted: Posted Yesterday

Senior Applied Scientist, Amazon Stores Economics & Science (SEAS) Seattle, Washington, USA Stores Economics and Science (SEAS) is an interdisciplinary science and engineering team in Amazon's Stores organization with a peak-jumping mission: we apply expertise in science and engineering to move from local to global optima in methods, models, and software. We pursue this mission by leveraging frontier science; collaborating with partner teams; and learning from the tools, experience, and perspective of others. We scale by solving problems, first in the small to prove concepts, and then in the large by building scalable solutions. We also help other teams within Amazon scale by hiring and developing the best and embedding them in other business units. We are team of passionate Applied Scientists, Research Scientists, and Economists collaborating to uncover, formulate, and solve big bet issues for broader Stores organization, including marketplace efficiency, seller incentive design, and inventory optimization. We are seeking to add another member to our team who thrives in inter-disciplinary, ambiguous, and high visibility environments. Key job responsibilities The successful candidate will lead large-scale science initiatives from research to production and translate complex business problems into mathematical frameworks. They will design and implement large-scale optimization algorithms for complex supply chain and marketplace problems, and design incentive-compatible mechanisms for marketplace challenges including auction design, matching algorithms, and pricing strategies. The ideal candidate will have a strong publication record in top-tier conferences/journals (INFORMS, EC, WINE, ICML, NeurIPS, etc.) and experience coordinating cross-functional projects. They should have hands-on experience building science

Data Engineer Senior - Data Products Organization (Cloudera Hadoop) 4 Locations posted: Posted 3 Days Ago

Software Development Engineer, Measurement, Ad Tech, and Data Science (MADS) Foundations- Traffic Seattle, Washington, USA The Traffic Applications team, part of Measurement, Ad Tech, and Data Science (MADS), owns the data ingress system for all of Amazon Ads. Traffic ingests hundreds of billions of ad events daily from upstream systems, decorates them with dimensional and identity data, and publishes structured traffic and billing datasets in a standardized format to downstream consumers across the Ads ecosystem. The system operates under strict SLAs for data freshness and accuracy on tier-one advertising metrics, owning three of the five critical metrics used for Ads billing. As the first MADS system to encounter regulatory and identity changes, Traffic's architectural decisions propagate across the entire MADS stack, making design choices here uniquely consequential. You will have the opportunity to work on critical business initiatives that directly impact Ads VP and SVP level goals. These include compliance initiatives such as GDPR and ePrivacy, enabling geo-targeting features, and driving architecture scalability to support spiky traffic from live sports events. Key job responsibilities As a SDE , you will: - Own team architecture and lead design on multi-engineer efforts across our Spark-based EMR pipelines, decoration jobs, and publication systems - Navigate ambiguous technical problems with conflicting constraints - regulatory deadlines, performance requirements, cost targets, and cross-org dependencies - Identify one-way-door decisions, proactively address architectural deficiencies, and ensure Traffic's design doesn't limit what downstream teams can build - Drive adoption of engineering best practices and maintain sound operations - alarms,

Research Engineer Seattle posted: Posted 30+ Days Ago

Sr Applied Scientist, Digital Ads , Amazon Digital Advertising Seattle, Washington, USA Are you passionate about developing new state-of-the-art measurement approaches at Petabyte scale? Amazon Advertising is one of Amazon's fastest growing businesses, and we are leveraging our unique data, the latest machine learning methods and big data technologies to better understand how Amazon's marketing influences customer behavior. We are looking for a Senior Applied Scientist to develop new systems and methods in the most challenging and data rich areas of marketing. We need an expert in experimental statistics, machine learning or causal inference to design advanced new models with our world class data systems. Dozens of Amazon businesses use Amazon's ad tech for their marketing objectives, driving more than $1B of marketing investments through Ads services and tools. As part of the 1PM team, this role will partner with a dedicated engineering team measuring the impact Amazon's marketing and identifying opportunities for optimization at scale. We drive initiatives to make smarter marketing decisions and improve the relevance of advertising to our customers. We move away from industry standard measurement systems and build sophisticated and insightful decision engines. We enable massive advertising programs, generating billions of impressions decorated with rich representations of customer state. The major challenges we are solving include integrating petabyte-scale distributed retail systems into a singular service to synthesize e-commerce data into measurement and optimization models. The successful candidate will have a causal inference background, a start-up mentality, an appreciation for white-space, and success solving problems with

Senior Machine Learning Engineer 3 Locations posted: Posted 30+ Days Ago