Spark jobs

Sr. Applied Scientist, Seller Fee Science Bengaluru, Karnataka, IND Amazon's third-party marketplace is a multibillion-dollar global ecosystem, connecting customers and sellers across the world through millions of transactions annually. The Seller Fee Science Team integrates economic modeling, machine learning, and artificial intelligence to guide business fee strategy, ensure fees are accurately computed for millions of products, and improves the seller experience with AI tools that support any fee related contact (understanding, audit, and dispute). We build the scientific foundation that empowers sellers to grow their businesses with clarity and confidence. Our team brings together world-class economists, physicists, mathematicians, and computer scientists to tackle diverse challenging problems that require theoretical rigor and deliver real-world impact. For example, measurement of item dimensions (what are the dimensions of a bag of apples?) , large-scale simulation of policy changes (how do marketplace dynamics change when...), Leveraging AI to simplify/document fee policy, resolve disputes, and provide detailed fee explanations to our sellers (explain how this fee is computed and what can be done to reduce costs). As a Senior Applied Scientist on our team, this role will lead the application of machine learning and artificial intelligence to predict and reconcile measurement of products globally. This blends together statistical modeling, application of NLP, image processing, classical machine learning, cost-benefit analysis, causal modeling, and optimization. You will partner closely with engineers and product partners to take your solutions from research to production. You will also help to set the team direction, influence partner teams across product and

Sr. Applied Scientist, Pricing Science Seattle, Washington, USA We are looking for a talented, organized, and customer-focused applied researcher to join our Pricing Optimization science group, with a charter to measure, refine, and launch customer-obsessed improvements to our algorithmic pricing and promotion models across all products listed on Amazon. This role requires an individual with exceptional machine learning modeling and architecture expertise - particularly in deep learning, neural networks, and transformer-based architectures applied to price prediction and forecasting problems. The ideal candidate brings a strong foundation in applied statistics and probabilistic modeling, excellent cross-functional collaboration skills, business acumen, and an entrepreneurial spirit. We are looking for an experienced innovator who is a self-starter, comfortable with ambiguity, demonstrates strong attention to detail, and has the ability to work in a fast-paced and ever-changing environment. Key job responsibilities See the big picture. Understand and influence the long-term vision for Amazon's science-based competitive, perception-preserving pricing techniques. Develop and advance price prediction models leveraging deep learning frameworks, transformer architectures, and advanced statistical methods to drive pricing accuracy at scale. Build strong collaborations. Partner with product, engineering, and science teams within Pricing & Promotions to deploy machine learning price estimation and error correction solutions at Amazon scale. Design and implement neural network-based architectures - including sequence models and transformers - for large-scale price prediction and optimization. Stay informed. Establish mechanisms to stay up to date on the latest scientific advancements in deep learning, transformer architectures, applied statistics, neural network design, probabilistic forecasting, and multi-objective optimization

Emerging Talent Mechanical/ Electronic Summer Trainee (Stavanger) (M/F/D) NO-Rogaland-Stavanger-Lagerveien 30 posted: Posted 7 Days Ago

BIE II, ShipTech Analytics, ShipTech Analytics Hyderabad, Telangana, IND Do you want to be in the forefront of engineering big data analytical solutions that takes Amazon's global transportation models to the next generation? Do you have a solid analytical thinking, metrics driven decision making and want to solve problems with solutions that will meet the growing worldwide need? We are looking for top notch Business Intelligence Engineers to be part of ShipTech Analytics team to build data and analytics solutions powering Amazon's global transportation network. We perform data modeling, build real time analytical platforms using big data tools and AWS technologies like Hadoop, Spark, EMR, SNS, SQS, Lambda, Kinesis Firehose, DynamoDB Streams. As a BIE II, you'll work on building analytical solutions that empower operations teams worldwide. You'll develop both near-real-time (NRT) streaming pipelines and batch processing pipelines that deliver critical insights for decision-making. You'll also build metrics for the transportation network, while contributing to innovative AI-powered solutions delivering automated insights across the transportation network. The ideal candidate relishes working with large volumes of data, enjoys the challenge of highly complex technical contexts, and, above all else, is passionate about data and analytics. The candidate is an expert with data modeling, ETL design and business intelligence tools and passionately partners with the business to identify strategic opportunities where improvements in data infrastructure creates out-sized business impact. The candidate is a self-starter, comfortable with ambiguity, able to think big (while paying careful attention to detail), and enjoys working in a fast-paced

Senior Data Scientist WARSAW DOWNTOWN OFFICE posted: Posted 30+ Days Ago

Senior Software Developer - Oracle Health, US citizenship required United States, US We're looking for highly skilled AI engineers to design and build high-scale, cloud-based data processing pipelines that ingest, transform, and analyze massive volumes of healthcare data with low latency, powering business insights and analytics across EHR and RCM systems. You will leverage LLMs, AI agents, and modern data platforms to solve problems like clinical decision support, revenue optimization, and workflow automation while using AI-assisted development tools to accelerate delivery. Responsibilities As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or operating systems. Provide technical leadership to other software developers. Specify, design and implement modest changes to existing software architecture to meet changing needs. Key Responsibilities Build and enhance data pipelines, ETL workflows, and transformations. Contribute to LLM/agent-based features and analytics use cases. Work with EHR/RCM datasets and support KPI/dashboard development. Learn and apply best practices in cloud, data engineering, and LLMOps. Mandatory Qualifications: BS/MS in in Computer Science or equivalent. 5+ years of relevant software engineering experience. Strong software engineering skills in Python/Java. Strong knowledge of SQL. Deep expertise in data engineering: ETL, data transformation, data modeling (Spark, SQL) Experience building high-scale distributed data systems. Cloud experience (OCI/AWS/Azure). Experience with creating major new functionality in a software system all the way from design, through development and testing to production deployment. Experience with collaborating across multiple functional areas to develop

Evergreen-Business Lead 2 Locations posted: Posted 30+ Days Ago

Principal Member of Technical Staff United States, US We're looking for highly skilled AI engineers to design and build high-scale, cloud-based data processing pipelines that ingest, transform, and analyze massive volumes of healthcare data with low latency, powering business insights and analytics across EHR and RCM systems. You will leverage LLMs, AI agents, and modern data platforms to solve problems like clinical decision support, revenue optimization, and workflow automation while using AI-assisted development tools to accelerate delivery. Responsibilities As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or operating systems. Provide technical leadership to other software developers. Specify, design and implement modest changes to existing software architecture to meet changing needs. Key Responsibilities Design and develop scalable data pipelines and AI-driven workflows. Build LLM/agent-based solutions for business use cases (revenue leakage, readmissions, automation). Own end-to-end features from data ingestion through transformation and on to insights. Optimize systems for performance, scale, and low latency. Mentor junior engineers and contribute to design decisions. Mandatory Qualifications: BS/MS in in Computer Science or equivalent. 8+ years of relevant software engineering experience. Strong software engineering skills in Python/Java. Strong knowledge of SQL. Deep expertise in data engineering: ETL, data transformation, data modeling (Spark, SQL) Experience building high-scale distributed data systems. Cloud experience (OCI/AWS/Azure). Experience with creating major new functionality in a software system all the way from design, through development and testing to production deployment. Experience

Senior Manager of Data Engineering & Business Intelligence, Alexa Audio Seattle, Washington, USA Alexa Audio manages the end-to-end customer listening experience for Alexa+ customers worldwide - across all endpoints, in all geos, and for Alexa's global Audio providers including Amazon Music, Apple Music, Spotify, Deezer, and more. Our team ensures that hundreds of millions of customers can discover, play, and enjoy audio content seamlessly through Alexa. Our team of Product Managers, Technical Program Managers, Data Engineers, and Business Intelligence Engineers work together to deliver smarter, more personalized, and more proactive audio experiences. The data that powers our decisions - from listening hours and content performance to quality metrics, discovery, and partner analytics - must be available, efficient, and trusted. As a Sr. Manager of Data Engineering and Business Intelligence, you will lead a team of 6 Data Engineers and BIEs responsible for the data infrastructure, pipelines, and reporting that underpin Alexa Audio's most critical business metrics. You will increase data availability and efficiency, improve data confidence and reliability, and scale existing systems or build net-new infrastructure to support the needs of a rapidly evolving business. You will own end-to-end analytical solutions that are highly available, scalable, stable, secure, and cost- effective. You are passionate about working with large-scale datasets and have experience with the organization and curation of data for analytics. You have a strategic, long-term view on architecting advanced data ecosystems and the ability to integrate data systems with AWS tools and services to support a variety of customer

Senior Applied Scientist, AWS Central Economics and Science San Francisco, California, USA AWS is one of Amazon's largest and fastest growing businesses, serving millions of customers in more than 190 countries. We use cloud computing to reshape the way global enterprises use information technology. We are looking for entrepreneurial, analytical, creative, flexible leaders to help us redefine the information technology industry. If you want to join a fast-paced, innovative team that is making history, this is the place for you. AWS Central Economics & Science (ACES) drives best practices for objectively applying economics and science in decision making across AWS. The team collaborates with AWS science and business teams to identify, frame, and analyze complex and ambiguous problems of the highest priority. Through data-driven insights and modeling, ACES supports strategic decision-making across the AWS global organization, including sales operations and business performance optimization. The ACES Sales Channels team is hiring an Applied Scientist (Senior or below) to advance our mission of providing rigorous, causal-inference-driven recommendations for AWS sales optimization. This role will focus on building ML systems with a causal modeling foundation, designing seller incentive mechanisms, and developing intervention strategies across the entire sales motion. Key job responsibilities • Causal ML System Development: Build and deploy machine learning models that emphasize causal inference, ensuring recommendations are grounded in valid interventions • Incentive Design: Define and model incentives that drive desirable behaviors across AWS sales channels, partner programs, and reseller ecosystems • Stakeholder Collaboration: Work with business stakeholders to understand requirements,

Senior Associate, Cloud Engineer Greece-Thessaloniki Chortiatis posted: Posted 18 Days Ago

Director, Data Engineering — Customer Success Score California - San Francisco; Washington - Seattle About the Role We're building data products that will define Salesforce's next era of agentic intelligence - powering smarter, adaptive, and self-optimizing product experiences at enterprise scale. As Director of Data Engineering, you'll set the strategic direction, architectural vision, and organizational execution for the data systems behind Customer Success Score (CSS), one of Salesforce's most critical product intelligence assets. This is a high-visibility leadership role for a strategic technologist who thrives at the intersection of data, AI, and platform engineering. What You'll Do Platform Strategy & Roadmap Own the roadmap for the CSS data platform, aligning engineering investment with Salesforce's agentic and AI-first product strategy Establish architectural principles and governance standards for telemetry, semantic modeling, and metadata-driven discovery at enterprise scale Drive convergence across product analytics, ML infrastructure, and AI data foundations - breaking down silos and creating shared organizational leverage Represent data engineering at the executive level; shape organizational priorities and secure resources for strategic initiatives Technical Architecture & Excellence Set and uphold the technical bar for distributed data systems - including fault-tolerant batch and streaming architectures (Spark, Trino, Flink, Kafka, dbt, Snowflake) Define engineering standards across software quality, CI/CD, observability, and reliability Guide platform evolution to support autonomous agent reasoning, real-time adaptive decisioning, and AI-native product experiences Champion semantic consistency, metric governance, and trusted signal definition across the organization Evaluate emerging technologies and drive adoption decisions that extend the platform's strategic value Organizational Leadership

Associcate Data Engineer India - Hyderabad posted: Posted 14 Days Ago

Senior Applied Scientist, Full-funnel Agentic Intelligence and Models Palo Alto, California, USA Amazon Advertising is one of Amazon's fastest growing and most profitable businesses. Amazon's advertising portfolio helps merchants, retail vendors, and brand owners succeed via native advertising, which grows incremental sales of their products sold through Amazon. The primary goals are to help shoppers discover new products they love, be the most efficient way for advertisers to meet their business objectives, and build a sustainable business that continuously innovates on behalf of customers. Our products and solutions are strategically important to enable our Retail and Marketplace businesses to drive long-term growth. We deliver billions of ad impressions and millions of clicks and break fresh ground in product and technical innovations every day! Amazon continues to develop its advertising program. Ads run in our Stores (including Consumer Stores, Books, Amazon Business, Whole Foods Market, and Fresh) and Media and Entertainment publishers (including Fire TV, Fire Tablets, Kindle, Alexa, Twitch, Prime Video, Freevee, Amazon Music, MiniTV, Audible, IMDb, and others). In addition to these first-party (1P) publishers, we also deliver ads on third-party (3P) publishers. We have a number of ad products, including Sponsored Products and Sponsored Brands, display and video products for smaller brands, including Sponsored Display and Sponsored TV. We also operate ad tech products, including Amazon Marketing Cloud (a clean-room for advertisers), Amazon Publisher Cloud (a clean-room for publishers), and Amazon DSP (an enterprise-level buying tool that brings together our ad tech for buying video, audio, and display

Senior Data Production Engineer 2 Locations posted: Posted Yesterday

Electrical Engineer, Data Center Engineering Seattle, Washington, USA AWS Infrastructure Services (AIS) AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. The Worldwide Sustainability (WWS) organization capitalizes on Amazon's scale, speed, ability to build, invent, and simplify a resilient and sustainable company. We manage our social and environmental impacts globally, and drive solutions that enable our customers, businesses, and the world to become more sustainable. Key job responsibilities - Produce clear and concise documentation such as detailed design specifications, drawings, white papers, wiring schematics and diagrams, and reports. - Understand and safeguard implementation of the Global Electrical Basis of Design (BoD) by driving standardization in the data

Data Scientist II - AMZ9774210 New York, New York, USA MULTIPLE POSITIONS AVAILABLE Employer: AMAZON DEVELOPMENT CENTER U.S., INC. Offered Position: Data Scientist II Job Location: New York, New York Job Number: AMZ9774210 Position Responsibilities: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. Position Requirements: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience in the job offered or a related occupation. Employer will accept a Bachelor's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer

Sr. Applied Scientist, Alexa Excellence AI Ops, Alexa Excellence AI Ops Chennai, Tamil Nadu, IND We are seeking a Senior Applied Scientist to join the Alexa Availability team within Alexa Excellence. This role leads the research and development of machine learning and statistical models that power Alexa's reliability at massive scale - serving hundreds of millions of customers globally. The ideal candidate will tackle complex, ambiguous problems spanning time series multivariate modeling, statistical anomaly detection, LLM-based operational intelligence, and adaptive threshold systems. They will design production-grade ML solutions, establish rigorous evaluation frameworks, and ensure AI systems are grounded, reliable, and free from systematic bias - leveraging techniques such as RAG, confidence scoring, knowledge graph integration, and counterfactual testing. This scientist will partner with engineers, product managers, and operations leaders to translate scientific innovation into production systems that directly impact Alexa's availability worldwide. They will drive the scientific agenda for the team, mentor fellow scientists, and influence the broader Alexa Excellence organization through technical leadership and cross-team collaboration. Key Focus Areas: Anomaly detection and predictive failure modeling Cross-service correlation and LLM-driven operational intelligence Production ML at the intersection of large-scale distributed systems and applied science Model reliability, hallucination mitigation, and grounding for operational AI Key job responsibilities As a Senior Applied Scientist on the Alexa Availability team, you will lead the research and development of machine learning and statistical models that power Alexa's reliability at scale. You will work on some of the most complex and ambiguous problems in the space

Staff Power Applications Engineer Ireland, Limerick posted: Posted 30+ Days Ago

Sr. Applied Scientist, Ads AI Core Infrastructure New York, New York, USA Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering AI-powered solutions that transform how advertisers make strategic decisions. We deliver billions of ad impressions and process massive volumes of advertiser data every single day. You'll work with us to pioneer breakthrough approaches in how AI agents access and reason over real-time advertiser data at scale. We are using generative AI and agentic systems to help advertising agents provide instant, strategic advice to millions of advertisers. You will need to invent new techniques for agent orchestration, context optimization, and code generation to ensure we're delivering accurate, trustworthy insights with minimal latency and token consumption. You'll create feedback loops to ensure our solutions are constantly evaluating themselves and improving. The Ads Real-Time Data Service team is seeking an exceptional Applied Scientist to research and develop novel approaches for agent-data interaction. The Ads Real-Time Data Service team is solving one of the most critical challenges in advertising AI: instant access to advertiser context. We're building the infrastructure that provides immediate, pre-computed access to advertiser data via Model Context Protocol (MCP) servers-an emerging standard for AI agent-data interaction. We're building summarized data for context using a mix of state of the art techniques like CodeAct and RAG-based embeddings, achieving a fundamental transformation in how AI agents interact with data. This role balances applied research (60%) with productionization (40%), giving you the opportunity to both

Ingénieur client programme APS Radial | Radials APU Program Customer Engineer CA-ON-MISSISSAUGA-P22M01 ~ 1801 Courtney Park Dr ~ P22M01 BLDG posted: Posted Yesterday

Data Scientist II - AMZ24268.1 New York, New York, USA Employer: Metro-Goldwyn-Mayer Studios Inc. Position: Data Scientist II Location: New York, NY Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. (40 hours / week, 8:00am-5:00pm, Salary Range $169541 - $207500) Amazon.com is an Equal Opportunity - Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation Basic Qualifications: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience in the

Director, Cloud Engineering Greece-Thessaloniki Chortiatis posted: Posted 18 Days Ago

Sr. Applied Scientist, Applied AI Solutions Seattle, Washington, USA The newest business group in AWS, Applied AI Solutions are built by AWS and AWS Partners to deliver applied AI solutions that leverage Amazon's operational expertise and that businesses love and trust for their day-to-day success. Our ambition is to become a partner which companies can rely on to run their business every day, putting AI to work delivering better customer experience, operational excellence and speed. Are you excited about pushing past single-turn chat into agents that run for hours or days, planning, recovering from failure, and accumulating knowledge as they work? Do you want to design the harnesses, memory systems, and context strategies that turn frontier models into reliablen collaborators on real business problems? Do you enjoy the prospect of solving agent problems that haven't been solved at scale anywhere before, including memory decay, belief revision, fact grounding, long-horizon credit assignment, and evaluation of open-ended trajectories? Along the way, you'll get opportunities to be a disruptor, innovator, and a problem solver, someone who truly enables AI agents to create significant impacts. Key job responsibilities You will partner with cross-functional business and engineering teams to identify and deliver high-impact agentic use cases across the Applied AI Solutions portfolio. You will design, develop, and evaluate long-running agents - including orchestration harnesses, memory architectures (episodic recall, semantic facts, revisable beliefs, principled decay), context compaction strategies, and safe, auditable tool and environment designs. You will define evaluation frameworks for agents whose outputs defy single-answer