Spark jobs

Senior Data Platform Engineer Lisbon About Us Riskified empowers businesses to unleash ecommerce growth by taking risk off the table. Many of the world's biggest brands and publicly traded companies selling online rely on Riskified for guaranteed protection against chargebacks, to fight fraud and policy abuse at scale, and to improve customer retention. Developed and managed by the largest team of ecommerce risk analysts, data scientists and researchers, Riskified's AI-powered fraud and risk intelligence platform analyzes the individual behind each interaction to provide real-time decisions and robust identity-based insights. Riskified is proud to work with incredible companies in virtually all industries including Acer, Gucci, Lorna Jane, GoPro, and many more . We thrive in a collaborative work setting, alongside great people, to build and enhance products that matter. Abundant opportunities to create and contribute provide us with a sense of purpose that extends beyond ourselves, leaving a lasting impact. These sentiments capture why we choose Riskified every day. About the Role We're looking for a talented multi disciplinary Senior Data Platform Engineer with passion for infrastructure, who will be responsible for the performance, scale, and stability of our core data platform products. We are a data-driven organization, ingesting data at high rates, with demands increasing each day. As a Senior Data Platform Engineer , you will be part of the Data Platform group and will be responsible for a large scale production data platform that serves as the core infrastructure of our products. You'll develop self-service tools that support the

Senior Applied Scientist, Amazon Shopping Personalization New York, New York, USA Are you a scientist interested in pushing the state of the art in machine learning and recommendation systems? Are you interested in working on novel ideas that can positively impact millions of customers? Do you wish you had access to large datasets and tremendous computational resources? Answer yes to any of these questions and you will be a great fit for our team at Amazon. As an Senior Applied Scientist in our team, you will be responsible for the research, design, and development of new AI technologies for Personalization. You will adopt or invent new machine learning and analytical techniques in the realm of recommendations and large language models. You will collaborate with scientists, engineers, and product partners locally and abroad. Your work will include inventing, experimenting with, and launching new features, products and systems. Key job responsibilities - Using Amazon's large-scale computing resources, you will ask research questions about customer behavior, build state-of-the-art models to optimize the shopping experience, and run these models directly on the retail website. - Develop AI solutions for Recommendation systems using Deep learning, LLMs, Reinforcement Learning, distillation, and Optimization methods; - Work closely with engineers and product managers to design, implement and launch AI solutions end-to-end; - Design and conduct offline and online (A/B) experiments to evaluate proposed solutions based on in-depth data analyses; - Effectively communicate technical and non-technical ideas with teammates and stakeholders; - Stay up-to-date with advancements and the latest

Data Engineer - R&D Data Catalyst Team India - Hyderabad posted: Posted 30+ Days Ago

On-Device ML Infrastructure Engineer, ML User Experience, APIs & Integration, Graphics, Games and Machine Learning Cupertino, United States of America Imagine being at the forefront of an evolution where innovative AI meets the elegance of Apple silicon. The On-Device Machine Learning team transforms groundbreaking research into practical applications, enabling billions of Apple devices to run powerful AI models locally, privately, and efficiently. We stand at the unique intersection of research, software engineering, hardware engineering, and product development, making Apple a top destination for machine learning innovation. We are building the first end-to-end developer experience for ML development that, by taking advantage of Apple's vertical integration, allows developers to iterate on model authoring, optimization, transformation, execution, debugging, profiling and analysis. This team builds the essential infrastructure that enables machine learning at scale on Apple devices. This involves onboarding modern architectures to embedded systems, developing optimization toolkits for model compression and acceleration, building ML compilers and runtimes for efficient execution, and creating comprehensive benchmarking and debugging toolchains. This infrastructure forms the backbone of Apple's machine learning workflows across Camera, Siri, Health, Vision, and other core experiences, supplying to the overall Apple Intelligence ecosystem. If you are passionate about the technical challenges of running sophisticated ML models across all devices, from resource-constrained devices to powerful clusters, and eager to directly impact how machine learning operates across the Apple ecosystem, this role presents a great opportunity to work on the next generation of intelligent experiences on Apple platforms. Our group is seeking an ML

Sr. Applied Scientist, Trust CX Innovations&AI Policy Bengaluru, Karnataka, IND Alexa+ is Amazon's next-generation, AI-powered assistant. Building on the original Alexa, it uses generative AI to deliver a more conversational, personalized, and effective experience. The Trust CX Innovations team is looking for an Applied Scientist with strong background in Generative AI space to build solutions that help in upholding customer trust for Alexa+. A Senior Applied Scientist in Trust CX innovations, you will be at the forefront of developing innovative solutions to critical challenges in AI trust and privacy. You'll lead research in trust-preserving machine learning techniques. We are working on revolutionizing the way Amazonians work and collaborate. You will help us achieve new heights of productivity through the power of advanced generative AI technologies. We are looking for a leader with strong technical experiences a passion for building scientific driven solutions in a fast-paced environment. You should have good understanding of Artificial Intelligence (AI), Natural Language Understanding (NLU), Machine Learning (ML), Dialog Management, Automatic Speech Recognition (ASR), and Audio Signal Processing where to apply them in different business cases. You will be joining a select group of people making history producing one of the most highly rated products in Amazon's history, so if you are looking for a challenging and innovative role where you can solve important problems while growing as a leader, this may be the place for you. Key job responsibilities • Lead research initiatives in generative AI, focusing on LLMs, multimodal models, and frontier AI capabilities

Sr. Applied Science , AWS Agentic AI Santa Clara, California, USA Come join the AWS AI science team in building the next generation models for intelligent automation. AWS, the world-leading provider of cloud services, has fostered the creation and growth of countless new businesses, and is a positive force for good. Our customers bring problems that will give Applied Scientists like you endless opportunities to see your research have a positive and immediate impact in the world. You will have the opportunity to partner with technology and business teams to solve real-world problems, have access to virtually endless data and computational resources, and to world-class engineers and developers that can help bring your ideas into the world. As part of the team, we expect that you will develop innovative solutions to hard problems, and publish your findings at peer reviewed conferences and workshops. We are looking for world class researchers with experience in one or more of the following areas - autonomous agents, API orchestration, Planning, large multimodal models (especially vision-language models), reinforcement learning (RL) and sequential decision making. About the team Agentic AI drives innovation at the forefront of artificial intelligence, enabling customers to transform their businesses through cutting-edge AI solutions. We build and deliver the foundational AI services that power the future of cloud computing, helping organizations harness the potential of AI to solve their most complex challenges. Join our dynamic team of AI/ML practitioners, applied scientists, software engineers, and solution architects who work backwards from customer needs

Staff Backline Engineer - Platform Mountain View, California; San Francisco, California P-1399 Recruiter: Stephanie Williams Hiring Manager: Ratish Maruthiyodan At Databricks, we are passionate about enabling Data & AI teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers, we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. About the Team: The Backline Engineering Team serves as the critical bridge between Frontline Support and Engineering. We handle complex technical issues and escalations across the Data and AI ecosystem. With a strong focus on customer success, we are committed to delivering exceptional customer satisfaction by providing deep technical expertise, proactive issue resolution, and continuous platform improvements. We emphasize automation and tooling to enhance troubleshooting efficiency, reduce manual efforts, and improve the overall supportability of the platform and the health of our products. By developing smart solutions and streamlining workflows, we drive operational excellence and ensure a delightful experience for both customers and internal teams. What your impact will be: - Act as the ultimate technical escalation point, driving the resolution of the most complex, high-stakes customer issues on the Databricks Platform through deep analysis

Machine Learning Engineer - 3 Bangalore posted: Posted 30+ Days Ago

Software Dev Engineer III, Ads AI Core Infra Bengaluru, Karnataka, IND Would you like to build highly available, scalable and distributed engineering systems for one of the largest data lakes in Amazon? Does Petabyte scale excite you? Spektr Datalake team is the central data lake for Advertising unifying Petabytes of data generated across the Ads pipeline such as campaigns, ad-serving, billing, clicks, impressions and more and into a single scalable repository. This is used across the organization to drive hundreds of thousands of complex queries for analysis, measurement and reporting decisions for our customers. The data lake enables customers such as data engineers, business analysts, ML engineers, research scientists, economists and data experts to collect what they need via world-class self-service tools. Spektr Data Lake team in Ads AI Core Infra org has a mission to provide unified experience for easy discovery and access to privacy compliant data that helps advertising business teams quickly generate insights and meet the data needs of Ads AI models with a vision to 'build the world's best & most cost efficient analytics platform'. A Sr SDE on this team has a unique opportunity to create tech strategies, design and innovate solutions for this scale, delivering robust and scalable services built over Java leveraging AWS services as well as innovate with big data technologies like Spark, EMR, Athena and more. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth. Key job responsibilities

Senior Software Engineer (L5) - Analysis USA - Remote At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what's next. The Analysis team in Experimentation Platform builds and operates the core systems that power A/B test analysis across Netflix. Our tools enable confidence in business decisions that affect our members. We are looking for a Senior Distributed Systems Engineer to design, build, and operate the next generation of analysis tooling at Netflix. What You'll Do Build and evolve critical experiment analysis tooling Build, maintain, and improve real-time and batch analysis workflows for experiment analysis, regression detection, and more Own reliability and performance Participate in on-call, lead incident response, and drive long-term reliability improvements Instrument services with rich observability (metrics, logs, traces) and continuously tune for resilience, performance, and scalability Shape data and integration surfaces Collaborate with teams using technologies like Flink, Spark, Elasticsearch, and Druid to ensure experimentation data is correct, timely, and usable Define clear data and API contracts for consumers and pipelines Partner with product engineering teams Deeply understand experimentation workflows across Netflix Simplify and improve the experience for monitoring and deciding experiments What Sets You Apart Strong understanding of experimentation lifecycle and risks You've done it before: run or

Data Engineering Lima, Peru posted: Posted Today

Senior Data Scientist , Alexa AI Aurora Bellevue, Washington, USA The Alexa AI AURORA organization is seeking a passionate, talented, and resourceful Senior Data Scientist to define and solve complex, ambiguous problems in state-of-the-art conversational AI. You will lead large-scale data science initiatives across the fields of Large Language Models (LLMs), Natural Language Processing (NLP), and Artificial Intelligence (AI), selecting the ideal methodologies from a wide range of data science disciplines to drive measurable business impact for millions of Alexa customers. In this role, you will autonomously define problem spaces and solution approaches, working closely with business, science, and engineering teams to build consensus and influence strategy. You will advise senior leadership on data-driven decisions, identify blind spots in existing metrics, and propose new measurements that shape our product direction. You will actively mentor and develop other data scientists while setting standards for scientific rigor and operational excellence within the team. The ideal candidate has broad expertise across multiple data science disciplines and a deep understanding of how software systems, data pipelines, and business processes interact. They take the lead on complex projects with minimal guidance, make sound trade-offs between short-term customer needs and long-term technical investments, and deliver solutions that are scalable, reproducible, and actionable. A proven track record of launching data science solutions that drive significant business outcomes is essential. Strong communication skills, the ability to document and present technical findings to both technical and non-technical audiences, and a commitment to collaborative teamwork are absolute requirements. Join us

Senior Software Engineer - Hybrid Ciudad de México, DIF, Mexico Company Description: NielsenIQ is a global strategy and analytics company that provides tailored, data-driven solutions that drive sales, boost profitability. Leveraging our deep analytics expertise, NielsenIQ helps organizations improve their competitive position across all facets of planning and operations from assortment optimization, price optimization, promotional optimization, targeted marketing, and supplier collaboration. Job Description: As a Senior Software Engineer , you'll be a part of a highly Agile and skilled team of other engineers who are proud to partner with some of the world's leading retailers on challenging, cutting-edge, data driven solutions, powered by technology, and people. This is a highly technical role that will allow you to be involved in the architecture of backend development using Java, Python, and/or Spark technologies. Responsibilities: Develop solutions for industry leading analytics. Work as part of a team to design, develop and deploy systems with multiple customizations. Develop with system integration in mind, mainly in context of data flow into and from BI Reporting Tool. Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises Continually develop technical expertise to ensure that customer solutions are efficient. Consistently develop with performance in mind to optimize end user experience. Work with architects and senior team members to identify new tools and technologies where applicable to expand customer offerings. Research and take advantage of new technology to improve and expand solutions. Participate in peer code reviews and troubleshoot and correct software defects. Monitor performance and advise

MLOps Engineer Bangalore, India posted: Posted 30+ Days Ago

SDE 3 - DevOps Mumbai FanCode is India's premier digital sports destination, dedicated to delivering a best-in-class experience for fans across live and non-live sports. Launched in March 2019 by industry veterans Yannick Colaco and Prasana Krishnan, FanCode has reached over 160 million users. The platform features a wide array of global and domestic sporting leagues, in partnership with leading sports associations. FanCode offers interactive live streaming through industry-first subscription models, including Match, Bundle, and Tour Passes, as well as monthly and annual plans at accessible price points. Some of the marquee properties include La Liga, Formula 1, MotoGP, cricket leagues from around the globe including CPL, Super Smash amongst others. Dream Sports, India's leading Sports Technology company, is the parent company of FanCode, with brands such as Dream11, and DreamSetGo in its portfolio. The mission is to create a platform for all sports fans, covering Sports Live Video Streaming, Live Scores & Commentary, Video On Demand, Player Analytics, Fantasy Research, News. Our tech stack is hosted on GCP and is built on GKE, GCS, Cloud Run, MediaCDN utilizing a microservices-based architecture with Java, Node.js, Python, Redis, MySQL, Cassandra, and Elasticsearch. They are a data-driven team that also uses Python and big data technologies like Kafka, Spark, and Redshift for Machine Learning and Predictive Analytics. As a data-driven team, we also use Python and other big data technologies for Machine Learning and Predictive Analytics. Besides these, we heavily use Kafka, Spark, Redshift and other cutting edge tech to keep improving

Data & AI Delivery Lead - R&D London Bankside, London, London, United Kingdom

Enterprise Hunter Account Executive - West Mumbai, India SLSQ227R67 As an Enterprise Account Executive at Databricks, you are an experienced enterprise sales professional specializing in selling to Enterprise accounts (Pharma, Real Estate, CPG, Retail etc). You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about communicating its value to Customers and System Integrators. Always seeking new opportunities, you will close new accounts while maintaining existing ones. Along with the chance to close exciting deals and solve meaningful problems. The impact you will have: - Present a territory plan within the first 90 days - Meet with CIOs, IT executives, LOB executives, Program Managers, and other important partners - Close both new accounts and existing accounts - Identify and close quick, small wins while managing longer, complex sales cycles - Exceed activity, pipeline, and revenue targets - Track all customer details, including use case, purchase time frames, next steps, and forecasting in Salesforce - Use a solution-based approach to selling and creating value for customers - Promote Databricks' enterprise cloud data platform powered by Apache Spark - Ensure 100% satisfaction among all customers - Prioritize opportunities and apply appropriate resources What we look for: - Field sales experience within big data and Cloud - Prior customer relationships with CIOs, program managers, and essential decision makers - Simply articulate intricate cloud technologies - 7+ years of Enterprise Sales experience exceeding

Senior ML Ops Engineer 9 Locations posted: Posted Today

Senior Applied Scientist, FinAuto Bengaluru, Karnataka, IND Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon's customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for FinAuto. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon's historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish

Power and Performance Design Engineer 2 Locations posted: Posted 14 Days Ago

Big Data Engineer III Chennai, Tamil Nadu, IND Amazon's Profit Intelligence is seeking a talented Big Data Engineer to join the Profit Intelligence team. We develop software solutions that are revolutionizing Amazon business intelligence through advanced algorithms running on big data technologies. The ideal candidate thrives in a fast-paced environment and relishes working with petabytes of extremely complex and dynamic data. In this role you will be part of a team of high caliber data and software engineers to build data pipelines using big data technologies such as Apache Spark, Hive/Hadoop, and distributed query engines. You should be passionate about working with big data and have the aptitude to incorporate new technologies and evaluate them critically. You must possess excellent business and communication skills and be able to work with business owners to analyze requirements and build solutions. You are a self-starter, has a proven track record of dealing with ambiguity and working in a fast-paced, highly dynamic environment. Working experience of any one of the programming languages such as Java, C#, Scala, etc. is a big plus. Key job responsibilities Interface with PMs, business customers, and software developers to understand requirements and implement solutions Collaborate with both Retail Finance and central FP&A teams to understand the interdependence and deliverables Design, develop, and operate highly-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms with AWS technologies Recognize and adopt best practices in data processing, reporting, and analysis: data integrity, test design, analysis, validation, and documentation Keep up

Senior Applied Scientist, Sponsored Products and Brands Seattle, Washington, USA The Sponsored Products and Brands team at Amazon Ads is re-imagining the advertising landscape through industry leading generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising! The Amazon Sponsored Products and Brands is looking for a talented Sr. Applied Scientist to join the Global Optimization science team at the forefront of advertising technology innovation. We are working backwards from emerging markets to reimagine Amazon's advertising stack from the ground up, leveraging multilingual and multi-modal GenAI technologies - including semantic hash designs, LLMs, and more - to deliver solutions that scale to non-US marketplaces from day one. This is your opportunity to be part of a small, high-impact team that prototypes, invents, and ships state-of-the-art solutions that will define the future of digital advertising. The ideal candidate combines entrepreneurial drive with deep technical expertise, thriving in ambiguous, fast-moving environments where you define the path forward

Firmware Engineer

Senior Applied Scientist, Special Projects Seattle, Washington, USA Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company's Think Big leadership principle to the limits. If you're interested in innovating at scale to address big challenges in the world, this is the team for you. As a Senior Applied Scientist on our team, you will focus on building state-of-the-art ML models for healthcare. Our team rewards curiosity while maintaining a laser-focus in bringing products to market. Competitive candidates are responsive, flexible, and able to succeed within an open, collaborative, entrepreneurial, startup-like environment. At the forefront of both academic and applied research in this product area, you have the opportunity to work together with a diverse and talented team of scientists, engineers, and product managers and collaborate with other teams. This role offers a unique opportunity to work on projects that could fundamentally transform healthcare outcomes. Key job responsibilities In this role, you will: • Design and implement novel AI/ML solutions for complex healthcare challenges • Drive advancements in machine learning and data science • Balance theoretical knowledge with practical implementation • Work closely with customers and partners to understand their requirements • Navigate ambiguity and create clarity in early-stage product development • Collaborate with cross-functional teams while fostering innovation in a collaborative work environment to deliver impactful solutions • Establish best practices for ML experimentation, evaluation, development and deployment • Partner with leadership to define roadmap