Spark jobs

Software Engineer, Data Orchestration N/A Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career. About the team The Big Data Infrastructure operates the critical infrastructure that powers the batch data processing at Stripe. The team supports a variety of use cases, including Payment, Ledger, ML, Fraud Detection, Product Analytics, Regulatory Reporting, Financial Data Reconciliation, and externally facing products like Radar and Sigma. As an example of the scale, the team's systems serve hundreds of teams, thousands of workflows, 100,000+ task executions, O(billion) transformations, and moving terabytes of data processing over 1 GB/second every day. Our users inside Stripe include other engineering teams, Data Scientists, Sales and Operations, Finance, etc. Data Orchestration builds and operates the time-based and event-based orchestration infrastructure that powers and accelerates batch data pipelines. The team operates on a wide range of tech stacks including Airflow, Spark, SQL, Kafka, Flink, Hive MetaStore, Trino, Pinot, Python, Java, Scala, S3, and Iceberg. What you'll do As a Software Engineer on this team, you'll design and build infrastructure that powers batch data processing at Stripe. Responsibilities Design, build, and

Senior Software Engineer, Data Engineering Menlo Park, CA Join us in building the future of finance. Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you're ready to be at the epicenter of this historic cultural and financial shift, keep reading. About the team + role We are building an elite team, applying frontier technologies to the world's biggest financial problems. We're looking for bold thinkers. Sharp problem-solvers. Builders who are wired to make an impact. Robinhood isn't a place for complacency, it's where ambitious people do the best work of their careers. We're a high-performing, fast-moving team with ethics at the center of everything we do. Expectations are high, and so are the rewards. The Data Engineering team builds and maintains the foundational datasets that power decision-making across Robinhood. We design reliable, scalable data systems that support product analytics, growth strategy, financial reporting, experimentation, and machine learning. The team partners closely with Product, Engineering, Data Science, and Finance to ensure accurate, well-modeled data is available to teams across the company. Our work directly influences how Robinhood measures performance, improves customer experience, and scales its products. As a Senior Data Engineer, you will design, build, and evolve core datasets that track product performance and company-wide metrics. You will develop scalable data pipelines that ingest application events and database snapshots into our data lake, ensuring high

Senior AI/ML Engineer 2 Locations posted: Posted 30+ Days Ago

Engineering Operation Technician, AWS Data Center team Sparks, Nevada, USA Join our dynamic team and become a critical guardian of technological infrastructure! As a Data Center Engineering Technician, you'll play a pivotal role in maintaining the heartbeat of mission-critical technology infrastructure, ensuring seamless operations that power global digital experiences. Your expertise will directly contribute to maintaining an extraordinary 99.999% uptime, keeping the digital world running smoothly and efficiently. Engineering Technicians are Amazon's front line when it comes to hands-on electrical and mechanical equipment troubleshooting. They will maintain, operate, and troubleshoot, Data Center Operation's Mission Critical Facilities, which includes stand-by diesel generators and related fuel systems, as well as three phase electrical systems such as: switch gear, UPSs, PDUs, wet cell batteries and associated systems, CRAC, centrifugal chillers, cooling towers/water chemical system, air handlers and associated systems, pumps, & motors. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to

System Test Engineer Lead - Sapphire 13 Locations posted: Posted 2 Days Ago

Workplace & Facilities Generalist Paris, France Know where you belong! Match Group is a leading provider of dating products across the globe. Our portfolio includes Tinder, Hinge, Match-Meetic, PlentyOfFish, Okcupid, The League, Archer, Salams and others, each designed to spark meaningful connections for singles worldwide. Creating a sense of belonging doesn't stop at our products - it's the foundation of every team we hire. Role overview : The PREWF (Protect, Real Estate, Events, Workplace & Facilities)PREWF Generalist, Paris & Ghent is responsible for the daily Workplace operations of the Paris and Ghent offices and for overseeing EMEA co-working locations. The role also contributes to facilities-related initiatives locally. The position ensures that workplaces remain functional, welcoming, compliant and operationally efficient. Working closely with the EMEA PREWF team, the PREWF Generalist coordinates vendors, supports building operations and contributes to continuous improvement initiatives within the Paris, Ghent, and EMEA co-working offices. How you'll make an impact : Know where you belong! Match Group is a leading provider of dating products across the globe. Our portfolio includes Tinder, Hinge, Match-Meetic, PlentyOfFish, Okcupid, The League, Archer, Salams and others, each designed to spark meaningful connections for singles worldwide. Creating a sense of belonging doesn't stop at our products - it's the foundation of every team we hire. Role overview : The PREWF (Protect, Real Estate, Events, Workplace & Facilities)PREWF Generalist, Paris & Ghent is responsible for the daily Workplace operations of the Paris and Ghent offices and for overseeing EMEA co-working locations. The role also

Senior Data Scientist San Francisco, CA Location: San Francisco, CA (Hybrid) What is Verse? Energy markets are more volatile than ever. Rapid electrification and the rise of AI are driving unprecedented demand for power, while energy costs continue to rise across the globe. For the world's largest energy buyers, managing energy has never been more complex or more critical. Verse helps these organizations manage complex power portfolios with confidence by unifying energy data, planning, forecasting, and operations in one tool. Our Energy Cost Intelligence platform, Aria, brings together energy, finance, and operations teams with real-time, finance-ready intelligence-replacing spreadsheets and consultants with precision across the entire energy lifecycle. Built by an expert team of energy buyers, data scientists, and engineers, Verse enables faster, smarter energy decisions that reduce risk and lower energy costs. The Role Verse is seeking a Senior Data Scientist to join our Data Science Team. In this role, you will lead the development and deployment of advanced data-driven solutions across a range of applications, including electricity markets, renewable procurement, and Behind-The-Meter (BTM) battery storage. You will play a critical role in shaping our modeling and analytical data layer, leveraging machine learning techniques, supporting optimization modeling infrastructure, and developing scalable approaches to power Verse's software offerings. This position emphasizes strong technical depth in Python, machine learning, and analytical modeling, along with the ability to independently scope and execute complex projects end-to-end. Experience in electricity markets and energy systems is preferred. Key Responsibilities Lead End-to-End Data Science Projects: Own and

Powerhouse Stationary Engineer – Electrician Indianapolis posted: Posted Today

Manufacturing Team Lead Fremont, California posted: Posted 15 Days Ago

Sr. Solutions Engineer - Public Sector (DoW - 4th Estate) Maryland; Virginia; Washington, D.C. FEQ327R1 While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. Sr. Solution Engineers at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science and machine learning. As a member of our team, you will exercise and develop expertise in those areas, using open-source projects such as Apache Spark™, MLflow, and Delta Lake. This is a customer-facing role, where you will work with customers, your teammates, the product team, and our post-sales teams, to identify use cases for Databricks, develop architectures and solutions using our platform, and guide customers through the implementation, to accomplish value. In that process, you will build relationships with our customers, find and build champions, and become a trusted advisor. You will report to the Sr. Field Engineering Manager for the team. The impact you will have: - Partner with the sales team to help customers understand how Databricks can help solve their business problems - Provide technical leadership for customers to evaluate and adopt Databricks - Consult on big data architecture, implement proof of concepts for strategic customer projects, data science and machine learning projects, and validate integrations with cloud services and other 3rd party applications - Build and present references architectures, how-tos, and demo applications for customers - Become an expert in, and promote Databricks

Senior Applied Scientist, Measurement, Ad Tech, and Data Science (MADS) Toronto, Ontario, CAN The Measurement, Ad Tech, and Data Science (MADS) team at Amazon Ads is at the forefront of developing innovative solutions that help tens of millions of advertisers understand the value of their ad spend while prioritizing customer privacy and measurement quality. The Media Planning Science team, part of broader MADS team, develops and implements models that deliver insights and recommendations for strategic media planning and measurement across Amazon Advertising's product portfolio. Our mission is to help advertisers create and execute plans that meet their objectives while providing accurate measurement tools. We work on a multitude of problem statements that encompass Reach and Frequency, Budget Planning Optimization, and Recommendations. Our models leverage both heuristic and machine learning approaches including deep learning techniques, with insights delivered through agent-based tools and APIs that integrate seamlessly into user interfaces and programmatic systems to ensure optimal advertising outcomes. As a Senior Applied Scientist on the team, you will be at the forefront of innovation, developing media planning solutions end-to-end from inception to production. You will set the technical vision and innovate on behalf of our customers. You will propose, design, analyze, and productionize models to provide novel measurement insights to our customers. You will partner with engineering to deploy these solutions into production. You will work with key stakeholders from various business teams to enable advertisers to act upon those metrics. Key job responsibilities * Lead the development of media planning models

Snowflake Data Engineer 2 Locations posted: Posted 30+ Days Ago

Senior Data Platform Architect DE-Germany-Remote, Remote, Germany, DE-Munich-MSO, DE-Berlin-Das Center At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Snowflake is about empowering enterprises to achieve their full potential - and people too. With a culture that's all in on impact, innovation, and collaboration, Snowflake is the sweet spot for building big, moving fast, and taking technology - and careers - to the next level. Our Solution Engineering organization is seeking a Senior Data Platform Architect (Specialist) to join our Applied Field Engineering team who can provide technical leadership in working with both technical and business executives in the design and architecture of the Snowflake Cloud Data Platform as a critical component of their enterprise data architecture and overall ecosystem. In this role you will work directly with the sales team to understand the needs of our customers, strategize on how to

Teamlead Account & Support Zeist, Utrecht, Nederland Whitelabels zijn de motor onder onze groei: meer dan 60% van onze platformomzet komt bij hen vandaan en dat aandeel groeit verder in de Benelux en Duitsland en wie weet daarbuiten. Voor het team dat hen elke dag bedient zoeken we een Team Lead die richting geeft, commerciële kansen ziet en zorgt dat afspraken structureel kloppen. Iemand die met inhoud, orde en eigenwaarde keuzes maakt en het team daarin meeneemt. Over Sparkles Sparkles is marktleider in Nederland en België op het gebied van gepersonaliseerde producten: geboortekaartjes, trouwkaarten en unieke cadeaus, just-in-time geleverd voor honderdduizenden klanten per jaar. We zetten technologie in om persoonlijke momenten echt bijzonder te maken. Naast onze eigen merken werken we samen met whitelabels: externe partners die onder hun eigen naam gepersonaliseerde producten aanbieden, en daarvoor gebruik maken van ons volledige platform - van technologie en personalisatie tot productie en levering. Sparkles neemt het volledige proces uit handen, terwijl de whitelabelpartner verantwoordelijk is voor design en marketing. Jouw rol Als Team Lead Account & Support stuur je een team aan van 4-5 collega's; account- sales- en supportspecialisten. Het team opereert los van onze domeinen en is het go-to-team voor de whitelabels voor alles wat met support, accountmanagement en business development te maken heeft. Je rapporteert aan Mariëtte (MD Platform & Technology). Er is intern draagvlak om verwachtingen scherper te maken en het team naar een hoger professioneel niveau te brengen. Je hebt een dubbele positie: bij Sparkles vertegenwoordig je het

Sr. Solutions Architect - AI Natives Business Remote - California; Remote - Oregon; Remote - Washington As a Solutions Architect on the AI native team supporting the Digital Natives business, you will shape the future of the big data landscape by working with the most sophisticated data engineering and data science teams in the world. Reporting to the Field Engineering Manager, you will collaborate with customers, product teams, and the broader customer-facing team to develop architectures and solutions using our platform and APIs. You will guide customers through the competitive landscape, best practices, and implementation, and develop technical champions along the way. The impact you will have: - You will partner with the sales team and provide technical leadership to help customers understand how Databricks can help solve their business problems. - Consult on Big Data architectures, implement proof of concepts for strategic projects, spanning data engineering, data science and machine learning, and SQL analysis workflows. As well as validating integrations with cloud services, home grown tools, and other 3rd party applications - Collaborate with your fellow Solutions Architects, using your skills to support each other and our users - Become an expert in, promote, and recruit contributors for Databricks inspired open-source projects (Spark, Delta Lake, and MLflow) across the developer community. What we look for: - 5+ years in a data engineering, data science, technical architecture, or similar pre-sales/consulting role - Experience building distributed data systems - Comfortable programming in and debugging Python and SQL - Have built solutions

Forward Deployed Strategist San Francisco | OnSite | New York ABOUT POETIC Poetic (formerly known as Forge) is creating the next layer of human-computer interaction - combining the intelligence of AI with the reliability of software. We automate the most complex manual processes for the world's largest enterprises using a new English programming language that blends structured control flow with natural language instructions. Processes that once took hours can now be completed in a fraction of the time at superhuman quality. Poetic is deployed globally, powering critical workflows for Fortune 500 companies with 98%+ quality across over half a million production runs. ABOUT THE ROLE As a Forward Deployed Strategist at Poetic, you will be on the front lines of a fundamental shift in how enterprises operate. You will own our most strategic customers (some of the largest companies in the world) to drive the adoption and expansion of automation that was previously impossible. These are not incremental improvements; you'll be orchestrating the rollout of solutions that replace entire workflows employing hundreds of people for decades. This role sits at the intersection of strategy, relationship management, and operational excellence. You'll navigate complex enterprise organizations, align stakeholders from operations teams to C-suite executives, and own deployments end-to-end - from initial pilot through global scale. You'll build deep, lasting relationships inside Fortune 500 organizations and drive the change management required to transform how they operate. We expect our Forward Deployed Strategists to operate with exceptional autonomy, thrive under ambiguity, and represent Poetic

Senior Applied Scientist, Alexa Ads Bengaluru, Karnataka, IND Alexa+ is the world's best Generative AI powered personal assistant / agent for consumers, and is becoming the conversational AI interface for Amazon services with the launch of Alexa for Shopping on Amazon.com and Amazon mobile app. At Alexa Ads, we are creating industry's first and most advanced Agentic Advertising products to drive Agentic Commerce. We are seeking an Applied Scientist to join our newly expanding team in India focused on Alexa Agentic/Conversational Ads and Personalization. In this role, you will build machine learning models that seamlessly and naturally integrate relevant advertising into the Alexa experience while deeply personalizing user interactions. You will work closely with other scientists, engineers, and product managers to take models from conception to production. Key job responsibilities Design, develop, and evaluate innovative deep learning and GenAI models for natural language processing (NLP), recommendation systems, and personalization. Conduct hands-on data analysis and build scalable ML pipelines. Design and run A/B experiments to measure the impact of new models on customer experience and ad performance. Collaborate with software development engineers to deploy models into high-scale, real-time production environments. About the team We are building a new science team in Bangalore to solve some of the most impactful problems in computational advertising. This isn't about tweaking existing models as we are rethinking how ads are ranked, priced, and personalized across voice-first and screen-first surfaces. These are problems that don't have textbook solutions. Key points to note about the team: 🧪

Data Center Engineer I Atlanta Data Center Engineer I

Data Center Services Manager İstanbul, Istanbul, Türkiye

Solutions Architect - Digital Native Business United States P-273 While candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. #LI-REMOTE As a Solutions Architect on the Digital Natives team, you will shape the future of the big data landscape by working with the most sophisticated data engineering and data science teams in the world. Reporting to the Field Engineering Manager, you will collaborate with customers, product teams, and the broader customer-facing team to develop architectures and solutions using our platform and APIs. You will guide customers through the competitive landscape, best practices, and implementation; and develop technical champions along the way. The impact you will have: - You will partner with the sales team and provide technical leadership to help customers understand how Databricks can help solve their business problems. - Consult on Big Data architectures, implement proof of concepts for strategic projects, spanning data engineering, data science and machine learning, and SQL analysis workflows. As well as validating integrations with cloud services, home grown tools, and other 3rd party applications - Collaborate with your fellow Solutions Architects, using your skills to support each other and our users - Become an expert in, promote, and recruit contributors for Databricks inspired open-source projects (Spark, Delta Lake, and MLflow) across the developer community. What we look for: - 5+ years in a data engineering, data science, technical architecture, or similar pre-sales/consulting role - Experience building distributed data systems - Comfortable programming in, and debugging,

Software Development Engineer II - Advertising, Amazon, Reporting API Toronto, Ontario, CAN Are you passionate about Big Data and Distributed Systems to build customer trust and grow new business? Interested in building new state-of-the-art products at Petabyte scale? Global advertisers rely on our team's performance insights to drive future investment in Amazon's Advertising Platform and improve the relevance of ads shown to customers. We're looking for strong Software Engineers that can build upon technologies such as Elasticsearch, Spark, Hive and Presto, as well as AWS services like Elastic Map Reduce (EMR), Redshift, Kinesis and DynamoDB to deliver next generation of our Reporting API platform. If this sounds interesting we'd love to hear from you! Amazon is investing heavily in building a world class advertising business and we are at the forefront of that explosive growth. We deliver campaign reporting for all of Amazon advertising and produce analytics and reporting data that are used by advertisers to grow their business every day. We process billions of ad impressions, clicks, and conversion events daily and we invent and evolve our event-driven architectures with AWS to manage the large scale of our data growth. As campaign reporting product owners, we are also breaking fresh ground to create world-class analytics products. We are highly motivated, collaborative and fun-loving with an entrepreneurial spirit and agile bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities. We start with the

Senior Data Engineer ESP Work-at-Home posted: Posted Yesterday

Sr. Applied Scientist, Private Brands Intelligence - SCIT Science Vancouver, British Columbia, CAN The Private Brands team is looking for a Sr. Applied Scientist to join the team in building science solutions at scale. Our team applies Optimization, Machine Learning, Statistics, Causal Inference, and Econometrics/Economics to derive actionable insights about the complex economy of Amazon's retail business and develop Statistical Models and Algorithms to drive strategic business decisions and improve operations. We are an interdisciplinary team of Scientists, Engineers, and Economists. Key job responsibilities You will work with business leaders, scientists, and economists to translate business and functional requirements into concrete deliverables, including the design, development, testing, and deployment of highly scalable optimization solutions and ML models. This is a unique, high visibility opportunity for someone who wants to have business impact, dive deep into large-scale problems, enable measurable actions on the consumer economy, and work closely with scientists and economists. As a Sr Scientist, you bring business and industry context to science and technology decisions. You set the standard for scientific excellence and make decisions that affect the way we build and integrate algorithms. Your solutions are exemplary in terms of algorithm design, clarity, model structure, efficiency, and extensibility. You tackle intrinsically hard problems, acquiring expertise as needed. You decompose complex problems into straightforward solutions. We are particularly interested in candidates with experience in Operations Research and predictive models and working with distributed systems. Academic and/or practical background in Operations Research, Machine Learning and Reinforcement Learning are particularly relevant

Sr. Engineer, Backend - Lightning (Hybrid) USA - Sunnyvale, CA posted: Posted 24 Days Ago