Spark jobs

Energy Resource Manager Oslo, Oslo, NO

Sr. Engineer - Cloud SDET - Lightning (Hybrid) 2 Locations posted: Posted 4 Days Ago

Engineering Manager - Pipelines Engine Mountain View, California; San Francisco, California P-1110 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. We are the Lakeflow Engineering team, responsible for Databricks ETL product line: Jobs , Spark Declarative Pipelines , and Genie Code for Data Engineering . We run one of the world's biggest (if not the biggest) data engineering platforms - responsible for processing exabytes of data daily for tens of thousands of customers. We're seeking a dedicated Engineering Leader to spearhead the Pipelines Engine engineering team. The team is responsible for building next generation Runtime ETL features and ensuring that Lakeflow Pipelines has state of art performance for ETL workloads. You will also spearhead the Agentic Data Engineering infrastructure, by building the next generation engine to power agentic pipeline authoring, execution and maintenance. The main responsibilities include: - You will lead an engineering team building the next-generation ETL features for the Databricks Lakeflow platform. - You will oversee sustained recruitment of top-tier talent, and upskilling talent on the team. - You will build processes to implement product vision and strategy, according to organizational goals and priorities. - You will build software that is not just high quality but easy

Sr Software Dev Engineer WOTC State/Province/Region Quebec | City/Town Montréal Step Into the Multiverse: Your Next Adventure Starts Here At Wizards of the Coast , we harness the power of imagination and connection to create unforgettable experiences. We create entertainment that inspires creativity, sparks passion, forges friendships, and fosters communities around the globe. In every pursuit our mission is to inspire a lifetime love of games. Whether it's through the strategic depth of Magic: The Gathering® , the rich storytelling of Dungeons & Dragons® , or our AAA digital game studios, we build worlds that bring people together, spark creativity, and fuel adventure. As we continue to grow and explore new realms, we're seeking passionate, curious, and innovative minds to join the adventure. Step Into the Multiverse: Your Next Adventure Starts Here At Wizards of the Coast , we harness the power of imagination and connection to create unforgettable experiences. We create entertainment that inspires creativity, sparks passion, forges friendships, and fosters communities around the globe. In every pursuit our mission is to inspire a lifetime love of games. Whether it's through the strategic depth of Magic: The Gathering® , the rich storytelling of Dungeons & Dragons® , or our AAA digital game studios, we build worlds that bring people together, spark creativity, and fuel adventure. As we continue to grow and explore new realms, we're seeking passionate, curious, and innovative minds to join the adventure. What You'll Do: Expand our ability to develop and

Staff Process Engineer Fremont, California posted: Posted 7 Days Ago

MS Fabric & PBI - Senior Associate Bangalore, India Join our team as a Senior Associate, MS Fabric & Power BI, and drive cloud data engineering solutions using Azure, Databricks, and Spark. Collaborate with stakeholders, design robust data pipelines, and mentor others while working on innovative projects in a dynamic, agile environment. Grow your expertise in data engineering and analytics with us.

Staff Software Engineer - Distributed Data Systems San Francisco, California P-186 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. Modern data analysis employs sophisticated methods such as machine learning that go well beyond the roll-up and drill-down capabilities of traditional SQL query engines. As a software engineer on

BigData Quality Engineer HALIFAX, Nova Scotia, Canada Embrace the role of a Big Data Quality Engineer and play a key role in testing and automating data pipelines for finance and risk solutions. Leverage cutting-edge technologies like Spark, Databricks, and Python to ensure data quality and drive innovation in a dynamic, collaborative environment. Grow your expertise in big data and AI-driven quality engineering.

Staff Performance Engineer 6 Locations posted: Posted 30+ Days Ago

Data Engineer - Data Bricks Associate (AC Manila) Taguig City, Philippines Embrace the role of a Data Engineer - Databricks Associate and help design, build, and optimize scalable Databricks-based data solutions. Leverage your expertise in PySpark, Spark SQL, and cloud platforms to drive operational excellence and deliver impactful analytics in a dynamic, managed services environment.

Staff Data Engineer (Scala, Spark, & Gen AI) Los Angeles, CA DISQO is a leading provider of advertising intelligence, measuring brand and performance outcomes across every media channel to power data-driven marketing decisions. Trusted by 500+ of the world's largest brands and 150+ agency and media partners, and recognized by Inc., Deloitte, Ad Age, Digiday, Forbes, and Cynopsis, DISQO is redefining the power of measurement in advertising. Joining DISQO Nation means being part of a team that moves fast, thinks boldly, and is passionate about solving meaningful problems. Innovation isn't just something we talk about, it's how we operate. We challenge assumptions, embrace new ideas, and continuously push ourselves to build better solutions for our customers and each other. Our values guide how we work and win together. We believe in winning as one team, fostering a culture of collaboration, trust, and shared accountability. We pursue outsized impact by focusing on opportunities that drive meaningful results for our customers and our business. We champion the customer by putting their needs at the center of every decision and delivering solutions that create real value. And we are relentlessly all in, bringing energy, passion, and commitment to every challenge, every day. If you're energized by high-growth environments, motivated by innovation, and excited by the opportunity to do impactful work alongside talented, driven teammates, you'll feel right at home at DISQO. DISQO is a leading provider of advertising intelligence, measuring brand and performance outcomes across every media channel to power data-driven marketing decisions.

Data Engineering Python and Pyspark - Assistant Vice President CHENNAI, Tamil Nādu, India | PUNE, Mahārāshtra, India

Data Engineer- Azure Databricks- Senior Associate Bangalore, India Join our team as a Senior Data Engineer - Azure Databricks and drive innovative cloud data solutions. Leverage your expertise in Azure Databricks, Hadoop, and Spark to design robust data pipelines and enable business insights. Collaborate with cross-functional teams and mentor junior engineers in a dynamic, growth-focused environment.

Staff Engineer – Power Generation (Turbines) 2 Locations posted: Posted 8 Days Ago

Seasonal: Guest Advocate (Cashier), General Merchandise, Fulfillment, Food and Beverage, Front of Store Attendant (Cart Attendant), Style, Inbound (Stocking) (T2472) 1550 E Lincoln Way, Sparks,NV 89434-8989 posted: Posted 30+ Days Ago

Data Engineer (Python/Spark) Toronto, Ontario, Canada Who We Are Headquartered in New York City, Take-Two Interactive Software, Inc. is a leading developer, publisher, and marketer of interactive entertainment for consumers around the globe. We develop and publish products principally through Rockstar Games, 2K, and Zynga. Our strategy is to create hit entertainment experiences, delivered on every platform relevant to our audience through a variety of sound business models. Our pillars - creativity, innovation, and efficiency - guide us as we strive to create the highest quality, most captivating experiences for our consumers. The Company's common stock is publicly traded on NASDAQ under the symbol TTWO. For more corporate and product information please visit our website at http://www.take2games.com . While our offices (physical and virtual) are casual and inviting, we are deeply committed to our core tenets of creativity, innovation and efficiency, and individual and team development opportunities. Our industry and business are continually evolving and fast-paced, providing numerous opportunities to learn and hone your skills. We work hard, but we also like to have fun, and believe that we provide a great place to come to work each day to pursue your passions. The Challenge We are looking for a dynamic Data Engineer to join a team involved in designing, building, and maintaining reliable and scalable data solutions. The ideal candidate is a strong Python developer who has some experience in front-end technologies like JavaScript, CSS3 and/or HTML5. They are a self-starter, comfortable with ambiguity, able to think big (while

MTS Software Engineer, Data Platform Toronto, Ontario, Canada Join our team as a Senior Software Engineer, Data Platform, and help shape the future of global ecommerce. Design and build scalable distributed systems, work with cutting-edge technologies like Java, Spark, and Kafka, and collaborate with passionate engineers to deliver high-impact solutions powering analytics and ML at scale.

Sr. Staff Engineer, Mechanical Design San Jose, California posted: Posted 14 Days Ago

AI Engineer

Senior Data Scientist Mountain View, California; San Francisco, California At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. As a Data Scientist on the Data Team, you will help build a data-driven culture within Databricks by helping solve product and business challenges. The Data team also functions as a

Senior Data Engineer, Ads Data Platform Amsterdam, North Holland, Netherlands Join our team as a Senior Data Engineer and help shape the future of eBay's Ads Data Platform. Work with cutting-edge technologies like Java, Kotlin, and Spark to build scalable, real-time data solutions for millions of buyers and sellers. Collaborate with top talent and drive innovation in a dynamic, global ecommerce environment.

Customer Engineer Bangalore, India Customer Engineer

Associate Director, Principal Data Engineer TORONTO, Ontario, Canada Embrace the role of an Associate Director, Principal Data Engineer and lead the design and delivery of next-generation data engineering solutions on Databricks. Drive innovation in Spark-based pipelines, ML workflows, and Delta Lake architectures. Collaborate with top talent to power critical financial workflows and shape the future of data engineering at RBC Capital Markets.

Lakebase Sales Lead EMEA Munich, Germany SLSQ327R173 Databricks is seeking a Lakebase Sales Specialist to help customers modernize their operational data foundation with Databricks Lakebase , our fully-managed Postgres offering for intelligent applications . This high-impact role sits within the Lakebase Go-To-Market team and partners closely with regional Account Executives to drive adoption of Lakebase with platform, application, and data teams. Lakebase gives customers a unified, governed foundation for operational workloads and AI-native applications , helping them move away from a fragmented estate of point databases toward a modern, scalable, serverless Postgres service. If you want to be at the forefront of operational databases for AI and intelligent applications at one of the fastest-growing data and AI companies in the world, this is your opportunity. The impact you will have - Drive new Lakebase revenue by identifying, qualifying, and closing Lakebase opportunities within a defined territory, in partnership with regional Account Executives and the broader account team. - Lead with outcomes for key Lakebase personas - including platform teams and developers , data teams , and central IT - articulating how Lakebase helps them ship features faster, simplify operational data architectures, and improve governance and cost efficiency. - Sell the value of fully-managed Postgres for intelligent applications , positioning Lakebase as the optimal choice for operational workloads that power real-time, AI-driven experiences. - Run complex, multi-threaded sales cycles from discovery and value hypothesis through commercial negotiation and close, navigating executive, technical, and line-of-business stakeholders. - Orchestrate proof-of-value and POCs that