Spark jobs

Stack Data Analysis Engineer San Jose, California posted: Posted 17 Days Ago

Senior Designated Support Engineer Bengaluru, India P-1553 As a Senior Designated Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Databricks' largest and most strategic customers in the Digital Native Business (DNB) segment. In this customer-facing role, you will leverage your technical expertise in Apache Spark™ and other data technologies to triage and resolve complex product issues and unblock our customers' most critical technical challenges. The Impact You Will Have - Perform advanced Troubleshooting and Root Cause Analysis to resolve performance and reliability issues in Spark, SQL, Delta, Streaming, and Databricks runtime features using tools like Spark UI metrics, Mosaic AI Model Service, DAGs, and event logs. - Discover requirements for continuous monitoring to detect early performance issues working with R&D and NOC teams to optimize the DNB customer environments. - Build Rapid POCs, Test/Deploy/Monitor the solutions built by Databricks Engineering to address customer challenges and showcase advanced Spark/ML/AI runtime capabilities aligned with their business goals. - Develop comprehensive playbooks and maintain a knowledge base of common issues and solutions for Spark, ML, and AI workflows. - Train customer engineering and business teams on best practices in performance tuning, debugging, and effectively leveraging Databricks Features. - Pilot new best practices processes/ programs, champion process improvements, and collaborate with cross-functional teams to enhance the customer experience. - Advocate for customers in business review meetings and maintain close relationships as a trusted advisor and primary

Lead Talent & Organizational Development Consultant 2 Locations posted: Posted 8 Days Ago

Senior Staff Server and Storage Engineer Bangalore, Karnataka posted: Posted 9 Days Ago

Senior Staff Server and Storage engineer Bangalore, Karnataka posted: Posted 17 Days Ago

Product Manager, Revenue Growth (Dojo Sparks) Remote | San Francisco ClassDojo's goal is to give every child on Earth an education they love. We started by building a powerful network for communication. ClassDojo's flagship app is the #1 communication app connecting K-8 teachers, children, and families globally. Teachers use it to share what's happening throughout the day through photos, videos, and messages that make parents feel like they're there. It's actively used in over 95% of US schools, reaching over 50 million children in 180 countries, with a team of just around 250 people. We can achieve this impact because we hire for talent density. Our team comprises the most talented, entrepreneurial, and innovative teammates from around the world, with experience in education and top consumer internet training grounds, including Instagram, Lyft, Dropbox, Stripe, Airbnb, Y Combinator, and more. We're building a company where the most talented people want to work. We believe you'll do the best work of your life here-and you'll pioneer the future of education, too. ABOUT DOJO SPARKS Dojo Sparks is ClassDojo's learn-to-read product for kids, built on the science of reading. Sparks has crossed $1M in bookings and found early product-market fit-and now the challenge has shifted from "does this work?" to "how do we scale it to millions of kids?" Every year, millions of new families join ClassDojo with kids in reading ages, giving us an enormous top-of-funnel to convert. The product has meaningful room to improve across conversion, activation, and churn, and we're

Staff Data Scientist San Francisco, California P-57 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best Data Intelligence Platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. As a Data Scientist on the Data Team, you will help build a data-driven culture within Databricks by helping solve product and business challenges. The Data team also functions as an in-house, production "customer" that

Client Relationship Consultant 2 (Banker) - Spanish Springs Savemart (36hrs) Sparks, NV, United States At U.S. Bank, we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succe

Staff Engineer - NPI (Mechanical ) Office - Bangalore IT/BT Park posted: Posted 30+ Days Ago

Staff Application Engineer San Jose, California posted: Posted 30+ Days Ago

Principal Data Engineer Hyderabad, Telangāna, India Embrace the role of a Principal Data Engineer and lead the design and modernization of scalable data architectures. Drive technical strategy, collaborate with cross-functional teams, and champion data governance. If you excel in SQL, Spark, and distributed systems, this is your opportunity to make a significant impact at JustGiving.

Senior ML Engineer - Firefly Bucharest posted: Posted 30+ Days Ago

Signature Customer Success Account Manager - Arlington, VA SPARKS, Maryland, United States of America This position will support a territory including Arlington, VA, Silver Spring, MD, and Takoma Park, MD. Summary. The Signature Customer Success Account Manager will manage a high volume of smaller cus...

Applied AI Engineer

Engineering Managers Bangalore, India Join our team as a Senior Data Engineering Manager and lead the design and implementation of advanced cloud data solutions. Leverage your expertise in Azure, Hadoop, and Spark to drive impactful projects, mentor teams, and deliver innovative data engineering services. Shape the future of data-driven decision-making at PwC.

Staff Software Engineer - Database Engine Internals Mountain View, California P-188 Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse ( CIDR 2021 paper ), open platforms that unify data warehousing and advanced analytics. The new architecture will help address several major challenges, including data staleness, reliability, total cost of ownership, data lock-in, and limited use-case support. A critical part of realizing this vision is the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance, yet retain the expressiveness and of general purpose systems such as Apache Spark™ to support diverse workloads ranging from ETL to data science. As part of this team, you will be working in one or more of the following areas to design and implement these next gen systems that leapfrog state-of-the-art: - Query compilation and optimization - Distributed query execution and scheduling - Vectorized execution engine - Data security - Resource management - Transaction coordination - Efficient storage structures (encodings, indexes) - Automatic physical data optimization What we look for: - A passion for database systems, storage systems, distributed systems, language design, or performance optimization - Experience working towards a multi-year vision with incremental deliverables - Motivated by delivering customer value and

Staff ML Engineer, Fine Tuning - Slack 3 Locations posted: Posted 14 Days Ago

Staff Software Engineer - Lakehouse Toronto, Ontario, Canada Join our team as a Senior Staff Software Engineer - Lakehouse and help shape the future of our next-generation analytics platform. Leverage your expertise in Spark, Java, and distributed systems to optimize performance, reliability, and scalability. Collaborate with passionate engineers to drive innovation and make a real impact in a global ecommerce leader.

Engineer Sr/ Staff-Power 5 Locations posted: Posted 23 Days Ago

Production Associate Sparks, Nevada, United States of America Embrace the role of a Production Associate and help produce high-quality cupels for global mining and assay labs. No experience required-training provided! Operate equipment, ensure safety and quality, and support efficient production. If you're hands-on, safety-focused, and eager to learn, this is your opportunity to grow in a dynamic environment.

Data Architect (IFE DCC) Singapore, Singapore Embrace the role of a Data Architect and help design, build, and scale robust data platforms powering analytics, AI, and digital services. Leverage your expertise in ETL, Databricks, Spark, and cloud technologies to drive secure, scalable solutions. Collaborate with cross-functional teams and shape the future of data-driven decision-making at Thales in Singapore.

EMEA Change & Adoption Lead Paris Join Pigment: The AI Platform Redefining Business Planning Pigment is the AI-powered business planning and performance management platform built for agility and scale. We connect people, data, and processes in one intuitive, feature-rich solution, empowering every team-from Finance to HR-to build, adapt, and align strategic plans in real time. Founded in 2019, Pigment is one of the fastest-growing SaaS companies globally. Industry leaders like Unilever, Snowflake, Siemens, and DPD use Pigment daily to make more informed decisions and confidently navigate any scenario. With a team of 600+ across Paris, London, New York, Toronto, San Francisco and Austin, we've raised nearly $400M from top-tier investors and were named a Visionary in the 2024 Gartner® Magic Quadrant™ for Financial Planning Software. At Pigment, we take smart risks, celebrate bold ideas, and challenge the status quo-all while working as one team. If you're driven by innovation and ready to make an impact at scale, we'd love to hear from you. As part of the Success Advisory team at Pigment, you will work alongside account teams and implementation partners to support our most strategic enterprise clients across the EMEA region in driving successful EPM adoption. Your contribution spans two dimensions: delivering change management expertise on complex client engagements, and helping scale the change management practice across the broader customer-facing organization. You will bring structured methodology and senior-level credibility to multi-stakeholder transformation programs, operating with a high degree of autonomy while remaining closely integrated with the wider Success Advisory

Staff Engineer Mechanical Mumbai, Maharashtra posted: Posted 11 Days Ago

Senior Data Engineer - Halifax BEDFORD, Nova Scotia, Canada Join our team as a Senior Data Engineer in Halifax, where you'll design and optimize data architecture and engineering for global risk IT projects. Leverage your expertise in Java, Spark, and cloud technologies to drive innovation, lead teams, and deliver impactful solutions. Shape the future of data management in a dynamic, collaborative environment.