Databricks jobs

Databricks Data Engineer Manassas, VA, US Company Details We started in early 2019 as a small group of technologists with a passion for making insurance better. Today we are working with a team of industry experts who run five different insurance brands and collectively control $1 billion in annual premiums. We believe in an idea and execution meritocracy. In other words, a place where the best ideas win and the people who deliver the most value get the most opportunities. As we grow our team, we are looking for inquisitive, entrepreneurial people who are excited to reimagine the insurance industry. Insurance is too complex. Help us make it better. Responsibilities This position requires on-site work Monday-Thursday at either our Manassas, VA or Chesterfield, MO location. The Databricks Data Engineer will help design, build, deploy, and maintain scalable and production grade data pipelines in modern cloud environments, enabling analytics, AI, ML, and decision advantage at scale. This role will work with cutting-edge tools like Databricks, Delta Lake, PySpark, and AI/BI genie to transform raw data into actionable insights. As a hands-on Databricks Data Engineer with deep expertise in Azure Databricks and MLOps, this role will have the opportunity to migrate and translate legacy SSIS ETL logic into scalable, cloud-native data pipelines in Databricks. This role will partner with data engineers, data scientists, and product manager to design features, train/evaluate models, and deploy them to production using MLflow, Dat

Senior Data Analytics Platform Engineer (Databricks) Hopkins, MN, United States Practical understanding and experience with Databricks Platform Administration and responsible for build/test/deploy automation for managing workspaces, compute resources (clusters, serverless), and o...

Databricks Engineer and Architect Databricks Engineer and Architect

Databricks developer -Senior Associate-Data Analytics Managed Services - Operate Bangalore, India Join our team as a Senior Data Engineer and drive impactful data solutions using Databricks, AWS, and Spark. Design and optimize scalable ETL pipelines, collaborate with cross-functional teams, and ensure data quality and security. Grow your expertise in a dynamic environment focused on innovation and continuous improvement.

Staff Data Scientist San Francisco, California P-57 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best Data Intelligence Platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. As a Data Scientist on the Data Team, you will help build a data-driven culture within Databricks by helping solve product and business challenges. The Data team also functions as an in-house, production "customer" that

Data Engineer- Azure Databricks- Senior Associate Bangalore, India Join our team as a Senior Data Engineer - Azure Databricks and drive innovative cloud data solutions. Leverage your expertise in Azure Databricks, Hadoop, and Spark to design robust data pipelines and enable business insights. Collaborate with cross-functional teams and mentor junior engineers in a dynamic, growth-focused environment.

Data Engineering- Azure Databricks- Manager Bangalore, India Join our team as a Manager, Data Engineering (Azure & Databricks) and lead the design and delivery of enterprise-grade cloud data solutions. Drive innovation, mentor teams, and manage complex data migration projects using the Azure Databricks stack. Shape the future of data engineering at PwC and make a significant impact on business growth.

Sr. Product Manager, Databricks Repos San Francisco, California RDQ427R130 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. More about the team: A great platform needs an exceptional developer experience. Databricks Repos is the source control and workflow foundation that powers how data engineers, ML engineers, and analysts manage code, collaborate with teammates, and ship data and AI applications to production. The Repos team builds the version control experience inside Databricks and defines how users connect their Git providers, manage code changes, track lineage, review pull requests, and promote code into jobs, pipelines, and deployments. We are responsible for creating a simple, reliable, AI native workflow that blends the best of Git style development with the unique needs of data and AI teams. Our mission is to provide a smooth authoring to production journey across notebooks, SQL, Python, and Lakeflow, all in a unified platform. You will drive the vision and roadmap for Databricks Repos and define how developers

Databricks Manager Location not specified

Software Engineer - Distributed Data Systems Belgrade, Serbia P-1414 At Databricks, we are passionate about helping data teams solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers, Databricks has started a multi-year journey to build the best Data Intelligence Platform. For this we are building on top of a great foundation but our goal is to go further to build dramatically better products. From the Storage Engine (data layout, encryption, caching, ...) to the Query Engine (Vectorization, Query Optimization, …), we want to revisit every component to provide our customers with the fastest, easiest to use and most secure data platform for all their data workloads. As a software engineer, you will join as a founding member of the not only the Belgrade site, but really as a founding team for our multi-year journey to achieve our Lakehouse vision. You will be involved in the entire development cycle and exemplify all core Databricks values (own-it, data decide, teamwork, customer-obsessed). The responsibilities you will have : - Drive requirements clarity and design decisions for ambiguous problems - Produce technical design documents and project plans - Develop new features - Mentor more junior engineers - Test and rollout to production, monitoring. What we look for: - BS in Computer

Lead Consultant - Databricks Data Engineering Job Description Today, the corporate landscape is dynamic and the world ahead is full of possibilities! None of the amazing things we do at Infosys would be possible without an equally amazing culture, the environment where ideas can flourish and where you are empowered to move forward as far as your ideas will take you. At Infosys, we assure that your career will never stand still, we will inspire you to build what's next and we will navigate further together. Our journey of learnability, values and trusted relationships with our clients continue to be the cornerstones of our organization and these values are upheld only because of our people. Required Skills (Must Have) - Hands-on experience with Databricks (notebooks, clusters, jobs, Delta Lake). - Strong understanding of ETL/ELT processes . - Experience with Python or SQL . - Good understanding of cloud platforms (Azure, AWS, or GCP). - Knowledge of Delta Lake features (ACID transactions, time travel, schema evolution). - Familiarity with data warehousing concepts . - Ability to work with large datasets and optimize performance. - Strong debugging and problem‑solving skills. Preferred Skills (Good to Have) - Experience with streaming systems (Auto Loader, Structured Streaming). - Knowledge of CI/CD workflows (Git, DevOps pipelines). - Experience with orchestration tools (Azure Data Factory, n8n, etc.). - Understanding of lakehouse architecture. - Exposure to ML workflows or MLOps. Qualifications - 2-6 years of experience in data engineering or analytics. - Certifications in Databricks, Azure, AWS, or

Senior Software Engineer - Distributed Data Systems San Francisco, California P-59 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. Modern data analysis employs sophisticated methods such as machine learning that go well beyond the roll-up and drill-down capabilities of traditional SQL query engines. As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support diverse workloads ranging from ETL to data science. Below are some example projects: Apache Spark™ : Develop the de facto open source standard framework for big data. Data Plane Storage : Provide reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store. Delta Lake : A storage management system that combines the scale and cost-efficiency of

Azure Databricks - Senior manager Gurugram, India Join our team as a Senior Manager, Azure Databricks and lead the design and implementation of innovative data solutions. Drive project success, mentor high-performing teams, and deliver impactful results using Azure and Databricks. Shape the future of data engineering with PwC and make a significant impact on business growth.

Databricks Mosaic AI - Manager Bangalore, India Join our team as a Manager, Databricks AI and lead a talented group of data scientists and GenAI developers. Drive enterprise-grade AI solutions, mentor teams, and shape the future of AI technologies. If you excel in Python, Databricks, and leadership, this is your opportunity to make a significant impact.

Engineering Manager - Databricks SQL Control Plane Mountain View, California RDQ326R233 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Databricks SQL (DBSQL) is a serverless data warehouse on the Databricks Lakehouse Platform that lets you run all your SQL and BI applications at scale. The Databricks SQL Control Plane team builds scalable solutions for managing the multi-tenanted DB SQL service. This team creates and maintains services that allow customers to create a data warehouse, scale it within seconds, and run mission critical workloads at scale. The team is seeking an Engineering Manager to spearhead the development of a new service and architecture for the next generation of our product. The key responsibilities include: - Leading a team of talented software engineers to build the next-generation low-latency, multi-tenanted, cloud native data warehousing system - Growing the team by hiring strong engineering talent - Leading and participating in technical, product and design discussions relating to cloud native database systems - Managing and operating a highly available service in the cloud - Growing leaders on the team by providing coaching, mentorship and growth opportunities - Playing a key role in defining the product and engineering roadmap for the team - Partnering with

Databricks Developer Ashburn, VA posted: Posted 30+ Days Ago

Sr. Delivery Solutions Architect Bengaluru, India CSQ327R19 At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the the Databricks Data Intelligence Platform. As a Sr. Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering teams to accelerate the adoption and growth of the Databricks platform in your customers. You will also help ensure customer success by increasing focus and technical accountability to our most complex customers who need guidance to accelerate usage on Databricks workloads that they have already selected, helping them maximise the value they get of our platform and the return on investment. This is a hybrid technical and commercial role. It is commercial in the sense that you will drive growth in your assigned customers and use cases through leading your customers' stakeholders, building executive relationships, orchestration of other focused/specialized teams within Databricks, and creating and driving plans and strategies for Databricks colleagues to build upon. This is in parallel to being technical, with expectations being that you become the post-sale technical lead across all Databricks products. This requires you to use your skills and technical credibility to engage and communicate at all levels with an organisation. You will report directly to a DSA Manager within the Field Engineering organization. The impact you will have: - Engage with Solutions Architects to understand the full use case demand plan for prioritised customers - Lead

Azure Databricks + AI - Manager Bangalore, India Join our team as a Manager, Azure Databricks and AI, leading innovative data engineering projects using Azure Databricks and Spark. Mentor teams, drive business insights, and collaborate with clients to deliver scalable analytics solutions. Shape the future of data at PwC and make a significant impact in a dynamic, growth-focused environment.

Solutions Architect Toronto, Canada P-225 While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations in eastern Canada As a Solutions Architect at Databricks within the Field Engineering org you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth and business knowledge and can drive complex technology discussions which express the value of the Databricks platform throughout the sales lifecycle. In partnership with our Account Executives, you will engage with our customers' technical leads, including architects, engineers, and operations teams with the goal of establishing yourself as a trusted advisor to achieve tangible outcomes. You will work with teams across Databricks and our executive leadership to represent your customer's needs and build valuable customer engagements and report to the Field Engineering Manager. The impact you will have: - You will work with Sales and other essential partners to develop account strategies for your assigned accounts to grow their usage of the platform. - Establish the Databricks Lakehouse architecture as the standard data architecture for customers through excellent technical account planning. - You will build and present reference architectures and demo applications for prospects to help them understand how Databricks can be used to achieve their goals to land new users and use cases. - Capture the technical win by consulting on big data architectures, data engineering pipelines, and data science/machine learning projects; prove out the Databricks technology for strategic customer

Azure +Databricks- Senior Associate Bangalore, India Join our team as a Senior Azure Databricks Associate and drive business growth by designing and implementing robust data pipelines and solutions. Leverage your expertise in Azure, Databricks, and data engineering to deliver actionable insights and enable informed decision-making for diverse clients. Grow your career in a collaborative, innovative environment.

Sr. Program Manager, Data for Good Seattle, Washington RDQ427R179 Are you a mission-driven leader with a passion for how data and AI can play a meaningful role in addressing global challenges? Do you enjoy shaping narratives, building programs, and translating complex work into stories that inspire action? As the Lead for Databricks for Good, you will own Databricks' social impact initiative end to end. You will work closely with Databricks teams and with nonprofits, universities, and public-interest organizations to design and scale programs that apply data and AI to real-world challenges. You will set the vision for Databricks for Good and ensure it delivers real, lasting impact, while clearly articulating how that impact is created and why it matters. About Databricks for Good At Databricks, we believe data and AI can be a force for positive change. Databricks for Good exists to ensure our platform empowers organizations working on humanity's most pressing challenges, including responding to crises, advancing education, improving health outcomes, and accelerating climate action. This role is an opportunity to define and lead that mission and shape how Databricks shows up in the world through meaningful, real-world impact. What you'll do Your responsibilities will span program design and management, storytelling, and owning execution across Databricks and its partners. - Build and lead Databricks for Good from the ground up, defining its mission, success metrics, execution strategy, and long-term vision. - Design and run high-impact programs such as social impact partnerships, hackathons, student and university initiatives, and nonprofit enablement

Delivery Solutions Architect Vancouver, Canada REQ ID - CSQ427R11 Location: Vancouver, BC At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering teams to accelerate the adoption and growth of the Databricks platform in your customers. You will also help ensure customer success by increasing focus and technical accountability to our most complex customers who need guidance to accelerate usage on Databricks workloads that they have already selected, helping them maximise the value they get of our platform and the return on investment. This is a hybrid technical and commercial role. It is commercial in the sense that you will drive growth in your assigned customers and use cases through leading your customers' stakeholders, building executive relationships, orchestration of other focused/specialized teams within Databricks, and creating and driving plans and strategies for Databricks colleagues to build upon. This is in parallel to being technical, with expectations being that you become the post-sale technical lead across all Databricks products. This requires you to use your skills and technical credibility to engage and communicate at all levels with an organisation. You will report directly to a DSA Manager within the Field Engineering organization. The impact you will have: - Engage with Solutions Architects to understand the full use case demand plan for

Software Engineer - Database Engine Internals Belgrade, Serbia P-1414 Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse ( CIDR 2021 paper ), open platforms that unify data warehousing and advanced analytics. This new architecture will help address several major challenges, including data staleness, reliability, total cost of ownership, data lock-in, and limited use-case support. To achieve this vision, Databricks is building the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance. Yet we will retain the expressiveness and robustness of general purpose systems such as Apache Spark™ to support diverse workloads ranging from ETL to data science. You will be part of this multi-year journey. As part of this team, you will design these next-generation systems that leapfrog state-of-the-art within the following areas: - Query compilation and optimization - Distributed query execution and scheduling - Vectorized execution engine - Data security - Resource management - Transaction coordination - Efficient storage structures (encodings, indexes) - Automatic physical data optimization The responsibilities you will have: - Drive requirements clarity and design decisions for ambiguous problems - Produce technical design documents and project plans - Develop new features - Mentor more junior engineers - Test and rollout to production,

Staff Software Engineer - Distributed Data Systems San Francisco, California P-186 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. Modern data analysis employs sophisticated methods such as machine learning that go well beyond the roll-up and drill-down capabilities of traditional SQL query engines. As a software engineer on