Databricks jobs

Java Spark Developer CHENNAI, Tamil Nādu, India

Solutions Architect (Lakebase) Melbourne, Australia; Sydney, Australia FEQ327R242 Mission The Solutions Architect (Lakebase) team executes on Databricks' strategic Product Operating Model that provides enhanced focus on earlier stage, highly prioritized product lines in order to establish product market fit, and set the course for rapid revenue growth. They are part of a global go-to-market team mandate, though individually will cover a specific, local region. Clients may span across one or more business units and verticals. By working in partnership with direct account teams, they will jointly engage clients, foster the necessary relationships, position in-depth the specific product line, so as to provide compelling reasons for clients to adopt and grow the usage of the given product. They understand the appropriate approach, the guardrails, and the steps needed to successfully adopt the product line, as clients deliver on their business objectives. The Solutions Architect (Lakebase) is paired with an Account Executive aligned to a given product line with specific targets accordingly. Together, they will devise and implement a strategy across their assigned set of accounts, develop presentations, demos and other assets and deliver them such that clients make an informed decision as they decide to adopt the product-line in a meaningful way. The Lakebase product-line requires the following core technical competencies: - 10+ years of transactional database (OLTP) expertise across engineering, product development, administration, and pre-sales, with a proven track record of designing and delivering client-facing solutions. - Credibility in influencing OLTP products with the market insight needed to shape and

Technology Lead Infosys is seeking an experienced Spark Scala Developer to design, develop, and optimize scalable bigdata solutions. The candidate will work on building high-performance batch and real-time data pipelines leveraging the Hadoop ecosystem and distributed computing frameworks(Spark). The role involves working closely with data engineers, architects, and business stakeholders to deliver robust, scalable, and efficient data processing systems. Required Qualifications: - Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time. - Candidate must be located within commuting distance of Mississauga, Ontario or be willing to relocate to the areas. - Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. - At least 4 years of Information Technology experience - 4+ years of experience in Big Data technologies. - Strong expertise in: - Apache Spark (Core, SQL, DataFrames, RDDs) - Scala programming - PySpark - Hands-on experience with: - Kafka (real-time streaming) - Hadoop ecosystem (HDFS, Hive, Impala) - NoSQL Databases (HBase, MongoDB, Couchbase) - Strong understanding of distributed computing concepts and data processing frameworks. - Experience in building ETL/data pipelines for large-scale datasets. - Proficiency in SQL and data modeling. Preferred Qualifications: - Hands-on experience with data lakes, data warehouses, and scalable ETL pipeline design, including batch and real-time processing architecture. - Strong understanding and practical exposure to Agile

Data Engineer Data Engineer

Manager, Field Engineering France Paris, France FEQ227R207 As a Field Engineering Manager, you will lead a talented team of technical pre-sales Solutions Architects and Solutions Engineers based in France. You'll play a key leadership role at the intersection of technology and business, helping our teams design value-based solutions and drive growth through effective collaboration with Sales. You'll coach your team to communicate complex ideas clearly, support strategic sales cycles, and build strong partnerships with customers and stakeholders across large organisations. The impact you will have: - Lead, mentor, and develop a high-performing pre-sales team in France. - Foster an inclusive and collaborative culture that reflects Databricks' values of customer obsession, teamwork, and diversity. - Partner with Sales to drive growth through solution- and value-based selling. - Enhance team effectiveness by establishing best practices that improve efficiency and focus on business impact. - Build trusted relationships with customer executives and strategic partners. - Collaborate across teams-including Marketing, Sales, and Services-to ensure seamless implementation and customer success. - Represent Databricks as part of the regional leadership team and contribute to building our brand and presence in the market. What we look for: - Proven experience managing technical teams in Big Data, Cloud, or SaaS environments. - A track record of leading, mentoring, and scaling pre-sales or technical field organisations. - Understanding of consumption-based business models. - Ability to collaborate effectively with Sales and other cross-functional leaders. - Strong communication and interpersonal skills-fluent in English and native-level French. - Technical background in Data

Data Engineer - R&D Data Catalyst Team India - Hyderabad posted: Posted 30+ Days Ago

Advisor - Data Architect, Data Foundry 5 Locations posted: Posted 8 Days Ago

AI Engineer - FDE (Forward Deployed Engineer) - U.S. Federal Sector Maryland; Virginia; Washington, D.C. PLEASE NOTE : Due to federal contract requirements and client site access obligations, U.S. citizenship and eligibility for a U.S. government secret clearance are required to access classified information. The position is based in the Washington, D.C., Maryland, or Virginia metropolitan area and includes periodic on‑site work and client collaboration. Candidates with an active Secret or higher clearance are strongly encouraged to apply. The AI Forward Deployed Engineering (AI FDE) team is a highly specialized customer-facing AI team at Databricks. We deliver professional services engagements to help our customers build and productionize first-of-its-kind AI applications. We work cross-functionally to shape long-term strategic priorities and initiatives alongside engineering, product, and developer relations, as well as support internal subject matter expert (SME) teams. We view our team as an ensemble: we look for individuals with strong, unique specializations to improve the overall strength of the team. This team is the right fit for you if you love working with customers, teammates, and fueling your curiosity for the latest trends in GenAI, LLMOps, and ML more broadly. This role can be remote. The impact you will have: - Develop cutting-edge GenAI solutions, incorporating the latest techniques from Databricks AI research to solve customer problems - Own production rollouts of consumer and internally facing GenAI applications - Serve as a trusted technical advisor to customers across a variety of domains - Present at conferences such as Data + AI

Principal Data Architect Spring, Texas, United States of America

Staff Engineer – Experimentation Team Remote - US About the Job: As a Staff Engineer on LaunchDarkly's Experimentation team, you'll build the platform that helps engineering teams make data-driven decisions with confidence. Our Experimentation product enables customers to run A/B tests, measure the impact of feature changes, and optimize experiences - integrated with a feature management platform that processes trillions of evaluations daily. This role sits at the intersection of data science and platform engineering. You'll design the statistical engine, warehouse-native analysis pipelines, and adaptive experimentation systems (including contextual bandits) that power our customers' most important decisions. We want someone who brings genuine depth in applied statistics and ML - as fluent in statistical validity as in system architecture. You'll also architect warehouse-agnostic features that run analysis directly inside customers' data warehouses (Snowflake, Databricks, Redshift, BigQuery) - modular computation layers that abstract across warehouse environments while maintaining statistical correctness. Deep technical experience, a scientific mindset, and the ability to influence product and technical direction are critical. You'll lead by example: setting the bar for rigor, mentoring teammates, and owning systems end to end, including on-call. Responsibilities: - Build the experimentation statistical engine - hypothesis testing, sequential analysis, variance reduction ( CUPED , Winsorization), power analysis. Ensure statistical correctness across all experiment types. - Design warehouse-native experimentation that runs analysis inside customer warehouses (Snowflake, Databricks, Redshift, BigQuery). Build modular, warehouse-agnostic abstractions for rapid new backend support. - Lead adaptive experimentation - contextual bandit systems, Bayesian optimization, automated allocation beyond simple A/B

Specialist Data Analytics India - Hyderabad posted: Posted Yesterday

DNASURE_ExxonMobil - Lead Azure Data Engineer - TL Mexico Lead Azure Data Engineer (Ingeniero líder de Datos Azure) Location: Mexico (Mexico City, Guadalajara, Monterrey) - Hybrid as per Infosys Mexico policy (CDT/EDT time) Role Overview As a Lead Azure Data Engineer , you will drive the architecture, design, and optimization of scalable data platforms and pipelines on Azure, while providing technical leadership and guidance to engineering teams. You will apply advanced expertise in SQL, Python, and Spark to build efficient ETL/ELT solutions, lead data modeling and performance tuning efforts, and ensure seamless integration with diverse data sources and BI tools. Additionally, you will establish and enforce data governance, security, and compliance standards, collaborate with stakeholders to translate business needs into robust solutions, and mentor team members to ensure high-quality delivery and alignment with enterprise data strategy. Key Responsibilities - Monitor and respond to alert emails regarding execution failures across all team tools-such as Databricks, Azure Data Factory, or data quality gap reports within our processes. - Proactively respond to user questions on team Zoom channels, capture issues in our processes, and implement necessary fixes. - Work extensively with Azure Cloud Services, Azure Data Factory, Databricks, Python, and Spark, snowflake including handling user requested break-ins such as issue investigation, missing data analysis and remediation of jobs or pipelines that did not run according to their pre-configured schedules. Basic Qualifications - Bachelor's degree or foreign equivalent in Computer Science or related field. - 8+ years of IT experience , including pipeline design,

Senior Manager Data Architecture and AI Dublin, Ireland posted: Posted Yesterday

GDB/ZE - Architect Data Products(M/F/D) Country / Location India Objective of the position Describe your Product Mission here / objective of the role. At our unit “Data Foundation - Big Data Management” we aim to offer organizations a robust and scalable solution for managing and deriving insights from vast quantities of data. By utilizing Azure's PaaS components, our platform streamlines the deployment and handling of Big Data workloads, empowering our clients to make data-driven decisions and propel business expansion. Our team is accountable for the creation and upkeep of the Big Data platform built on Azure PaaS components EDL (Enterprise Data Lake). We collaborate intensively with stakeholders to comprehend their needs and devise solutions that fulfill their expectations. The team is also in charge of guaranteeing the platform's scalability, dependability, and security, and for staying abreast with the newest technologies and trends in the big data domain About the Job: We are seeking a highly motivated and detail-oriented candidate who will be responsible for all data engineering aspects of the data product layer of our Enterprise Datalake, working with Azure and Databricks, maintaining/developing our framework and CI/CD pipelines and processes in an ambitious team. Main tasks Develop, extend and optimize the data product layer of our Enterprise Datalake with high code standards, tests and suitable documentation to meet both user and internal needs. Collaborate with the product owner and architect to understand data requirements and

Sr. Staff Security Assurance Engineer Mountain View, California; San Francisco, California RDQ326R106 While candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. As a Senior Staff Security Assurance Engineer within the Security Assurance Team, you will lead high-visibility security compliance implementation initiatives. Reporting directly to the Senior Director, you will serve as a strategic catalyst for these programs, ensuring seamless execution and alignment with Databricks' global security objectives. You will navigate a complex, cloud-native landscape, collaborating with Security, IT, Engineering, Internal Audit, Corporate Operations, and other teams, to assure successful completion of highly cross-functional projects that enable the growth of our business and safeguard of our customers. US Citizenship Required. The impact you will have: - Drive Project Outcomes: Adopt an ownership mindset to manage the end-to-end delivery of work required for new security certifications, expanding Databricks' reach across global markets. - Accelerate Execution: Act as a force multiplier by proactively identifying and neutralizing project blockers, reducing friction, and maintaining high velocity in a cloud-native environment. - Orchestrate Cross-Functional Decision Making: Navigate complex technical and compliance trade-offs, driving consensus across Engineering, IT, and Product teams to reach timely resolutions. - Optimize Delivery Methodologies: Continuously refine project frameworks to maximize effectiveness, ensuring that security initiatives are both rigorous and agile. - Precision Program Management: Masterfully oversee project lifecycles-including milestones, dependencies, and risk mitigation-while providing executive-level transparency through accurate status reporting. - Build Strategic Partnerships: Forge deep, collaborative relationships with Security Assurance Team subject

Sr. IT Site Reliability Software Engineer Costa Rica GAQ127R40 Team: IT Infrastructure and Operations About the Role At Databricks Information Technology, we are a product-led organization transforming how we work-from the ease of using our IT services to the applications we develop to scale seamlessly during rapid growth. As a Site Reliability Engineer (SRE) , you will bridge the gap between software engineering and systems architecture. You will be a core contributor to the IT Infrastructure team, owning the evolution of core infrastructure and observability platforms. This role requires a strong software engineering mindset and deep technical breadth to deliver high-quality, scalable solutions for "immature" system problems. Your focus will be on building resilient, automated infrastructure that empowers development teams and ensures our cloud environment is cost-optimized, secure, and highly available. The Impact You Will Have - Architect and Automate: Design and deploy production-grade infrastructure on cloud platforms (AWS/Azure) using Infrastructure as Code (IaC) tools like Terraform or Pulumi. - Reliability and Performance Engineering: Optimize system performance, architecture, and scaling to ensure maximum uptime and minimal latency for critical IT services. - CI/CD Excellence: Architect robust deployment pipelines (e.g., GitHub Actions), managing both hosted and self-hosted runners for specialized build requirements. - Observable by Default: Create underlying infrastructure to ensure new internal applications are secure and have logging, metrics and alerts enabled by default. - Agentic ToolingI: Build internal AI plugins, and automation scripts to streamline developer workflows and enhance operational efficiency. - Incident Response: Focus on subsequent data usage,

Associcate Data Engineer India - Hyderabad posted: Posted 14 Days Ago

Apprentice - Data Enablement Hadapsar, Pune, Maharashtra, IND, 411013

Sr. Software Engineer (Agentic Access) Columbus, OH Immuta is the Data Provisioning Company, helping organizations provision secure, governed data access at the speed modern business demands. We automate access by policy and by request-eliminating tickets, reducing risk, and enabling both humans and AI systems to work with data safely and instantly. Founded in 2015, Immuta is trusted by Fortune 500 companies and government agencies worldwide and operates as a hybrid workplace globally. • Technology partners include Snowflake, Databricks, AWS, Azure, Google Cloud, and Starburst. • Immuta has been recognized by Forbes as a top American startup employer, by Inc. Magazine and BuiltIn as one of the best workplaces, and by Fast Company as one of the top 50 most innovative companies. • $267 million in total funding. Lead investors include NightDragon, Snowflake, and Databricks, along with additional funding from ServiceNow, Citi Ventures, Dell Technologies Capital, DFJ Growth, IAG, Intel Capital, March Capital, Okta Ventures, StepStone, Ten Eleven Ventures, and Wipro Ventures. • A hybrid workplace with offices in Boston, MA; Columbus, Ohio; College Park, Maryland. ABOUT OUR TEAM At Immuta, we're on a mission to make data secure, accessible, and trusted for every organization. Our Engineering Team builds the technologies that power this mission - enabling global enterprises to automate data access control, privacy enforcement, and policy management across modern cloud ecosystems. YOUR ROLE As a Senior Software Engineer on the Agentic Access team, you'll play a key role in designing, building, and evolving the AI systems that underpin Immuta's

Data Architect USA Work at Home posted: Posted 2 Days Ago

MS Fabric & PBI - Senior Associate Bangalore, India We are looking for a Senior Associate to join our Advisory Acceleration Centre at PwC. This role involves implementing cloud data engineering solutions using Azure, Databricks, and SQL. If you have a strong background in data management and a passion for innovative solutions, we want to hear from you!

Data Architect Ashburn, VA, US posted: Posted 30+ Days Ago

Data Engineer India - Hyderabad posted: Posted Today

Sr. Contracts Negotiator - Healthcare & Life Sciences Bellevue, Washington; Chicago, Illinois; Denver, Colorado; Mountain View, California; San Francisco, California; Seattle, Washington; Washington, D.C. GAQ127R55 Location: This position will be based in Seattle, Bellevue, Denver, or Chicago. This will be a hybrid role with in-office expectations. About the Role: Databricks is seeking a Sr. Contracts Negotiator to support our growing Healthcare and Life Sciences (HLS) commercial business. Reporting to the Director, Assistant General Counsel, you will negotiate and close complex commercial transactions with HLS customers, including Master Cloud Services Agreements (MCSAs), Business Associate Agreements (BAAs), Data Privacy Agreements, NDAs, Statements of Work, and Order Forms, often addressing topics such as data privacy, information security, intellectual property, and emerging technologies, including AI. This role is ideal for someone who loves commercial transactions, excels at navigating complex contract issues, and takes pride in helping close strategic, high-impact deals that move the business forward in a fast-paced, collaborative environment. What You Will Do - Negotiate, draft, and close commercial agreements (including MCSAs, Order Forms, and BAAs) with HLS customers, ensuring compliance with company policies, data privacy, information security, and applicable healthcare regulations. - Support assigned Attorneys on complex or strategic transactions and assist in driving deal execution for key accounts. - Partner with Sales, Finance, Product, and Compliance teams to facilitate revenue-generating transactions while managing legal and commercial risk. - Triage and manage incoming contracting requests using Databricks' contract lifecycle management (CLM) tools, ensuring timely review, accurate routing, and collaboration with cross-functional stakeholders