Spark jobs

Data Scientist Mexico, Mexico City About Us Nu was born in 2013 with the mission to fight complexity to empower people in their daily lives by reinventing financial services. We are one of the world's largest digital banking platforms, serving millions of customers across Brazil, Mexico, and Colombia. About the role We are seeking an enthusiastic and driven Data Scientist to join our Credit Strategy team. This role focuses on applying innovative machine learning methodologies to our risk model and developing causal machine learning approaches for the initial line assignment workflow. You will be responsible for - Translate business challenges into specific and well-designed machine learning solutions that meet business requirements; - Integrate and leverage external data sources to feed our models; - Ensure the team maintains a high level of technical excellence; - Contribute to a technical culture in the local team. - Bring expertise to the team to help design projects across the many areas involved in building machine learning products (training, deployment, data consistency, monitoring, governance, etc.) We are looking for a person who has - Strong coding skills Python/Scala or equivalent languages; - Experimental design skills; - Ability to interact and communicate effectively with business and engineering; - Good understanding of model development and deployment pipeline; - Experience with machine learning tools and libraries such as Scikit-learn, Mllib and etc; - Nice data handling skills, Spark Dataframes, or SQL proficiency is a plus; - English language proficiency. Local Benefits - Chance of earning equity at Nubank

Big Data Engineer United Kingdom-London

Strategic Enterprise Account Executive, Financial Services Boston, Massachusetts; Remote - New York SLSQ127R619 As a Strategic Enterprise Account Executive at Databricks, you are a strategic sales professional experienced in selling into Financial Services accounts. You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about communicating its value to Customers and System Integrators. Always looking for new opportunities, you will be asked to grow within existing accounts. Along with the chance to close an exciting deal, we also offer accelerators above 100% quota attainment. The impact you will have: - Meet with CIOs, IT executives, LOB executives, Program Managers, and other important partners - Close both new accounts and existing accounts - Identify and close quick, small wins while managing longer, complex sales cycles - Exceed activity, pipeline, and revenue targets - Track all customer details including use case, purchase time frames, next steps, and forecasting in Salesforce - Use a solution-based approach to selling and creating value for customers - Promote Databricks' enterprise cloud data platform powered by Apache Spark™ - Ensure 100% satisfaction among all customers - Prioritize opportunities and applying appropriate resources - Build a plan for success internally at Databricks and externally with your accounts What we look for: - You have previously worked in an early stage company and you know how to navigate and be successful - Field sales experience within big data,

Strategic Enterprise Account Executive, State and Local Sacramento, California; San Francisco, California SLSQ327R425 As a Strategic Enterprise Account Executive, State & Local at Databricks, you are a strategic sales professional experienced in selling into a dedicated set of public sector accounts. You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about communicating its value to Customers and System Integrators. Always looking for new opportunities, you will be asked to maintain and grow existing accounts. Along with the chance to close an exciting deal, we also offer accelerators above 100% quota attainment. The impact you will have: - Meet with CIOs, IT executives, LOB executives, Program Managers, and other important partners - Close both new accounts and existing accounts - Identify and close quick, small wins while managing longer, complex sales cycles - Exceed activity, pipeline, and revenue targets - Track all customer details including use case, purchase time frames, next steps, and forecasting in Salesforce - Use a solution-based approach to selling and creating value for customers - Promote Databricks' enterprise cloud data platform powered by Apache Spark™ - Ensure 100% satisfaction among all customers - Prioritize opportunities and applying appropriate resources - Build a plan for success internally at Databricks and externally with your accounts What we look for: - You have previously worked in an early stage company and you know how to navigate and be

Data Architecture Lead 12 Locations posted: Posted 4 Days Ago

EPM Presales Operations - Product Innovation Paris Join Pigment: The AI Platform Redefining Business Planning Pigment is the AI-powered business planning and performance management platform built for agility and scale. We connect people, data, and processes in one intuitive, feature-rich solution, empowering every team-from Finance to HR-to build, adapt, and align strategic plans in real time. Founded in 2019, Pigment is one of the fastest-growing SaaS companies globally. Industry leaders like Unilever, Snowflake, Siemens, and DPD use Pigment daily to make more informed decisions and confidently navigate any scenario. With a team of 500+ across Paris, London, New York, San Francisco, and Toronto, we've raised nearly $400M from top-tier investors and were named a Visionary in the 2024 Gartner® Magic Quadrant™ for Financial Planning Software. At Pigment, we take smart risks, celebrate bold ideas, and challenge the status quo-all while working as one team. If you're driven by innovation and ready to make an impact at scale, we'd love to hear from you. Join Pigment: The AI Platform Redefining Business Planning Pigment is the AI-powered business planning and performance management platform built for agility and scale. We connect people, data, and processes in one intuitive, feature-rich solution, empowering every team-from Finance to HR-to build, adapt, and align strategic plans in real time. Founded in 2019, Pigment is one of the fastest-growing SaaS companies globally. Industry leaders like Unilever, Snowflake, Siemens, and DPD use Pigment daily to make more informed decisions and confidently navigate any scenario. With a team of 500+

Software Development Engineer, AWS Athena Bellevue, Washington, USA Want to help make history in the world of big data and make it easy for customers to efficiently query and analyze petabytes and more of data? Come join the Amazon Athena team in AWS! We are developing innovative new capabilities from the ground up that will transform the way customers analyze their data while also giving them high performance, low costs, and exceptional ease-of-use. We are a small, entrepreneurial team that operates independently, but with access to some of the top engineers in our field across AWS. In this role, you will have the opportunity to collaborate with senior and principal engineers who are domain experts at AWS. You'll develop deep expertise in areas like distributed systems, query engines, open source applications, performance optimization, and operational excellence. You'll also have the opportunity to work with and contribute to the leading open source big data and analytic frameworks like Hive, Spark, and Presto. You will enjoy competitive compensation and your contributions in this role will impact customers and businesses around the world. Key job responsibilities You'll be responsible for designing, developing, testing and deploying some of our most strategic technical projects. You'll deliver large-scale, high performance production systems, design new software systems of distributed technology, and have a significant bottom-line impact on our business results. You will draw from your deep and broad technical expertise to mentor engineers, complete hands-on technical work and provide leadership on complex technical issues. Internal job description

Member of Technical Staff New York, NY About Us: At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We've been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We're an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI. Job Duties: Design, develop, and maintain large-scale backend and cloud-native infrastructure to support distributed machine learning training, inference, and data processing pipelines for generative AI platform. Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and data processing pipelines. Lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems. Design and implement core backend services with a focus on efficiency and low latency. Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, and network performance. Collaborate with machine learning, DevOps, and product teams to translate research and product requirements into robust infrastructure solutions. Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability. Own end-to-end systems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence. Minimum Education & Experience Required : Bachelor's degree or equivalent in Computer Science or related field

Cloud Engineer Cloud Engineer

Staff Software Engineer - Money Team Bellevue, Washington Staff Software Engineer - Money Team P-940 At Databricks, we are obsessed with Data + AI to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has grown from a tiny corner office in Berkeley, CA to a global organization with over 6500 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest-growing SaaS companies in the world. The Money team's mission at Databricks is to maximize the value that our customers derive from their investments in data projects. We accomplish this through innovative commercialization strategies and cutting-edge engineering. Our team ensures timely, accurate, and customizable billing and usage data, alongside budgeting, forecasting, and cost optimization tools. We provide a seamless and consistent billing experience for all our customers, whether they are large enterprises or individual developers, across different pricing plans and cloud providers (AWS, GCP & Azure). As a software engineer on the Money team, you will be closely involved in the entire billing process, including usage ingestion, metering, pricing, credits, promotions, payments, usage reporting, and cost center and budgeting. Your role is crucial in democratizing data by bringing Databricks products to market. By collaborating

Resource Analyst, Forecasting & Capacity Planning Vilnius, Lithuania posted: Posted 10 Days Ago

Enterprise Account Executive, Federal Financials Remote - Washington D.C. SLSQ327R413 While candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered. As an Enterprise Account Executive, Federal Financials, at Databricks, you will be responsible for driving sales of Databricks within a dedicated set of consuming accounts in the Public Sector segment. As an experienced Account Executive, you know how to sell innovation and change through customer vision expansion and can drive deals forward to compress decision cycles. You love understanding a product in depth and are passionate about communicating its value to Public Sector clients. Always looking for new opportunities, you will be expected to net new accounts and expand current footprints. Along with the chance to close an exciting deal, we also offer accelerators above 100% quota attainment. The impact you will have: - Manage complex sales-cycles and present to C-level executives. - Close net new logos and expand existing accounts. - Identify and close quick, small wins while managing longer, complex sales cycles. - Exceed activity, pipeline, and revenue targets. - Track all customer details including use case, purchase time frames, next steps, and forecasting in Salesforce. - Use a solution-based approach to selling and creating value for customers. - Promote Databricks; enterprise cloud data platform powered by Apache Spark. - Ensure 100% satisfaction among all customers. - Prioritize opportunities and applying appropriate resources. - Build a plan for success internally at Databricks and externally with your accounts. What we look

Senior Applied Scientist, Translation Services Hyderabad, Telangana, IND Have you ever wondered how Amazon launches and maintains a consistent customer experience across hundreds of countries and languages it serves its customers? Are you passionate about data and mathematics, and hope to impact the experience of millions of customers? Are you obsessed with designing simple algorithmic solutions to very challenging problems? If so, we look forward to hearing from you! At Amazon, we strive to be Earth's most customer-centric company, where both internal and external customers can find and discover anything they want in their own language of preference. Our Translations Services (TS) team plays a pivotal role in expanding the reach of our marketplace worldwide and enables thousands of developers and other stakeholders (Product Managers, Program Managers, Linguists) in developing locale specific solutions. Amazon Translations Services (TS) is seeking a Senior Applied Scientist to be based in our Hyderabad office. As a key member of the Science and Engineering team of TS, this person will be responsible for designing algorithmic solutions based on data and mathematics for translating billions of words annually across 130+ and expanding set of locales. The successful applicant will ensure that there is minimal human touch involved in any language translation and accurate translated text is available to our worldwide customers in a streamlined and optimized manner. With access to vast amounts of data, technology, and a diverse community of talented individuals, you will have the opportunity to make a meaningful impact on the way customers

Lakebase Sales Specialist United States Lakebase Sales Specialist Databricks is seeking a Lakebase Sales Specialist to help customers modernize their operational data foundation with Databricks Lakebase , our fully-managed Postgres offering for intelligent applications . This high-impact role sits within the Lakebase Go-To-Market team and partners closely with regional Account Executives to drive adoption of Lakebase with platform, application, and data teams. Lakebase gives customers a unified, governed foundation for operational workloads and AI-native applications , helping them move away from a fragmented estate of point databases toward a modern, scalable, serverless Postgres service. If you want to be at the forefront of operational databases for AI and intelligent applications at one of the fastest-growing data and AI companies in the world, this is your opportunity. The impact you will have - Drive new Lakebase revenue by identifying, qualifying, and driving Lakebase activations and consumption within a defined territory, in partnership with regional Account Executives and the broader account team. - Lead with outcomes for key Lakebase personas - including platform teams and developers , data teams , and central IT - articulating how Lakebase helps them ship features faster, simplify operational data architectures, and improve governance and cost efficiency. - Sell the value of fully-managed Postgres for intelligent applications , positioning Lakebase as the optimal choice for operational workloads that power real-time, AI-driven experiences. - Run complex, multi-threaded sales cycles from discovery and value hypothesis through commercial negotiation and close, navigating executive, technical, and line-of-business stakeholders. - Orchestrate proof-of-value

Senior Java PySpark Developer – Assistant Vice President PUNE, Mahārāshtra, India

Solutions Architect Greenfield (New Logo) Mid Market France France FEQ327R195 The location for the role should be in the Paris region (i.e. within a commutable distance for a hybrid schedule). At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data & Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team who values innovation and creativity, using your skills to create customised solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! The impact you will have: - Form successful relationships with Greenfield (New Logo) clients within the SMB market in France, providing technical and business value to Databricks customers in collaboration with Account Executives. - Operate as an expert in big data analytics to excite customers about Databricks. You will develop into a 'champion' and trusted advisor on multiple issues of architecture, design, and implementation

Senior Linux System Engineer - ACS Seattle, United States of America Build and solve Linux production systems at scale. Multi-datacenter deployment and supporting a large-scale Linux environment with heterogeneous hardware. Build automation tools and scripts using Bash, Python, Go, etc. Design and support orchestration pipeline using Ansible and Puppet. Familiarity with Hadoop and its ecosystem Hive, Pig, Spark, HDFS, HBase, Oozie, Zookeeper, etc will be useful in this role. Fix and address issues with UNIX and TCP/IP network stack components. Design and support Linux systems (RedHat/OEL/CentOS etc) including automated OS installation, Linux certification, compile and validate various kernels, package management, OS lifecycle management, diagnostic, and performance troubleshooting/profiling. - This is Senior Linux system Engineer position with dedicated focus on E2E system validation - Build, Automate and support critical infrastructure supporting applications used across multiple teams - Run different automation pipelines in the large ecosystem, including provision, orchestration, and monitoring on Linux baremetal and Linux Virtual Machines - Collaborate across teams to run workloads and analyze/debug data - Evolve and modify the Analytics Platform based on requirements - Write code, tests, documentation, participate in code reviews

Senior Talent Advisor Senior Talent Advisor

Senior Analyst - Financial Reporting Bangalore, Karnataka posted: Posted 30+ Days Ago

Sr. Solutions Engineer Italy Remote - Italy At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team who values innovation and creativity, using your skills to create customized solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! The impact you will have: - Form successful relationships with clients throughout your assigned territory to provide technical and business value in collaboration with an Account Executive and the other cross-functional teams. - Gain excitement from clients about Databricks through hands-on evaluation and Spark programming, integrating with the wider cloud ecosystem and 3rd party applications. - Contribute to building the Databricks technical through engagement at workshops, seminars, and meet-ups. - Become a Big Data Analytics advisor on aspects of architecture and design. - Support your customers by authoring

CLOUD MACHINE LEARNING ENGINEER Pune, Maharashtra, India

Senior Scientist, Data Science - Hybrid Country US Please note that the following enhanced screening and interview requirements apply to this role: Virtual backgrounds or headphones / earbuds are not permitted during web-based interviews. Additionally, a minimum of one onsite, in person interview will be required as part of the application process. By choosing to apply, you acknowledge and agree to these requirements. What you'll need to succeed as a Senior Scientist, Data Science at XPO Minimum qualifications: Bachelor's degree or equivalent related work or military experience 2 years of experience in data science, operations research, or data analysis with a focus on AI-driven analytics, statistical modeling, machine learning, forecasting, or optimization Experience in at least one programming language such as Python, R, SQL, SAS, Spark, Java, etc., with practical applications in AI or ML projects Familiarity with AI techniques and machine learning algorithms, including supervised and unsupervised learning Strong communication skills with a knack for translating complex AI concepts into clear business insights Preferred qualifications: Bachelor's degree in Computer Science, Statistics, Mathematics, Engineering, Economics, or any related quantitative discipline A Master's or PhD in Computer Science, AI, Data Science, or a related quantitative field years of hands-on experience in developing and deploying optimization solutions 5+ years' experience in pricing optimization, demand forecasting, utilizing statistical modeling, m

Data Center Technician, AWS Data Center team Sparks, Nevada, USA Join our dynamic AWS team and become a critical guardian of global cloud infrastructure! You'll play a pivotal role in maintaining the heartbeat of the world's most innovative technology platform, ensuring seamless data center operations that power millions of businesses and services worldwide. Data Center Technicians should be willing to work both independently and with a team. Work prioritization, organizational skills, effective communication, and the ability to react quickly are critical to success. In addition to hardware and network repair, candidates will install equipment, create documentation, innovate solutions, and fix problems within the data center space. This team works in an environment that operates 24/7. Traveling within and outside of the regional work area is required. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly

AI Engineer New York | Hybrid | Remote ABOUT CINDER Cinder provides a cutting-edge platform to protect the internet. Cinder safeguards the interaction layer: the front end of products that users engage - and sometimes abuse. Our AI agents, integrated workflow platform, and deep expertise power real-time integrity at the speed of innovation. We support some of the most important and innovative companies in the world, including OpenAI, Midjourney, and ElevenLabs. Cinder is backed by Accel and Y Combinator. We care deeply about being relentless, intentional, and empathetic. We hire gritty thinkers who set ego aside, aggressively solve customer problems, and get better every day. We're building an enterprise-grade platform to make the internet safer and we need highly curious, hard-working self-starters. Cinder is seeking an AI/ML engineer to architect and deploy production AI systems at scale. You'll contribute to the strategic vision for machine learning and AI at Cinder, collaborating with data and software engineers to build world-class AI capabilities that directly impact our product and business outcomes. We're looking for an engineer first - someone who builds, ships, and maintains production systems rather than writing papers. If you've taken ML models from experimentation to production at scale, navigated the messy realities of real-world data, and understand that robust infrastructure matters as much as model performance, we want to talk. WHAT YOU'LL DO: - Own the complete lifecycle of large language model implementation: from data preparation and fine-tuning through rigorous evaluation and production deployment. - Develop automated evaluation frameworks