Spark jobs

Senior Software Engineer - Data Platform (Spark & Trino) Canada, BC, Vancouver posted: Posted 2 Days Ago

Senior Software Engineer, Managed Spark, Open Source Sunnyvale, CA, USA Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Cloud Dataproc enables open source data analytics users (e.g., Apache Hadoop, Spark, Flink, Trino, etc.) to modernize their Open-Source BigData Analytics workloads in the cloud. Dedicated to meeting customers where they are, Dataproc enables users to quickly provision and manage clusters and workloads. Google Cloud accelerates every organization's ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. Individual pay is

Senior Software Engineer, Managed Spark, OpenSource Sunnyvale, CA, USA Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Google Cloud accelerates every organization's ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $253000 (USD) + 15% bonus target + bonus + equity + benefits Learn more about benefits at Google . Build customer-facing features for Managed Service for Apache Spark (formerly Dataproc)

Software Engineer, Managed Service for Apache Spark Kirkland, WA, USA Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Managed Service for Apache Spark enables open source data analytics users (Apache Hadoop, Spark, Presto, Flink, etc.) to lift and modernize their workloads into the cloud. It is a fast, easy-to-use, fully managed cloud service for running Apache Spark, Apache Hadoop and dozens of other OSS softwares in a simpler, performant and cost-efficient way. Operations that take hours or days now complete in seconds or minutes, and the customer pays only for the resources they use (with per-second billing). Managed Service for Apache Spark also easily integrates with other Google Cloud Platform (GCP) services like BigQuery, Dataplex (governance, lineage), Catalogs/Meta stores to

Senior Software Development Engineer - Big Data and Spark Bucharest posted: Posted 30+ Days Ago

Software Engineer Lead - Data Product Organization (Cloudera Hadoop, Neo4j, Spark/PySpark) 6 Locations posted: Posted 3 Days Ago

Sales Intern (Paid) Sparks, NV, USA posted: Posted 30+ Days Ago

Service Center Supervisor Sparks posted: Posted 29 Days Ago

Lube Tech Sparks, NV, USA posted: Posted 9 Days Ago

Maintenance Technician (Mechanic) Country / Location United States Now hiring! Maintenance Technician (Mechanic) Sparks, GA We are looking for a Maintenance Technician to join our Agricultural Solutions team in Sparks, GA Come create chemistry with us! BASF's Agricultural Solutions division connects innovation, customers, partners and agricultural experts and integrates sustainability criteria into all business decisions. We help farmers deliver the best possible outcomes, working to achieve the balance between economic, environmental, and social value creation for sustainable and efficient agriculture. BASF's Crop Protection Site in Sparks, Georgia is seeking a Maintenance Technician who has mechanical aptitude, training, and the skills necessary to perform maintenance function on various plant infrastructures. The candidate will report to and receive work assignments, priorities, etc. from the Maintenance Supervisor. During your shift as a Maintenance Technician (Mechanic), you will Perform preventive and/or predictive maintenance of mechanical tasks, document findings and completion. Maintain, check, adjust, install, and repair every mechanical system in the plant, according to maintenance procedures and manufacturers recommendations using drawing, manuals, blueprints, and P&ID diagrams. Repair and install various piping systems and valves: including threaded, flanged, welded, glued, and compression Recommend changes to existing equipment, piping, or system in order to improve plant safety or reliability. Recommend tools, equipment, or me

Senior Software engineer (Furnishing Platform) Remote Spain

Software Development Engineer, AI Upgrades & Transformation East Palo Alto, California, USA Do you enjoy working on large-scale distributed systems and Agentic AI ? The team manages the Apache Spark Upgrade Agent for Analytics services (Glue, EMR, Athena), the Remote MCP Service (SageMaker Unified Studio MCP), and the AWS Glue Python Service - Product and Runtime. Apache Spark Upgrade Agent[1], is a new generative Agentic AI capability that enables customers to upgrade their Apache Spark applications to newer versions. Spark upgrades traditionally require 6-12 months of engineering effort for customers due to analyzing API changes, resolving dependency conflicts, and validating functional correctness across hundreds of enterprise applications. Apache Spark Upgrade Agent, reduces upgrade timelines from months to weeks through conversational interfaces, automated code transformation, and rigorous data quality validation, allowing engineers to use natural language for upgrades while maintaining approval control over changes and freeing engineering capacity for strategic innovation. The Remote MCP service is a fully managed Model Context Protocol server that provides customers using AI assistants (Kiro, Claude, Cline) and Agents secure access to value-added Spark Troubleshooting, Code Recommendation and Upgrade tools for Analytics services. Remote MCP service provide Agents with a MCP-compliant (Json-RPC-based interface) for Tool calls with IAM based permissions and auditability through AWS CloudTrail. The team also manages Glue Python Shell product and runtime. Glue Python Shell customers use Python 2 (2.7) and Python 3 (3.6 & 3.9). [1] Spark Upgrade agent - https://aws.amazon.com/blogs/big-data/introducing-apache-spark-upgrade-agent-for-amazon-emr/ Key job responsibilities - Collaborate with experienced cross-disciplinary Amazonians to conceive,

Software Engineer II, Backend (Capital Orchestration) Remote US

Databricks Developer Ashburn, VA posted: Posted 30+ Days Ago

Senior ML Engineer - Firefly Bucharest posted: Posted 30+ Days Ago

Software Development Engineer, Open Data Analytics - Engines Redmond, Washington, USA Amazon Web Services Open Data Analytics (ODA) organization is looking for exceptional engineers to help in our mission to provide the world's best cloud Big Data processing platform and services such as EMR and Athena. The ODA engines team is looking for an experienced engineer to join the core engines and datalake team. Athena and EMR are services that our customer use to run large scale analytics, leveraging open source engines like Apache Spark and Trino, with datalake open table formats like Apache Iceberg, Hudi and Delta. The analytics engines organization makes significant modifications to these engines to run in serverless environments and with superior performance and scalability than what is available in Open Source. In the last 3 years we have improved our engines by a factor of 5x by making changes to the optimizer, query runtime and storage connectors. We have also made significant changes to the compiler to enable enterprise features like fine grain access control with these engines and table formats. Additionally, we strive to regularly contribute features, bug fixes and optimizations back to open-source, as well be current with the latest open-source versions of these frameworks. This is a “must-win” strategic area in a growing and very technical space. We are seeking a passionate and hands-on engineer to collaborate closely with open-source communities like Apache Iceberg and Apache Spark, driving innovations in query engines and table format integrations. In this role, you will focus

Senior Machine Learning Engineer (Fraud) Remote Canada

Machine Learning Services Engineer - Firefly Bucharest posted: Posted 30+ Days Ago

Machine Learning Engineer II (Fraud) Remote Canada

Creative Services Producer India - Hyderabad posted: Posted 30+ Days Ago

Machine Learning Engineer - Evergreen Bucharest posted: Posted 30+ Days Ago

Staff ML Engineer, Fine Tuning - Slack 3 Locations posted: Posted 14 Days Ago

Staff Software Engineer, Backend (Deal Reporting) Remote Spain

Senior Staff Machine Learning Engineer, (Machine Learning) Remote Canada