Spark jobs

Staff Machine Learning Engineer Seattle (WA) posted:

Hadoop and PySpark Developer In the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: ⦁ Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided ⦁ Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions ⦁ Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability ⦁ Conduct code reviews, do changes to the codebase and maintain code repositories ⦁ Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards ⦁ Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications ⦁ Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability ⦁ Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projects Your contribution to the team: ⦁ A collaborative spirit and excellent communication skills. ⦁ The ability to handle end to end SDLC phases from requirement gathering to implementation. ⦁ A knack for translating complex requirements into actionable development tasks. ⦁ A passion for design and hands-on coding experience ⦁ A proactive approach to testing, troubleshooting, and refining our applications. ⦁ The ability to work with cross-functional teams and do software integration.

Seasonal Science Lead Counselor - Rochester, MN Rochester, Minnesota, United States of America As a Science Lead Counselor at Science Factory Camp, you will guide campers ages 6-12 through hands‑on, curiosity‑driven experiments that spark wonder and those “whoa, that's cool!” moments. You wi...

Machine Learning Engineer Seattle (WA) posted:

Technical Account Manager, EMEA London About Highspot Highspot is pioneering the category that is fundamentally changing the way companies increase sales productivity. On a mission to transform the way millions of people work with sales enablement, Highspot is committed to building breakthrough software with a spark of magic. We believe a great place to work is about more than the work - it's about what the company stands for, and how it authentically represents its values in the real world. To this end, we have put intentional focus on creating equitable workspaces for each of our employees. Our goal is to create a culture where everyone feels a deep sense of belonging and is empowered to be an agent of change, with the ability to transform themselves, their workplace, and their world. About Highspot Highspot is pioneering the category that is fundamentally changing the way companies increase sales productivity. On a mission to transform the way millions of people work with sales enablement, Highspot is committed to building breakthrough software with a spark of magic. We believe a great place to work is about more than the work - it's about what the company stands for, and how it authentically represents its values in the real world. To this end, we have put intentional focus on creating equitable workspaces for each of our employees. Our goal is to create a culture where everyone feels a deep sense of belonging and is empowered to be an agent of change, with the

Workshop Technician Philippines Being part of Cummins means working alongside today's most innovative thinkers to solve the world's toughest problems. We are proud to offer learning and development opportunities designed to promote individual performance and spark purpose and trust within our teams. We look to hire the best and then help you to become even better. Thank you for your interest in continuing to grow your Cummins career!

Demand Generation Manager Prague Demand Generation Manager

Big Data Platform & Distributed Systems (Mid/Senior/Lead/Principal) Washington - Bellevue About the Teams: By applying to this role, you will be considered for two mission-critical teams at the heart of our data strategy. Both teams operate at extreme scale, leveraging Public Cloud (AWS/GCP) and Kubernetes to power the next generation of data-driven intelligence. Pillar 1: Data Engineering & Observability Build and own large-scale data pipelines and observability systems that power metrics, logging, and real-time insights across services. This role focuses on designing reliable telemetry pipelines, improving monitoring and alerting, and ensuring data quality and system visibility at scale. Ideal candidates have strong distributed systems fundamentals, backend development experience (Java or similar), and experience operating high-throughput data or monitoring platforms in cloud or hybrid environments. Build and ship high-quality, production-grade software using modern engineering practices, with AI as a core part of your development workflow by pushing the boundaries of AI development tools to deliver secure, optimized, and high-quality code. Design and orchestrate complex systems where AI agents integrate seamlessly into human workflows, driving efficiency and innovation at scale. Pillar 2: Data Cloud. Big Data Compute platform team. Owns the compute infrastructure that powers large-scale Spark workloads. The team focuses on optimizing core Spark performance, solving distributed systems challenges, and building scalable AI infrastructure, including exploring efficient ways to run smaller language models. Contribute to building and maintaining the shared system context, an explicit repository of system designs, constraints, and standards that enables AI to operate accurately and reliably. Critically evaluate

Kitting Team Lead - Day Shift Newark, Delaware posted: Posted 4 Days Ago

Senior Serviceability Engineer - Hardware Senior Serviceability Engineer - Hardware

Senior Software Engineer (Tech Lead) - Message Security Detection Hybrid - Bangalore, India What you will do - Architect & Scale: Design and maintain high-throughput detection systems and backend services, ensuring low latency and high reliability. - Data Orchestration: Lead the development of robust data pipelines using Spark and Airflow to supply detection teams with high-fidelity data for ML model training and evaluation. - Technical Leadership: Partner with Engineering Managers to define technical roadmaps, mentor junior/mid-level engineers, and drive best practices in code quality and system design. - AI-Driven Innovation: Lead the team in adopting AI productivity initiatives , leveraging tools like Claude, OpenAI, and GitHub Copilot to accelerate the development lifecycle and automate internal workflows. - Cross-functional Collaboration: Work closely with TPMs, Product Managers, Data Scientists, and Security Researchers to translate complex business needs into scalable technical solutions. - Operational Excellence: Manage and optimize cloud-native infrastructure on AWS/EKS , ensuring systems are cost-effective, secure, and performant. Must Haves - 8+ years of professional experience: Proven track record in production-level backend development with Python or Golang . - Data Engineering Expertise: Expert-level proficiency in building and optimizing distributed data pipelines using Spark and Airflow (or equivalent orchestration tools). - Cloud & Infrastructure: Extensive experience managing and scaling cloud-native applications on AWS (highly preferred) , GCP, or Azure, with a proven track record of hands-on container orchestration using EKS . - Leadership & Mentorship: Experience leading technical projects, mentoring engineers, and contributing to the long-term technical strategy of a team. -

Sr. Database Administrator 9 Locations Axos Bank Target Range: $120,000.00 /Yr. - $145,000.00 /Yr. Actual starting pay will vary based on factors including, but not limited to, geographic location, experience, skills, specialty, and education. Eligible for an Annual Discretionary Cash Bonus Target: 12.5% Eligible for an Annual Discretionary Restricted Stock Units Bonus Target: 12.5% These discretionary target bonuses may be awarded semi-annually based upon your achievement of performance goals and targets. About This Job We are seeking a SQL DBA with hands-on Databricks experience to support and optimize enterprise data platforms. This role combines strong database administration expertise with modern data engineering capabilities, focusing on performance, scalability and reliability. This role will be onsite and available at any of the posted locations to include: San Diego, CA Irvine, CA Los Angeles, CA Centennial, CO Las Vegas, NV Remote or Hybrid is not available. Responsibilities Administer, monitor and maintain SQL Server databases Perform performance tuning, query optimization and troubleshooting Manage backups, restores and high availability (HA/DR) solutions Ensure database security, integrity and compliance Develop and manage data pipelines using Databricks Work with large-scale data processing using Spark (PySpark/Scala) Support ETL/ELT workflows and data transformations Optimize data processing for performance and scalability Collaborate with cross-functional teams to support data platform initiatives Requirements: 6+ years of experience as a SQL Server DBA Strong expertise in SQL performance tuning and database optimization Automate Database server maintenance tasks through TSQL, PowerShell, and Python Hands-on experience with Databricks Experience with Spark (PySpark/Scala) Knowledge of ETL processes

Creative Services Producer India - Hyderabad posted: Posted 30+ Days Ago

Data Architect 3 Locations posted: Posted 3 Days Ago

Principal Software Engineer - Data Analytics Pune, IN About the Role PubMatic is seeking a Data Analytics-focused Principal Software Engineer with experience in building and optimizing AI agents, including strong skills in Hadoop, Spark, Scala, Kafka, Spark Streaming, and cloud-based solutions, with proficiency in programming languages such as Scala and Python. You will be responsible for developing advanced AI agents that enhance our data analytics capabilities, enabling our platform to handle complex information retrieval, contextual understanding, and adaptive interactions, ultimately improving our data-driven insights and analytical workflows. What You'll Do: Build, design, and implement our highly scalable, fault-tolerant big data platform to process terabytes of data and provide customers with in-depth analytics. Develop backend services using Java, REST APIs, JDBC, and AWS. Build and maintain Big Data pipelines using technologies like Spark, Hadoop, Kafka, and Snowflake. Architect and implement real-time data processing workflows and automation frameworks. Lead multiple projects to develop features for data processing and reporting platforms, and collaborate with product managers and cross-functional teams. Collaborate with functional teams to build products to deliver end-to-end products and features, and fix bugs for better performance. Design and develop GenAI-powered agents for analytics, operations, and data enrichment use cases using frameworks like LangChain, LlamaIndex, or custom orchestration systems. Integrate LLMs (e.g., OpenAI, Claude, Mistral) into existing services for query understanding, summarization, and decision support. Manage end-to-end GenAI workflows, including prompt engineering, fine-tuning, vector embeddings, and retrieval-augmented generation (RAG). Working closely with cross-functional teams on improving the availability and scalability of large

Senior Software Engineer - Distributed Data Systems San Francisco, California P-59 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. Modern data analysis employs sophisticated methods such as machine learning that go well beyond the roll-up and drill-down capabilities of traditional SQL query engines. As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support diverse workloads ranging from ETL to data science. Below are some example projects: Apache Spark™ : Develop the de facto open source standard framework for big data. Data Plane Storage : Provide reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store. Delta Lake : A storage management system that combines the scale and cost-efficiency of

Finance Manager Selangor, Malaysia Being part of Cummins means working alongside today's most innovative thinkers to solve the world's toughest problems. We are proud to offer learning and development opportunities designed to promote individual performance and spark purpose and trust within our teams. We look to hire the best and then help you to become even better. Thank you for your interest in continuing to grow your Cummins career!

Member of Technical Staff 1- Core Data Path Member of Technical Staff 1- Core Data Path

Social Marketing Manager, YouTube Marketing SPARK (English, Korean) Seoul, South Korea YouTube's mission is to give everyone a voice and show them the world. We believe that everyone deserves to have a voice, and that the world is a better place when we hear, share and build community through our stories. The YouTube Brand and Social Marketing brings this mission to life. You will build brand love, keep YouTube at the center of culture and partner with teams on social and influencer marketing that have the user at its center. As Social Marketing Manager for YouTube, you will be shaping and driving the social presence of one of the most culturally significant brands of our times in a dynamic and growing region. You should have experience driving social and influencer marketing strategies and programs that have created an impact on marketing and business goals. You have a knack for spotting trends before others do, and you are as obsessed about what excites communities as you are about what our products can do for them. You are a constant advocate for our users and creators - your ideas are always deeply rooted in what they care about, what they crave, and what delights them. And you have experience executing and optimizing programs, from influencer marketing, to always-on social editorial, to escalating brand risks and responding swiftly and thoughtfully to topics that are important to our users and creators. You have analytical, strategic and creative capabilities, using data for insights that will

Cloud Technical Lead Southfield posted: Posted 14 Days Ago

Specialist IoT Cloud Engineer Lead Madrid, Spain

Sales Representative, NL Netherlands, Amsterdam Who We Are: At Brooks, we believe movement is the key to feeling more alive. That's why we're driven to create gear and experiences that take people to the place that makes them feel more alive - whether it's a headspace, a feeling, or a finish line. Everyone who works at Brooks is propelled by a company culture that sparks excitement, fuels collaboration, inspires creativity, and ignites innovation. Our brand values help bond us together and drive our success: • Runner First: We act in the best interest of the runner • Word is Bond: We do what we say we'll do • Champion Heart: We give our all in everything we do • There is no “I” in Run: We stay generous with our humanity • Keep Moving: We find ways to move every day, because joy is kinetic! We welcome everyone from every walk of life looking to inspire others through the power of movement - because we're all moving towards something. Let's run there. Who We Are: At Brooks, we believe movement is the key to feeling more alive. That's why we're driven to create gear and experiences that take people to the place that makes them feel more alive - whether it's a headspace, a feeling, or a finish line. Everyone who works at Brooks is propelled by a company culture that sparks excitement, fuels collaboration, inspires creativity, and ignites innovation. Our brand values help bond us together and drive our

Data Engineer India - Hyderabad posted: Posted Today

Senior Data Engineer, GFT TORONTO, Ontario, Canada Join our team as a Senior Data Engineer and drive the development of our Finance Core Data Platform. Leverage your expertise in Spark, Big Data, and cloud technologies to deliver robust data solutions. Collaborate with cross-functional teams and mentor others while working on innovative projects in a dynamic, growth-focused environment.