Spark jobs

Software Development Engineer, AWS Athena Bellevue, Washington, USA Want to help make history in the world of big data and make it easy for customers to efficiently query and analyze petabytes and more of data? Come join the Amazon Athena team in AWS! We are developing innovative new capabilities from the ground up that will transform the way customers analyze their data while also giving them high performance, low costs, and exceptional ease-of-use. We are a small, entrepreneurial team that operates independently, but with access to some of the top engineers in our field across AWS. In this role, you will have the opportunity to collaborate with senior and principal engineers who are domain experts at AWS. You'll develop deep expertise in areas like distributed systems, query engines, open source applications, performance optimization, and operational excellence. You'll also have the opportunity to work with and contribute to the leading open source big data and analytic frameworks like Hive, Spark, and Presto. You will enjoy competitive compensation and your contributions in this role will impact customers and businesses around the world. Key job responsibilities You'll be responsible for designing, developing, testing and deploying some of our most strategic technical projects. You'll deliver large-scale, high performance production systems, design new software systems of distributed technology, and have a significant bottom-line impact on our business results. You will draw from your deep and broad technical expertise to mentor engineers, complete hands-on technical work and provide leadership on complex technical issues. Internal job description

Machine Learning Engineer, Firefly Services 2 Locations posted: Posted 30+ Days Ago

Data Architect Bangalore posted: Posted 30+ Days Ago

Senior Applied Scientist, Translation Services Hyderabad, Telangana, IND Have you ever wondered how Amazon launches and maintains a consistent customer experience across hundreds of countries and languages it serves its customers? Are you passionate about data and mathematics, and hope to impact the experience of millions of customers? Are you obsessed with designing simple algorithmic solutions to very challenging problems? If so, we look forward to hearing from you! At Amazon, we strive to be Earth's most customer-centric company, where both internal and external customers can find and discover anything they want in their own language of preference. Our Translations Services (TS) team plays a pivotal role in expanding the reach of our marketplace worldwide and enables thousands of developers and other stakeholders (Product Managers, Program Managers, Linguists) in developing locale specific solutions. Amazon Translations Services (TS) is seeking a Senior Applied Scientist to be based in our Hyderabad office. As a key member of the Science and Engineering team of TS, this person will be responsible for designing algorithmic solutions based on data and mathematics for translating billions of words annually across 130+ and expanding set of locales. The successful applicant will ensure that there is minimal human touch involved in any language translation and accurate translated text is available to our worldwide customers in a streamlined and optimized manner. With access to vast amounts of data, technology, and a diverse community of talented individuals, you will have the opportunity to make a meaningful impact on the way customers

Data engineer Bangalore posted: Posted 30+ Days Ago

Senior Product Manager, Google Cloud Dataproc Bengaluru, Karnataka, India At Google, we put our users first. The world is always changing, so we need Product Managers who are continuously adapting and excited to work on products that affect millions of people every day. In this role, you will work cross-functionally to guide products from conception to launch by connecting the technical and business worlds. You can break down complex problems into steps that drive product development. One of the many reasons Google consistently brings innovative, world-changing products to market is because of the collaborative work we do in Product Management. Our team works closely with creative engineers, designers, marketers, etc. to help design and develop technologies that improve access to the world's information. We're responsible for guiding products throughout the execution cycle, focusing specifically on analyzing, positioning, packaging, promoting, and tailoring our solutions to our users. In this role, you will be responsible for Google Cloud Platform (GCP) Data Analytics' big data analytics portfolio for Spark and other open source components in Dataproc and Serverless Spark. Google Cloud accelerates every organization's ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. Drive the new set of innovation and growth powering open source analytics at scale on Google Cloud. Work

DCEO Chief Engineer, DCC Communities Sparks, Nevada, USA AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. Amazon Web Services (AWS) is looking for an individual to join our Data Center Engineering Operations Team. This committed group works to maintain the critical physical infrastructure that supports Amazon Web Services. Specifically, this team works to ensure that the data center's MEP operates at 100% availability while maintaining first-class customer service to the teams and groups within the data centers. The Data Center Chief Engineer (CE) is responsible for ensuring that all electrical, mechanical, and fire/life safety equipment within the data center is operating at peak efficiency. This involves

Lead Mechanical Beit She'an Valley posted: Posted 30+ Days Ago

Sr. Applied Scientist , Amazon Seattle, Washington, USA How can we improve the customer experience by tailoring what we display on our pages based on available data? How do we build models that help us innovate in different ways to enhance customer experience? What is the relationship between what customers do on the site vs. what they actually buy? How do we do all of this without asking the customer a single question? Our team's stated missions is to "grow each customer's relationship with Amazon by leveraging our deep understanding of them to provide relevant and timely product, program, and content recommendations." Recommendations at Amazon is a way to help customers discover products. Our team strives to better understand how customers shop on Amazon (and elsewhere) and build recommendations models to streamline customers' shopping experience by showing the right products at the right time. Understanding the complexities of customers' shopping needs and helping them explore the depth and breadth of Amazon's catalog is a challenge we take on every day. Using Amazon's large-scale computing resources, you will ask research questions about customer behavior, build state-of-the-art models to generate recommendations, and run these models directly on the retail website. You will participate in the Amazon ML community and mentor Applied Scientists and software development engineers with a strong interest in and knowledge of ML. Your work will directly benefit customers and the retail business and you will measure the impact using scientific tools. We are looking for a passionate, hard-working, and

Machine Learning Engineer - 5 Bangalore posted: Posted 30+ Days Ago

Data Center Logistics Technician, DCC Communities Sparks, Nevada, USA AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. The Site Logistics Technician reviews Data Center inventory, inbound shipments, and ongoing demand to ensure that proper stock levels are maintained in the all locations to support build and repair activities. Working with the Logistics Manager, they create plans to optimize the flow of parts through their lifecycle; tracking inventory locations, movements, age, and turns. They work closely with Data Center Operations Technicians and Data Center Engineers to fulfill parts quickly and accurately. They work with Procurement and Hardware Engineering to purchase new parts and interface directly with vendors

Data Center Operations and Design Engineer IL - Northlake, 505 N Railroad Ave posted: Posted Yesterday

Data Scientist & Machine Learning Researcher 2 Locations posted: Posted 30+ Days Ago

Sr. Applied Scientist, Amazon Robotics Boston, Massachusetts, USA Are you interested in how to build AI reasoning systems that give provably correct answers? Are you excited by science at the interface of classical AI reasoning and Large Language Models (LLMs)? Would you like to apply your technology to serve operations customers better? Amazon Robotics is looking for a talented Applied Scientist in Neurosymbolic AI. You will innovate on combining language models (LMs) with classical AI reasoning. You will work with a team of scientists and engineers to achieve this. You will publish your results in papers at leading venues in AI. You will be part of a larger team and have the opportunity to work on problems such as: using LMs to generate plans, using AI reasoning to verify plan correctness, learning efficient reasoning strategies, self-improving models. You will work on basic science and on business problems in robotics, automation and fulfillment across our operations. Key job responsibilities In this role you will: • Work closely with other scientists and engineers, and be part of Amazon's diverse global science community. • Publish your research in top-tier academic venues and hone your presentation skills. • Be inspired by challenges and opportunities to invent new techniques in your area(s) of expertise. A day in the life You'll meet regularly with your technical lead and your team on your ideas, get guidance and feedback, work together on architectures and algorithms, author papers, build AI systems, all with the aim of delivering results for

Associate Data Scientist (Data Engineering) India - Hyderabad posted: Posted Yesterday

Staff ML Engineer - ML Infrastructure Remote - US Who we are Samsara (NYSE: IOT) is the pioneer of the Connected Operations™ Cloud, which is a platform that enables organizations that depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At Samsara, we are helping improve the safety, efficiency and sustainability of the physical operations that power our global economy. Representing more than 40% of global GDP, these industries are the infrastructure of our planet, including agriculture, construction, field services, transportation, and manufacturing - and we are excited to help digitally transform their operations at scale. Working at Samsara means you'll help define the future of physical operations and be on a team that's shaping an exciting array of product solutions, including Video-Based Safety, Vehicle Telematics, Apps and Driver Workflows, and Equipment Monitoring. As part of a recently public company, you'll have the autonomy and support to make an impact as we build for the long term. About the role: Samsara is the industry leader in AI for physical operations. We're hiring a Staff / Senior Staff Machine Learning Infrastructure Engineer to lead the design and evolution of our end-to-end ML platform powering Safety AI and adjacent product areas. This role combines deep platform ownership with direct product impact-enabling teams to build, deploy, and scale ML systems that improve real-world safety outcomes. This is a remote position open to candidates based in the United States. You should apply if: You

Sr. Applied Scientist, Last Mile Science Bengaluru, Karnataka, IND Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so fast? Have you wondered where it came from and how much it cost Amazon to deliver it to you? If so, the WW Amazon Logistics, Business Analytics team is for you. We manage the delivery of tens of millions of products every week to Amazon's customers, achieving on-time delivery in a cost-effective manner. We are looking for an enthusiastic, customer obsessed, Sr. Applied Scientist with good analytical skills to help manage projects and operations, implement scheduling solutions, improve metrics, and develop scalable processes and tools. The primary role of an Operations Research Scientist within Amazon is to address business challenges through building a compelling case, and using data to influence change across the organization. This individual will be given responsibility on their first day to own those business challenges and the autonomy to think strategically and make data driven decisions. Decisions and tools made in this role will have significant impact to the customer experience, as it will have a major impact on how the final phase of delivery is done at Amazon. Ideal candidates will be a high potential, strategic and analytic graduate with a PhD in (Operations Research, Statistics, Engineering, and Supply Chain) ready for challenging opportunities in the core of our world class operations space. Great candidates have a history of operations research, and

Applied Scientist, WWOS Tech Seattle, Washington, USA Have you ever wanted to solve a mystery or be part of solving a case? Are you fascinated by detective stories or crime shows on TV? Do you love to catch bad actors, build ML models and solve complex problems. If so, working on the WWOS Tech team as a Sr Applied Scientist is the place for you! We detect theft, fraud and organized crime happening across our global supply chain and operations for millions of items, for hundreds of product lines worth billions of dollars of inventory world-wide. We foster new game-changing ideas, creating ever more intelligent and self-learning systems to maximize the cost savings of Amazon's inventory losses. The primary role of a Sr Applied Scientist within Amazon is to address business challenges through building a compelling case, and using data to influence change across the organization. This individual will be given responsibility on their first day to own those business challenges and the autonomy to think strategically and make data driven decisions. Decisions and tools made in this role will have significant impact to the customer experience, as it will have a major impact on all the fraud investigations happening across Amazon operations. Ideal candidates will be a high potential, strategic and analytic graduate with a PhD in ( Research, Statistics, Engineering, and Supply Chain) ready for challenging opportunities in the core of our world class operations space. Great candidates have a history of building fraud detections, detecting organized crime

Senior AI/ML Engineer 2 Locations posted: Posted 30+ Days Ago

Network Install Technician, Amazon Web Services Sparks, Nevada, USA Transform network infrastructure by joining our dynamic team! You'll be at the forefront of developing innovative solutions that drive network stability and scalability, using your technical expertise to create automated systems that power global technological advancement. Network Install Technicians will collaborate with cross-functional teams, troubleshoot complex technical scenarios, and implement strategic solutions that keep our network running seamlessly. Expect to engage in hands-on technical work that requires creativity, precision, and a passion for technological innovation. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. NOTE: Amazon does not sponsor for immigration, including for H-1B, TN, and other non-immigrant

System Test Engineer Lead - Sapphire 13 Locations posted: Posted 2 Days Ago

Associate Platform Engineer - SAP Business Technology Platform Big Data Team Region Europe | Country Bulgaria | Internal Posting Location Sofia We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging - but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. Overview As an Associate Platform Engineer, you will support the design, implementation, and operation of the Big Data and cloud platform services (Kafka, Cassandra, Spark) that power SAP's enterprise‑scale solutions. You will work alongside experienced engineers to build reliable, scalable, and secure platform capabilities used across SAP Business Technology Platform (SAP BTP). This role is ideal for early‑career engineers who are eager to learn modern cloud technologies, distributed systems, Kubernetes, and automation practices. Curiosity, a willingness to learn, and a collaborative mindset are highly valued. What you will build As an Associate Platform Engineer, you will contribute to platform development and operations with guidance and mentorship. Your responsibilities include: Build and automate provisioning, configuration, and lifecycle management for Big Data platform components Implement cloud‑agnostic platform features across hyperscalers (Amazon Web Services, Google Cloud,

Data Engineer - R&D Data Catalyst Team India - Hyderabad posted: Posted 30+ Days Ago

Engineering Operations Technician, AWS Sparks, Nevada, USA Join our dynamic team and become a critical guardian of technological infrastructure! As a Data Center Engineering Technician, you'll play a pivotal role in maintaining the heartbeat of mission-critical technology infrastructure, ensuring seamless operations that power global digital experiences. Your expertise will directly contribute to maintaining an extraordinary 99.999% uptime, keeping the digital world running smoothly and efficiently. Engineering Technicians are Amazon's front line when it comes to hands-on electrical and mechanical equipment troubleshooting. They will maintain, operate, and troubleshoot, Data Center Operation's Mission Critical Facilities, which includes stand-by diesel generators and related fuel systems, as well as three phase electrical systems such as: switch gear, UPSs, PDUs, wet cell batteries and associated systems, CRAC, centrifugal chillers, cooling towers/water chemical system, air handlers and associated systems, pumps, & motors. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver