Spark jobs

Data Scientist II - AMZ9658237 New York, New York, USA MULTIPLE POSITIONS AVAILABLE Employer: AMAZON ADVERTISING LLC Offered Position: Data Scientist II Job Location: New York, New York Job Number: AMZ9658237 Position Responsibilities: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. 40 hours / week, 8:00am-5:00pm, Salary Range $169,541/year to $207,500/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For

Lead Mechanical Engineer GB-AN-MONTROSE-CHARLETON ROAD posted: Posted 9 Days Ago

Senior Data Engineer Manchester, Lancashire posted: Posted 30+ Days Ago

Software Development Engineer III Data Bangalore, Karnataka When 5% of Indian households shop with us, it's important to build data-backed, resilient systems to manage millions of orders every day. We've done this - with zero downtime! 😎 Sounds impossible? Well, that's the kind of Engineering muscle that has helped Meesho become the e-commerce giant that it is today. We value speed over perfection, and see failures as opportunities to become better. We've taken steps to inculcate a strong 'Founder's Mindset' across our engineering teams, making us grow and move fast. We place special emphasis on the continuous growth of each team member - and we do this with regular 1-1s and open communication. Tech Culture We have a unique tech culture where engineers are seen as problem solvers. The engineering org is divided into multiple pods and each pod is aligned to a particular business theme. It is a culture driven by logical debates & arguments rather than authority. At Meesho, you get to solve hard technical problems at scale as well as have a significant impact on the lives of millions of entrepreneurs. You are expected to contribute to the Solutioning of product problems as well as challenge existing solutions. Meesho's user base has grown 4x in the last 1 year and we have more than 50 million downloads of our app. Here are a few projects we have completed last year to scale oursystems for this growth: ● We have developed API gateway aggregators using frameworks like Hystrix

Staff Business Analyst Staff Business Analyst

Senior Applied Scientist, Japan Prime & Marketing Tokyo, JPN The Japan Prime & Marketing team drives customer growth and engagement for Amazon Japan. Our applied science team combine advanced machine learning with deep business understanding to deliver experiences that delight customers and grow the Prime membership base in one of Amazon's most dynamic and competitive marketplaces. We are seeking a Senior Applied Scientist to lead the science for personalization and customer growth initiatives across Japan Points, promotional campaigns, and Prime membership engagement. You will own end-to-end science solutions - from problem formulation and data analysis through model development, A/B testing, and production deployment - that directly impact millions of Japanese customers. This is a high-visibility role where you will define the science roadmap, influence business strategy with data-driven insights, and collaborate with product, engineering, economics, and marketing teams across Japan and globally. Key job responsibilities - Define and execute the science roadmap for personalization, points optimization, promotions targeting, and customer growth within Japan Prime & Marketing - Design and develop machine learning models for customer segmentation, lifetime value prediction, churn propensity, and next-best-action recommendation to drive Prime acquisition and retention - Build optimization frameworks for Japan Points allocation, promotional offer targeting, and budget efficiency that maximize long-term customer value rather than short-term engagement - Apply causal inference, experimentation design, and econometric methods to measure the incremental impact of points, promotions, and marketing interventions - Develop personalization systems that tailor offers, messaging, and incentive structures to individual customer preferences and lifecycle

Senior Software Engineer, Data Infrastructure USA - Remote Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Data represents the voice of Airbnb's users at scale. The Data Warehouse Infrastructure team is responsible for the foundational big data infrastructure, which is used by hundreds of engineers to collect, manage, and analyze data at scale. We are using open source technologies like Hadoop, Spark, Trino, Iceberg, Airflow etc. A Typical Day: Architect, design, and implement Airbnb's next-generation big data compute platform to support data ETL, analytics, and machine learning initiatives. Manage and operate the platform, continually enhancing its reliability, performance, observability, and cost-efficiency. Produce high-quality, maintainable, and self-documenting code, actively participating in code review processes. Contribute to open-source software and drive meaningful industry impact. Your Expertise: Qualifications Education: BS/MS/PhD in Computer Science, a related field, or equivalent practical experience (preferred). Experience: 6+ years of professional experience in data infrastructure, with a deep focus on big data technologies. Technical Skills Big Data Proficiency: Expert-level knowledge of big data technologies, including Spark, Trino, Kunbernates, and AWS EMR. Programming: Strong programming abilities in languages such as Java, Scala, and SQL. System Design: Extensive experience in

Lead Cloud Engineer CAN, ON, Mississauga posted: Posted 2 Days Ago

Staff Salesforce Developer Staff Salesforce Developer

Senior Partner Solutions Architect Atlanta; Austin; Dallas; Florida; Miami We are looking for passionate technologists to join our Pre-Sales organization to ensure that our growth is grounded and guided by strong technical alignment with our platform and the needs of our customers. MongoDB Pre-Sales Solution Architects are responsible for guiding our customers and partners to design and build reliable, scalable systems using our data platform. Our team is made up of seasoned software architects and developers who take direct responsibility for customer success, including the design of their software, deployment, and operations. You'll work closely with our field partner leaders and play a key role in winning deals and driving the business forward. You'll be a trusted advisor to a wide range of users from startups to the world's largest enterprise IT organizations. As an ideal candidate, you will have: - 8+ years of pre-sales experience with enterprise software and technical aptitude - Working knowledge and ability to code with one or more modern scripting languages (e.g. Python, Node.js, SQL) and/or popular programming languages (e.g. C/C++, Java, C#) - Experience with scalable and highly available distributed systems - 2+ years of software development experience - Excellent presentation and communication skills - The ability to travel up to 50% - A Bachelor's degree or equivalent work experience - Professional proficiency in speaking and writing Portuguese and English - Professional proficiency in speaking and writing Spanish is highly preferred As an ideal candidate, you may also have: - Experience selling databases and/or

Engineering Operations Technician, AWS Data Center team Sparks, Nevada, USA Join our dynamic team and become a critical guardian of technological infrastructure! As a Data Center Engineering Technician, you'll play a pivotal role in maintaining the heartbeat of mission-critical technology infrastructure, ensuring seamless operations that power global digital experiences. Your expertise will directly contribute to maintaining an extraordinary 99.999% uptime, keeping the digital world running smoothly and efficiently. Engineering Technicians are Amazon's front line when it comes to hands-on electrical and mechanical equipment troubleshooting. They will maintain, operate, and troubleshoot, Data Center Operation's Mission Critical Facilities, which includes stand-by diesel generators and related fuel systems, as well as three phase electrical systems such as: switch gear, UPSs, PDUs, wet cell batteries and associated systems, CRAC, centrifugal chillers, cooling towers/water chemical system, air handlers and associated systems, pumps, & motors. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to

Hardware Power Engineer - New Grad Ottawa posted: Posted 28 Days Ago

Senior Business Intelligence Engineer, EU Stores CX Analytics & Automation Madrid, Community of Madrid, ESP This position can be based in either Madrid or Berlin. Are you passionate about using data to create shopping experiences that feel genuinely personal? We're looking for a Senior Business Intelligence Engineer to lead the way we build and scale personalised recommendations for millions of customers across ten European marketplaces. In this role, you'll sit at an exciting intersection of business intelligence, data engineering, and data science. You'll build on top of Amazon's world-class personalisation infrastructure - consuming real-time customer intent signals, blending them with large-scale EU retail data and engagement metrics, and applying custom processors and matching models to surface the right product at the right moment. Think complement strategies that inspire follow-on purchases, discovery strategies that introduce customers to new categories, and inspiration experiences that tap into individual browsing and purchase patterns - all layered on top of centralised recommendation systems and enriched with EU-specific intelligence that you build and own. This is more than a traditional data role. On the data science side, you'll develop custom models using Python and Spark to understand customer-product affinity at scale, applying techniques like embeddings modelling and customer persona matching to power EU-specific personalisation strategies built on top of Amazon's global recommendation infrastructure. On the engineering side, you'll build and deploy the internal tooling that puts these capabilities directly in the hands of marketing teams - writing production-grade Python services, building serverless infrastructure with AWS Lambda

Corporate Account Executive - West US Join Pigment: The AI Platform Redefining Business Planning Pigment is the AI-powered business planning and performance management platform built for agility and scale. We connect people, data, and processes in one intuitive, feature-rich solution, empowering every team-from Finance to HR-to build, adapt, and align strategic plans in real time. Founded in 2019, Pigment is one of the fastest-growing SaaS companies globally. Industry leaders like Unilever, Snowflake, Siemens, and DPD use Pigment daily to make more informed decisions and confidently navigate any scenario. With a team of 600+ across Paris, London, New York, Toronto, San Francisco and Austin, we've raised nearly $400M from top-tier investors and were named a Visionary in the 2024 Gartner® Magic Quadrant™ for Financial Planning Software. At Pigment, we take smart risks, celebrate bold ideas, and challenge the status quo-all while working as one team. If you're driven by innovation and ready to make an impact at scale, we'd love to hear from you. Join Pigment: The AI Platform Redefining Business Planning Pigment is the AI-powered business planning and performance management platform built for agility and scale. We connect people, data, and processes in one intuitive, feature-rich solution, empowering every team-from Finance to HR-to build, adapt, and align strategic plans in real time. Founded in 2019, Pigment is one of the fastest-growing SaaS companies globally. Industry leaders like Unilever, Snowflake, Siemens, and DPD use Pigment daily to make more informed decisions and confidently navigate any scenario. With a team of 600+

Data Scientist II - AMZ9890779 Palo Alto, California, USA MULTIPLE POSITIONS AVAILABLE Employer: AMAZON.COM SERVICES LLC Offered Position: Data Scientist II Job Location: Palo Alto, California Job Number: AMZ9890779 Position Responsibilities: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. 40 hours / week, 8:00am-5:00pm, Salary Range: $174,826/year to $212,800/year. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information,

Sales Associate

Serviceability Engineer – Prism Central Product Support Serviceability Engineer - Prism Central Product Support

10188: Driver Development Instructor Sparks, Nevada, United States Starting rate of pay $33.92/ hour POSITION OVERVIEW: Effectively develop pre-qualified employees into CDL qualified drivers as well as increase morale and opportunity for advancement for employees. Perform city driving responsibilities and assist operations leadership with special assignments when not instructing. ESSENTIAL FUNCTIONS: Operate tractor-trailer combination, including doubles (and triples, where applicable) and/or straight trucks Perform daily pre-trip and safety inspections on equipment Hook/unhook trailers and converter dollies to/from a tractor and/or trailer Perform freight handling using appropriate motorized and manual equipment, including but not limited to: forklift, pallet jack and hand truck Secure freight inside trailers using appropriate tools and supplies, including but not limited to: pallets, straps and rope Recoup/repair damaged freight when necessary Verify and complete required documentation and reports Comply with hazardous material regulations and procedures Collect cash or checks for freight charges, as required, and maintain required documentation Follow dispatch instructions and communicate with dispatch, including but not limited to: delays, arrivals and equipment problems, as required Communicate with customers to determine pick-up or delivery needs and solicits additional business Demonstrate internal and external customer service Ask for additional business from customers, and provide leads to sales for potential new opportunities Create and edit current curriculum to better educate participants Coordinate class schedules and locations, schedule skills course and drive times, secure equipment and supplies and measure success of participants Maintain good working relationship with service center managers and manager driver development Conduct pre-shift meetings, advertise for

Senior Process Improvement Specialist San Jose, California posted: Posted 30+ Days Ago

Forward Deployed Data Engineer (TS/SCI) North America | Hybrid | Washington DC | Remote BUILD A SAFER WORLD. TRM Labs provides AI-powered intelligence solutions that help public and private sector agencies investigate and disrupt crime. TRM's platforms enable investigators to trace illicit activity, build cases, and construct operating pictures of threat networks. Leading agencies and businesses worldwide rely on TRM to make the world safer and more secure. As a Forward Deployed Engineer, you will work directly with TRM's government customers. This includes bridging our SaaS offering with federated capabilities and cloud architectures from the initial setup and implementation to configuration and maintenance. A successful mission will enable TRM's government customers to securely leverage TRM in regulated industries and also scale with maturity. As an early member of the Forward Deployed Engineering team, you will be deeply involved in the technical details and ultimately champion your team to build a safer financial system for billions of people. THE IMPACT YOU'LL HAVE HERE: - Partner directly with mission-focused customers to design and deploy secure, scalable cloud-based data lakehouse solutions on AWS (e.g., S3, EMR/EKS, Iceberg or Delta Lake). - Own and deliver production-ready ETL/ELT pipelines using Python, Apache Airflow, Spark, and SQL-optimized for petabyte-scale workloads. - Containerize and deploy services on Kubernetes (EKS), using Terraform or CloudFormation for Infrastructure-as-Code and repeatable environments. - Design integrations that ingest data from message buses, APIs, and relational databases, embedding real-time analytics capabilities into client workflows. - Actively participate in all phases of the software

DevOps and Cloud Engineer DevOps and Cloud Engineer

Senior II Data Engineer - Data Ingestion and Enrichment team Kyiv, Ukraine We power people's progress. At Preply, we're all about creating life-changing learning experiences. We help people discover the magic of the perfect tutor, craft a personalised learning journey, and stay motivated to keep growing. Our approach is human-led, tech-enabled - and it's creating real impact. We've just reached unicorn status with a $150M Series D, accelerating our vision to transform education through human-led, AI-enhanced learning. Today, 100,000+ tutors teach 90+ languages to learners in 180 countries - and we're only getting started. As a category-defining company, we're shaping what the future of learning looks like at global scale. Every Preply lesson sparks change, fuels ambition, and drives progress that matters. Joining Preply means helping define the future of education at global scale, and building something that truly matters for millions of people, every day. Meet the team! At Preply, the Data ingestion and enrichment team provides a single, trusted, and scalable data foundation. The team ensures that all analytics, machine learning, and product features are built on unified, governed, and production-grade data assets in Preply's Lake House, including the extraction, normalization, and generation of structured data from Preply's unstructured assets, forming a durable data moat for AI-driven products. As a Senior II Data Engineer in the Data Ingestion and Enrichment team , you will own and drive technical vision for the data layer that powers both Preply's analytics, machine learning, and product. You will work closely with ML

Software Engineer, Machine Learning Platform San Francisco, CA, USA About the role Chime's Machine Learning Platform (MLP) team builds and operates the infrastructure, tooling, and developer experience that powers machine learning across the company. We enable data scientists and ML engineers to develop, train, deploy, and monitor models reliably and efficiently. As a Machine Learning Platform Engineer, you will design and build scalable systems that support model training, feature computation, real-time inference, and experimentation. You'll work at the intersection of distributed systems, cloud infrastructure, and applied machine learning. This role focuses on building robust foundations that allow ML teams to move quickly while maintaining reliability, governance, and cost efficiency. The base salary offered for this role and level of experience will begin at $187,000.00 and goes up to $259,000.00. Full-time employees are also eligible for a bonus, competitive equity package, and benefits. The actual base salary offered may be higher, depending on your location, skills, qualifications, and experience. In this role, you can expect to - Design, build, and operate scalable ML infrastructure on AWS - Develop distributed training and batch processing systems using Ray - Build and maintain infrastructure-as-code using Terraform - Support and evolve the feature store and feature pipelines - Develop data ingestion and streaming systems (e.g., Kinesis, Kafka, Flink, Spark, or similar technologies) - Improve CI/CD workflows for ML models and platform components - Enhance observability, reliability, and cost visibility across ML workloads - Partner closely with Data Science and ML Engineering teams to improve developer

ENGINEER - Powerplant Performance Bangalore Area posted: Posted 7 Days Ago