Spark jobs

Data Scientist San Francisco posted: Posted Yesterday

Sr. Applied Scientist, SSG Science Bengaluru, Karnataka, IND Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like the Kindle family of products, Fire Tablets, Fire TV, Health Wellness, Amazon Echo & Astro products. This is an exciting opportunity to join Amazon in developing state-of-the-art techniques that bring Gen AI on edge for our consumer products. We are looking for exceptional scientists to join our Applied Science team and help develop the next generation of edge models, and optimize them while doing co-designed with custom ML HW based on a revolutionary architecture. Work hard. Have Fun. Make History. Key job responsibilities What will you do? - Quantize, prune, distill, finetune Gen AI models to optimize for edge platforms - Fundamentally understand Amazon's underlying Neural Edge Engine to invent optimization techniques - Analyze deep learning workloads and provide guidance to map them to Amazon's Neural Edge Engine - Use first principles of Information Theory, Scientific Computing, Deep Learning Theory, Non Equilibrium Thermodynamics - Train custom Gen AI models that beat SOTA and paves path for developing production models - Collaborate closely with compiler engineers, fellow Applied Scientists, Hardware Architects and product teams to build the best ML-centric solutions for our devices - Publish in open source and present on Amazon's behalf at key ML conferences - NeurIPS, ICLR, MLSys. Basic Qualifications: - 3+ years of building machine learning models for business application experience - PhD, or Master's degree and 6+ years of applied research experience

Manager Data Engineering 2 Locations posted: Posted 30+ Days Ago

IT Specialist (AI Data Engineer) Multiple Locations Summary As an IT Specialist (AI Data Engineer) with the US Office of Personnel Management, Office of the Chief Information Officer, Products and Data Engineering Division, you will develop, test, maintain, and support automated data pipelines and AI-assisted data engineering solutions that support OPM mission operations, stakeholder needs, and reliable data-driven services. Duties Develop, maintain, test, and support automated data pipelines using Python, SQL, Spark, .NET, and related data processing tools. Apply cloud-based continuous integration, deployment, and operations practices in Azure, Amazon Web Services, or Google Cloud environments. Use artificial intelligence tools to support coding, documentation, code review, log analysis, data quality checks, and anomaly detection. Implement data architecture patterns, including bronze, silver, and gold medallion architecture and big data platform solutions. Troubleshoot pipeline failures across infrastructure, data quality, and application layers, escalating issues as appropriate. Collaborate with business analysts, product owners, and stakeholders to clarify data requirements and explain technical constraints. Prepare technical documentation, data dictionaries, runbooks, status updates, and stakeholder communications. Requirements Must be a U.S. Citizen or National Males born after 12-31-59 must be registered for Selective Service Suitable for Federal employment, determined by a background investigation May be required to successfully complete a probationary period Candidates will not be hired based on their race, sex, color, religion, or national origin Complete the initial online assessment and USAHire Assessment, if required You will be required to report to an OPM assigned office. This position is not eligible for inclusion in

Data Scientist II, AWS Managed Operations Intelligence (MOI) - Data Science Arlington, Virginia, USA Amazon Web Services (AWS) is the world leader in providing a highly reliable, scalable, low-cost infrastructure platform in the cloud that powers hundreds of thousands of businesses in 190 countries around the world! Passionate about building, owning and operating massively scalable systems? Want to make a billion-dollar impact? If so, we have an exciting opportunity for you. The AWS Managed Operations (MO) organization was founded in April 2023, with the objective to reduce operational load and toil through long-term engineering projects. MO is building the best-in-class engineering and operations team that will own the day-to-day operations for AWS Regions; improving the availability, reliability, latency, performance and efficiency to operate AWS regions. The AWS Managed Operations Intelligence (MOI) Team is looking for a Data Scientist to lead the research and thought leadership to drive our data and insight strategy for AWS. You will be expected to serve as a Full Stack Data Scientist. You will be responsible for driving data-driven transformation across the organization. In this role, you will be responsible for the end-to-end data science lifecycle, from data exploration, ETL, model development and data visualization. You will leverage a diverse set of tools and technologies, including general analytical frameworks (Spark, Airflow, etc.), AI frameworks (Hugging Face, etc.) and various machine learning frameworks, to tackle complex business problems. Your analytics research will provide direction on the technology strategy of the Managed Operations organization. Your Decision Science artifacts

Powerplant Engineer 2 Locations posted: Posted 30+ Days Ago

Data Scientist II - AMZ27351.1 San Francisco, California, USA Employer: Amazon Web Services, Inc. Position: Data Scientist II - AMZ27351.1 Location: San Francisco, CA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. (40 hours / week, 8:00am-5:00pm, Salary Range $175425 - $212800) Amazon.com is an Equal Opportunity - Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation Basic Qualifications: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience

Sr Applied Scientist, Generative AI/ML Seattle posted: Posted 24 Days Ago

Nocturnist | Paid PTO | APP Support | Reno, NV | Tahoe Lifestyle Sparks, NV, US Opportunity Details We are seeking a full-time Board Eligible/Board Certified Hospitalist Nocturnist to join the Northern Nevada Health System's expanding hospitalist team in beautiful Reno, Nevada. This opportunity offers competitive compensation, a great schedule, paid PTO, and the support of a collaborative hospitalist team. You'll practice in a thriving, growing region with access to world‑class outdoor recreation and a strong, family‑friendly community. Position Overview Employment Type: Full-time Schedule: 6 am to 6 pm; 7 days on/7 days off rotation Call: None Patient Volume: Typically about 8 admissions per shift (varies) Practice Setting: Northern Nevada Medical Center, with optional shifts at the Sierra Medical Center Support/Care Team: APP admission support Technology: Cerner EMR Please note: This position is not J1 or H1-B Visa Eligible Responsibilities Collaborate with physicians and support staff Admit, evaluate, diagnose, treat, and provide generalist consultation to adult patients with common and complex illnesses Timely completion of documentation, query responses, and billing Document care using Cerner Compensation & Benefits Competitive Salary: Earn between $2,000 and $2,075 per 12-hour shift (based on experience) Quality Bonus Productivity Bonus PTO Commencement bonus Relocation Assistance No State Income Tax Student Loan Assistance Available CME Reimbursement Annual Licensure and Dues Reimbursement Health, Dental, Vision & Retirement 401K Matching Program

Staff Analyst, Data Analysis Staff Analyst, Data Analysis

Senior Applied Scientist, Entertainment Devices & Grocery Experiences (EDGE) Ads New York, New York, USA We are seeking an Senior Applied Scientist for our Entertainment Devices & Grocery Experiences (EDGE) Ads team. This team addresses challenging content and ads optimization problem related to how advertisements are priced, selected, allocated and shown to customers on Amazon devices including Prime Video, Fire TV, Alexa, Fire Tablet and Amazon Stores. As Senior Applied Scientist, you will be responsible for improving advertising performance and delivering innovative advertising experiences for display and video ads on Amazon Devices. We are innovating for the next generation of conversational ads and agentic ai driven ads experience. This team leads initiatives to improve advertising fundamentals such as relevance, coverage, CTR, and CPSU (cost per sign up for streaming services) which in turn increase advertising revenue across Amazon's devices worldwide. You will own the scoping, implementation, and launch of science based ad solutions and experiences specifically for these entertainment focused environments. Key job responsibilities - Gain a comprehensive understanding of the customer lifecycle journey with Amazon Ads, and develop sophisticated models to optimize various conversion KPIs for enhanced marketing effectiveness. - Develop scalable data processing pipelines and architectures to ingest, transform, and enrich Customer data from various sources (Retail, Prime Video, FireTV, Alexa+ and AppStore). - Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production; work closely with product managers and engineers to launch your models to customers. - Drive innovation within your team and

Staff Machine Learning Systems Engineer Remote - United States Reddit is a community of communities. It's built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 126 million daily active unique visitors, Reddit is one of the internet's largest sources of information. For more information, visit www.redditinc.com . Who We Are: The Machine Learning Platform team at Reddit is a high-impact team that owns the infrastructure that powers recommendations, content discovery, user and content quantification, while directly impacting other teams such as Growth, Ads, Feeds, and Core Machine Learning teams. What You'll Do: As a Staff ML Infrastructure Engineer, you will lead development of a platform for large scale ML models at Reddit. - Design end-to-end model lifecycle patterns (MLOps) to boost velocity of development for ML engineers, including data preparation, model management, experiment tracking, and more - Zero-to-one development and support of a graph ML codebase and platform that abstracts away common patterns and enables greater model scalability and iteration - Collaborate with ML engineers on performance tuning, including improving model training time, efficiency, and GPU training costs in a large, distributed ML training environment - Optimize batch data processing within a data warehouse and with tools such as Apache Beam, Apache Spark, Ray Data, and more - Architect pipelines to build and maintain massive graph data structures

Senior Commercial Data Advisor CA-AB-Calgary posted: Posted 7 Days Ago

Staff Software Engineer - Applied Performance Group US-CA-Menlo Park, Menlo Park, California, United States At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Applied Performance Group (APG) Engineering team provides a highly strategic function at Snowflake, with direct impact to our product direction, as well as to our bottom line. APG engineers are a key bridge between Engineering and our Sales organization, support organization, and other engineering organizations at Snowflake. They are called on to help with our most challenging customer performance issues, and help deliver some of our biggest deals. In addition, APG plays a strategic role in competitive benchmarking, defining and/or utilizing industry benchmarks to compare Snowflake performance against our competitors. APG Engineers are at the cutting edge of innovation at Snowflake, pioneering Snowflake deployments with the newest technology and working with Engineering and Product Management to continuously improve

Sr. Applied Scientist, Selling Partner Communities (SPC) Seattle, Washington, USA The Selling Partner Communities (SPC) organization is dedicated to ensuring every Selling Partner (SP) achieves satisfaction with their Amazon selling experience. SPC serves as a vital bridge between sellers/vendors and Amazon, creating and managing platforms where they can connect, share knowledge, and receive help. The team's mission encompasses listening to SP feedback, advocating for experience improvements, and empowering SPs through effective, relevant, and timely communications that demonstrate Amazon's commitment to building lasting partnerships. We are seeking a Sr. Applied Scientist to join our Communities team. The successful candidate is a skilled scientist capable of putting theory into practice through experimentation and invention, leveraging science techniques and implementing systems to work on massive datasets in an effort to tackle never-before-solved problems. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. Key job responsibilities The Senior Applied Scientist in the Selling Partner Communities (SPC) organization plays a crucial role in developing and implementing advanced AI and machine learning solutions to enhance the selling partner experience on Amazon. This role requires strong ownership of all technical aspects throughout the full project lifecycle, while partnering closely with the business to define requirements and exercise good judgment in balancing speed and complexity. As a senior AS on our team you will: - Handle challenging problems that directly impact millions of selling partners - Independently collect and analyze data - Design,

Power Apps Developer Voluntari posted: Posted 7 Days Ago

Master Data Developer Melaka (Malaysia)

Data Scientist -CDD (Maternity Cover) LU GICL Why this role matters In this role, you will help shape how data and AI contribute to smarter, more sustainable mobility solutions. As part of the Data Science & Analytics group, your work will support the development of tire intelligence services that enable better decision-making for fleet customers. You will collaborate closely with product, business, and technical teams to turn complex data into practical, scalable solutions. Your contributions will help bring innovative ideas from concept to real-world application, strengthening the organization's ability to deliver meaningful, data-driven impact. What will you do Partner with product owners and stakeholders to identify opportunities for data-driven and AI-based solutions Design and support the development of AI solutions from concept through to deployment Explore, clean, and model data to generate insights and support large-scale data science initiatives Collaborate with data scientists and engineers to scale solutions and maintain robust ML pipelines (CI/CD) Ensure solution quality through best practices such as testing, code reviews, and monitoring Coordinate research collaborations and contribute to project delivery, reporting, and knowledge sharing What we're looking for PhD or Master Degree in Data Science, Mathematics, Computer Science, or a related field Experience with machine learning and advanced analytics on large datasets Familiarity with deploying and maintaining ML models in cloud environments (e.g., AWS or Azure) Strong foundation in applied mathematics (statistics, linear algebra, optimization) Experience with data science and software engineering tools (e.g., Python, Spark, Git, CI/CD practices) Ability to collaborate across teams and

Senior Applied Scientist, Amazon Leo Data Science Platform Redmond, Washington, USA Amazon Leo is Amazon's low Earth orbit satellite network. Our mission is to deliver fast, reliable internet connectivity to customers beyond the reach of existing networks. From individual households to schools, hospitals, businesses, and government agencies, Amazon Leo will serve people and organizations operating in locations without reliable connectivity. The Role As a Senior Applied Scientist in Project Leo, you'll be leading us in making critical and time sensitive decisions that impact customers. You'll use your machine learning expertise to build solutions that can scale and solve the business problem, and your engineering experience to build systems that take those solutions to production; it's an exciting opportunity to apply data science to help improve fraud detection accuracy, inference, and customer experience monitoring activity. It's fast paced, data driven, and impactful. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities The position requires hands-on expertise in Analytics to identify and isolate issues, Statistical Modeling and traditional Machine Learning, the ability to write queries to aid in data extraction, and the ability to productionalize models. This role is a self sufficient scientist that can source data, build and evaluate models, and ultimately take those models and rules to deployment. You should have excellent communication skills and be able

Technical Account Management Team Lead - EMEA Paris Join Pigment: The AI Platform Redefining Business Planning Pigment is the AI-powered business planning and performance management platform built for agility and scale. We connect people, data, and processes in one intuitive, feature-rich solution, empowering every team-from Finance to HR-to build, adapt, and align strategic plans in real time. Founded in 2019, Pigment is one of the fastest-growing SaaS companies globally. Industry leaders like Unilever, Snowflake, Siemens, and DPD use Pigment daily to make more informed decisions and confidently navigate any scenario. With a team of 600+ across Paris, London, New York, Toronto, San Francisco and Austin, we've raised nearly $400M from top-tier investors and were named a Visionary in the 2024 Gartner® Magic Quadrant™ for Financial Planning Software. At Pigment, we take smart risks, celebrate bold ideas, and challenge the status quo-all while working as one team. If you're driven by innovation and ready to make an impact at scale, we'd love to hear from you. The Success Advisory team provides expertise across the Customer Success organization through: Paid offerings: We design, own and deliver Pigment Success Plans, structured packages that support customers on Solution Architecture, Technical Solutions and Change Management. Strategic Engagements: We lead expert engagements in Solution Architecture, Technical Solutions and Change Management that are critical to customers' success. Our mission is to deliver high-impact expertise engagements that drive adoption and long-term customer success. The Success Advisory team provides expertise across the Customer Success organization through: Paid offerings: We

Family Medicine NP | 4-Day Schedule | Nevada - Reno - Tahoe | No State Income Tax Sparks, NV, US Opportunity Details The Pinnacle Medical Group is seeking a full-time Nurse Practitioner (NP) or Physician Associate/Physician Assistant (PA) to provide outpatient primary care in breathtaking Reno, Nevada! This position is perfect for an NP/PA who wants to join a premier provider of top-quality primary care services in a team-based atmosphere. Please note: This position is not available for a J1 or H1B visa sponsorship. Quick Facts Employment Type: Full-time Schedule: 4x10s Call: Once per year, for a week Patient volume: 20 per day on average (varies) Practice Setting: Clinic Support/Care Team: MA EMR: ECW Position Responsibilities Collaborate with physicians, APPs, and support staff Manage day-to-day clinical responsibilities Document care using EMR Compensation & Benefits Competitive Compensation with a guaranteed base salary of $150K (salary offers will be based on experience) Commencement bonus Malpractice Insurance & Tail Coverage PTO, CME & Licensure Allowance No State Income Tax Qualifications Active or the ability to obtain a Nevada NP or PA license Required: 2+ years of experience (following training) About Reno-Tahoe Reno offers: No State Income Tax Four-season climate with 300+ days of sunshine A quick 45‑minute drive to Lake Tahoe World‑class skiing, hiking, mountain biking, and water sports Vibrant and safe neighborhoods with excellent school options Thriving downtown with restaurants, breweries, arts, and year‑round events Access to the University of Nevada, Re

Staff AI/ML Engineer 2 Locations posted: Posted 10 Days Ago

Data Scientist II - AMZ26888.1 Mountain View, California, USA Employer: Amazon Web Services, Inc. Position: Data Scientist II Location: Mountain View, CA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. (40 hours / week, 8:00am-5:00pm, Salary Range $157300 - $212800) Amazon.com is an Equal Opportunity - Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation Basic Qualifications: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience in the

Powerplant Integration Engineer Getafe Area posted: Posted Today