Spark jobs

Software Engineer - APG US-CA-Menlo Park, Menlo Park, California, United States At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Applied Performance Group (APG) Engineering team provides a highly strategic function at Snowflake, with direct impact to our product direction, as well as to our bottom line. APG engineers are a key bridge between Engineering and our Sales organization, support organization, and other engineering organizations at Snowflake. They are called on to help with our most challenging customer performance issues, and help deliver some of our biggest deals. In addition, APG plays a strategic role in competitive benchmarking, defining and/or utilizing industry benchmarks to compare Snowflake performance against our competitors. APG Engineers are at the cutting edge of innovation at Snowflake, pioneering Snowflake deployments with the newest technology and working with Engineering and Product Management to continuously improve the product and

Staff Electrical Engineer 2 Locations posted: Posted 10 Days Ago

Senior Applied Scientist, Amazon AWS Agentic AI, AWS AI Fundamental Research Santa Clara, California, USA Amazon is looking for a passionate, talented, and inventive Applied Scientist with a strong machine learning background to help build industry-leading technology in generative AI and foundational models. As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in generative AI. Your work will directly impact millions of our customers in the form of products and services that make use of speech, vision and language technology. You will gain hands on experience with Amazon's heterogeneous speech, text, image and structured data sources, and large-scale computing resources to accelerate advances in machine learning and foundation models. More specifically, you will have the opportunity to impact millions of our customers by researching and building innovative solutions using Agentic AI. Agentic AI drives innovation at the forefront of artificial intelligence, enabling customers to transform their businesses through generative AI solutions. We build and deliver the foundational AI services that power the future of cloud computing, helping organizations harness the potential of AI to solve their most complex challenges. Join our dynamic team of AI/ML practitioners and applied scientists who work backwards from customer needs to create novel technologies. If you're passionate about shaping the future of AI while making a meaningful impact for customers worldwide, we want to hear from you. Key job responsibilities The Senior Applied Scientist will lead the

Data DevOps Engineer Data DevOps Engineer

Data Platform Architect - Data Engineering (Streaming Solutions) US-USA-Remote, Remote, United States Minor Outlying Islands, United States At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Our Solution Engineering organization is seeking a Principal Solutions architect with Data Engineering expertise to join our Applied Field Engineering team who can provide technical leadership in working with both technical and business executives in the design and architecture of the Snowflake Cloud Data Platform as a critical component of their enterprise data architecture and overall ecosystem. In this role you will work directly with the sales team to understand the needs of our customers, strategize on how to navigate winning sales cycles, provide compelling value-based demonstrations, support enterprise Proof of Concepts, and ultimately close business. You will leverage your expertise, best practices and reference architectures highlighting Snowflake's Data Platform capabilities across data ingestion, transformation, and

Staff Frontend Engineer - Seattle Seattle, Washington At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. As a Staff Frontend Engineer, you will work with your team and product management to make insights from data simple. We are looking for engineers that are customer obsessed, who can take on the full scope of the product and user experience beyond the technical implementation. You'll set the foundation for how we build robust, scalable and delightful products. Below are some example experiences you'll create for our customers to achieve the full project lifecycle from loading data, visualizing results, creating statistical models, and deploying as production artifacts. - Design and ship reusable UI primitives and component patterns that behave consistently across consoles, enabling a write‑once, run‑anywhere model. - Define application bootstrapping and cross‑surface navigation primitives that abstract console boundaries while enforcing correct AuthZ and routing. - Deliver unified frontend data clients and service components. - Create, deploy, test, and upgrade platform components

Data Engineer-1 Year Contract, ATE Data Engineering Team Beijing, CHN Amazon ATE (Analytics Technology and Engineering) team is seeking for a contractor Data Engineer of deep expertise in creation and management of datasets. The role is responsible to build data analytical solutions that will address increasingly complex business questions, as an expert at implementing and operating stable, scalable data flow solutions from production systems into end-user facing applications/reports; working on developing solutions that provide some of the unique challenges of space, size and speed; implementing data analytics using cutting edge analytics patterns and technologies that are inclusive of but not limited to various AWS Offerings -Redshift, S3 and RDS.; working with partner teams to create dashboards for our customers. Basic Qualifications: - 1+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines - Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala) - Experience with one or more scripting language (e.g., Python, KornShell) Preferred Qualifications: - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR - Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

OpenShift Infrastructure - Senior Consultant 51 Locations posted: Posted 10 Days Ago

Data Scientist II - AMZ27022.1 San Diego, California, USA Employer: Amazon Web Services, Inc. Position: Data Scientist II - AMZ27022.1 Location: San Diego, CA Multiple Positions Available: Design and implement scalable and reliable approaches to support or automate decision making throughout the business. Apply a range of data science techniques and tools combined with subject matter expertise to solve difficult business problems and cases in which the solution approach is unclear. Acquire data by building the necessary SQL / ETL queries. Import processes through various company specific interfaces for accessing Oracle, RedShift, and Spark storage systems. Build relationships with stakeholders and counterparts. Analyze data for trends and input validity by inspecting univariate distributions, exploring bivariate relationships, constructing appropriate transformations, and tracking down the source and meaning of anomalies. Build models using statistical modeling, mathematical modeling, econometric modeling, network modeling, social network modeling, natural language processing, machine learning algorithms, genetic algorithms, and neural networks. Validate models against alternative approaches, expected and observed outcome, and other business defined key performance indicators. Implement models that comply with evaluations of the computational demands, accuracy, and reliability of the relevant ETL processes at various stages of production. (40 hours / week, 8:00am-5:00pm, Salary Range $136000 - $184000) Amazon.com is an Equal Opportunity - Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation Basic Qualifications: Master's degree or foreign equivalent degree in Statistics, Applied Mathematics, Economics, Engineering, Computer Science, or a related field and one year of experience

Energetic Engineer Cegléd (Hungary)

Software Development Engineer, Amazon Data Firehose East Palo Alto, California, USA Come build the future of data streaming with the Amazon Data Firehose (ADF) team! Amazon Data Firehose is a fully managed service for capturing, transforming, and delivering streaming data to destinations like Amazon S3, S3 Tables, Redshift, Splunk, and OpenSearch Service. It automatically scales to handle incoming data, requires no application to be written, and can perform transformations before delivery, such as format conversion or dynamic partitioning. Firehose works with billions of events and petabytes of data each day in support of many thousands of customers running mission-critical real-time applications. We are looking for a Software Development Engineer for the Amazon Data Firehose Team. The team owns all aspects of the Firehose service, including requirements, architecture, design & development, quality assurance, deployment and operations. As an engineer in this team, you will learn the ins and outs of building a highly available, scalable, distributed and secure system that uses all the modern cloud computing paradigms, techniques and tools. The ideal candidate has experience designing large-scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses skills to innovate, design and solve problems at scale. Ideally you have an in-depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark, Apache Flink, or Apache Storm. Your responsibilities will include collaborating with other engineers to build a large scale AWS service, and work with senior leaders

Senior Critical Facilities Engineer - Data Center Slough posted: Posted 4 Days Ago

[REMOTE] Principal Software Engineer – Healthcare Analytics & AI United States, US At Oracle Health, we're building the future of healthcare - cloud-native Healthcare Solutions with AI at their core, designed to operate at nation-scale. Our mission is to transform how hospitals and physicians work - enabling better patient care while ensuring accurate, timely reimbursement. We are modernizing Electronic Health Record and Revenue Cycle Management systems using LLMs and AI agents, helping clinicians focus more on patients and less on administrative burden. We're looking for highly skilled AI engineers to design and build high-scale, cloud-based data processing pipelines that ingest, transform, and analyze massive volumes of healthcare data with low latency, powering business insights and analytics across EHR and RCM systems. You will leverage LLMs, AI agents, and modern data platforms to solve problems like clinical decision support, revenue optimization, and workflow automation while using AI-assisted development tools to accelerate delivery. Key Responsibilities • Design and develop scalable data pipelines and AI-driven workflows. • Build LLM/agent-based solutions for business use cases (revenue leakage, readmissions, automation). • Own end-to-end features from data ingestion through transformation and on to insights. • Optimize systems for performance, scale, and low latency. • Mentor junior engineers and contribute to design decisions. Qualifications: • BS/MS in in Computer Science or equivalent. • 8+ years of relevant software engineering experience. • Strong software engineering skills in Python/Java. • Strong knowledge of SQL. • Deep expertise in data engineering: ETL, data transformation, data modeling (Spark, SQL) • Experience

Data Scientist 2 Locations posted: Posted 3 Days Ago

AIML - Machine Learning Engineer - Computer Vision & Audio, MIND Seattle, United States of America The Machine Intelligence, Neural Design (MIND) team, part of Apple's AIML organization, is leading Apple-wide innovation on HW/SW co-design for efficient inference. With roots in ML, computer vision, and energy efficiency research, our team is strategically positioned to contribute to diverse initiatives ranging from shipping features in well-known Apple products to ambitious, long-term research projects. We are seeking a hands-on Machine Learning Engineer to drive the data & evaluation lifecycle for our production models. In this role, you will focus on designing and scaling high-performance data processing pipelines, ensuring data quality, performing in-depth failure analysis on production models, and implementing advanced data augmentation techniques to boost model performance. This includes but is not limited to crafting creative techniques to analyze audio & video datasets, designing metrics to understand user behavior & evaluate performance of machine learning models. You will innovate across the entire end-to-end ML production pipeline, bridging the gap between hardware, software, and modeling, ensuring our ML systems are robust, efficient, and scalable. We are seeking a Machine Learning Engineer to design and deliver innovative features and models that advance our ML systems. In this role, you will scale model evaluation workflows, build robust data pipelines, and optimize performance across the stack. Your responsibilities will include: * Pipeline Scaling & Optimization: Design, build, and maintain scalable ETL/ELT data pipelines using tools like Spark, & Airflow to handle large-scale datasets. Optimize existing pipelines for

Senior Demand Generation Manager San Francisco | [Hybrid] | Remote

Optical Networking Research Post-Doc Greece, Athens posted: Posted 2 Days Ago

Sr Manager Research Science, Last Mile Science and Analytics Bengaluru, Karnataka, IND Have you ever wondered how that Amazon box with the smile arrives so quickly, where it came from, and how much it cost Amazon to deliver? The WW Amazon Logistics, Business Analytics team manages the delivery of tens of millions of products every week to Amazon's customers, achieving on-time delivery in a cost-effective manner. We are seeking an enthusiastic, customer-obsessed Sr. Manager Research Science with strong analytical skills to join our team. This role is crucial in optimizing Amazon's vast delivery network and will have significant impact on the customer experience, particularly in the final phase of delivery. As a Sr. Manager Research Science, you will: 1. Address business challenges through building compelling cases and using data to influence change across the organization 2. Develop input and assumptions based on preexisting models to estimate costs and savings opportunities associated with varying levels of network growth and operations 3. Create metrics to measure business performance, identify root causes and trends, and prescribe action plans 4. Manage multiple high-impact projects simultaneously 5. Work with technology teams and product managers to develop new tools and systems supporting business growth 6. Communicate with and support various internal stakeholders and external audiences 7. Implement scheduling solutions, improve metrics, and develop scalable processes and tools The ideal candidate will have: - Extensive experience in operations research and data-driven decision making - Strong analytical and problem-solving skills - Robust program management and research science skills

Staff Security Detection Engineer United States As part of the Security Detection team at Databricks, you will play a critical role in safeguarding our products, cloud infrastructure, endpoints, and employees from modern cyber threats. Our team combines deep expertise in machine learning, log analysis, cybersecurity, and software development to create a robust and scalable detection platform. Embracing the "Detection-as-Code" model, we build detections on our own Databricks platform, ensuring that our security measures are deeply integrated with our technology stack. In this role, you will work with cutting-edge machine learning techniques to design and implement scalable intrusion detection solutions at the enterprise level. You'll partner with our product and data engineering teams to optimize log ingestion pipelines, fuse diverse log sources, and develop anomaly-based and ML-driven detection strategies. You will be instrumental in enhancing the organization's threat detection capabilities by utilizing novel data sources, exploring new attack vectors, and refining our detection models. You will be an individual contributor on the Security Detection team at Databricks, reporting to the Sr Manager of Detection Engineering. Key Responsibilities: - Design and implement advanced detection strategies by deeply understanding and analyzing new or unknown log sources, schemas, and raw data. - Collaborate with cross-functional teams, including product and data engineering teams, to build efficient log ingestion pipelines and support large-scale data analytics. - Engineer and deploy detection solutions on Databricks using Spark, Python, and other cutting-edge technologies with a strong emphasis on clean code, rigorous testing, and comprehensive documentation. - Develop Rule-based and/or

Renewables Lead

Senior Member of Technical Staff - US Citizenship Required United States, US We're looking for highly skilled AI engineers to design and build high-scale, cloud-based data processing pipelines that ingest, transform, and analyze massive volumes of healthcare data with low latency, powering business insights and analytics across EHR and RCM systems. You will leverage LLMs, AI agents, and modern data platforms to solve problems like clinical decision support, revenue optimization, and workflow automation while using AI-assisted development tools to accelerate delivery. Responsibilities As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or operating systems. Provide technical leadership to other software developers. Specify, design and implement modest changes to existing software architecture to meet changing needs. Key Responsibilities Build and enhance data pipelines, ETL workflows, and transformations. Contribute to LLM/agent-based features and analytics use cases. Work with EHR/RCM datasets and support KPI/dashboard development. Learn and apply best practices in cloud, data engineering, and LLMOps. Mandatory Qualifications: BS/MS in in Computer Science or equivalent. 5+ years of relevant software engineering experience. Strong software engineering skills in Python/Java. Strong knowledge of SQL. Deep expertise in data engineering: ETL, data transformation, data modeling (Spark, SQL) Experience building high-scale distributed data systems. Cloud experience (OCI/AWS/Azure). Experience with creating major new functionality in a software system all the way from design, through development and testing to production deployment. Experience with collaborating across multiple functional areas to develop

Business Support Data Analyst - Talent Pool Warsaw, Poland | N/A

Sr. Applied Scientist, Prime Video - Personalization and Discovery Science Seattle, Washington, USA Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports - including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video technologist, you'll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You'll get to work on projects that are fast-paced, challenging, and varied. You'll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We'll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! We are looking for a self-motivated, passionate and resourceful Applied Scientist to bring diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. You will

AI ML Data Engineer Chennai, India posted: Posted 30+ Days Ago