Spark jobs

Sr. Applied Scientist, Applied AI Solutions Seattle, Washington, USA The newest business group in AWS, Applied AI Solutions are built by AWS and AWS Partners to deliver applied AI solutions that leverage Amazon's operational expertise and that businesses love and trust for their day-to-day success. Our ambition is to become a partner which companies can rely on to run their business every day, putting AI to work delivering better customer experience, operational excellence and speed. Are you excited about pushing past single-turn chat into agents that run for hours or days, planning, recovering from failure, and accumulating knowledge as they work? Do you want to design the harnesses, memory systems, and context strategies that turn frontier models into reliablen collaborators on real business problems? Do you enjoy the prospect of solving agent problems that haven't been solved at scale anywhere before, including memory decay, belief revision, fact grounding, long-horizon credit assignment, and evaluation of open-ended trajectories? Along the way, you'll get opportunities to be a disruptor, innovator, and a problem solver, someone who truly enables AI agents to create significant impacts. Key job responsibilities You will partner with cross-functional business and engineering teams to identify and deliver high-impact agentic use cases across the Applied AI Solutions portfolio. You will design, develop, and evaluate long-running agents - including orchestration harnesses, memory architectures (episodic recall, semantic facts, revisable beliefs, principled decay), context compaction strategies, and safe, auditable tool and environment designs. You will define evaluation frameworks for agents whose outputs defy single-answer

Machine Learning Engineer - II 2 Locations posted: Posted 30+ Days Ago

Senior Applied Scientist, Linear Personalization Experience Team (LPEX) Seattle, Washington, USA Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports - including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video technologist, you'll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You'll get to work on projects that are fast-paced, challenging, and varied. You'll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We'll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! Prime Video is disrupting traditional media with an ever-increasing selection of movies, TV shows, Emmy Award-winning original content, add-on subscriptions, and live events like Thursday Night Football. Within this expanding ecosystem,

Data Engineer India - Hyderabad posted: Posted 24 Days Ago

Sr. Applied Scientist, WWGS Real Estate & Store Development Seattle, Washington, USA Do you want to help shape the future of Amazon's physical retail presence? Worldwide Grocery Stores (WWGS), Location Strategy and Analytics team is looking for a Sr. Applied Scientist to join us in developing advanced forecasting models, optimization models, and analytical tools to support critical real estate and network planning decisions for Amazon's Worldwide Grocery business, including Whole Foods Market. Our team is responsible for developing predictive models and tools to support Real Estate and Topology analysts in making important decisions regarding our stores-including new store openings, relocations, closures, remodels, design, new formats, and more. We leverage statistical modeling, machine learning, and GenAI to build solutions for store sales forecasting, sales transfer effects, macrospace optimization, store network optimization, store network diffusion planning, and causal effects. As a Sr. Applied Scientist on our team, you will apply your deep technical expertise to tackle complex business problems and develop innovative solutions to improve our forecasting, decision-making capabilities, and MLOps. You will collaborate with a diverse team of scientists, economists, and business partners to identify opportunities, develop hypotheses, build internal products, and translate analytical insights into actionable recommendations for Executive Leadership. Key job responsibilities - Design and implement forecasting models and machine learning solutions to predict store performance and optimize our retail network. - Analyze large datasets to uncover insights and patterns related to store performance, customer behavior, and market dynamics. - Develop and own end-to-end solutions, tools and frameworks to

Lead Customer Application Engineer- Mechanical GB-NEWCASTLE-UPON-TYNE-WINCOMBLEE ROAD WELLSTREAM HOUSE posted: Posted 10 Days Ago

Sr. Applied Scientist, Alexa International London, England, GBR The Alexa International Science team is looking for a passionate, talented, and inventive Senior Applied Scientist with a strong background in speech models (understanding and generation) and deep learning, to help build industry-leading Generative AI technology with speech-to-speech models and multilingual systems. At this level, you will drive cross-team scientific strategy for speech quality across international locales, influence partner teams, and deliver solutions that have broad impact across Alexa's global products. Key job responsibilities As a Senior Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art in multilingual speech generation, text-to-speech synthesis, and speech-to-speech models. Your work will directly impact customers across multiple languages in the form of natural, expressive, and locale-appropriate voice experiences for Alexa+. You will leverage Amazon's heterogeneous data sources and large-scale computing resources to accelerate advances in speech synthesis, voice quality, and pronunciation accuracy for non-English locales. The ideal candidate possesses a solid understanding of machine learning, speech synthesis (TTS/S2S), multilingual phonetics, modern model architectures, and evaluation methodology. They thrive in a fast-paced environment, tackle complex challenges in low-resource language settings, excel at delivering impactful solutions while iterating based on customer feedback, and are able to influence and align multiple teams around a shared scientific vision for international speech quality. A day in the life You will start your day reviewing experiment results and iterating on model architectures for speech

Senior Cloud Engineering Lead Greece-Thessaloniki Chortiatis posted: Posted 18 Days Ago

Remote Data Engineer NO-ROGALAND-TANANGER-Kontinentalveien 8, N-4056 posted: Posted 30+ Days Ago

Sr. Applied Scientist, C360 Seattle, Washington, USA Are you a scientist passionate about advancing Information Retrieval, NLP, and Large Language Models? Do you want access to massive datasets, world-class compute, and a team of top scientists and engineers building the future of e-commerce? If so, you'll be a great fit for our team at Amazon. We build large-scale ML solutions that deliver personalized, up-to-date recommendations to millions of customers. Our team is uniquely positioned to shape how customers think about their shopping journey. We're looking for scientists with deep LLM expertise to build our next generation of models. The team focuses on post-training-instruction tuning, reward modeling, reinforcement learning, and multi-modal alignment. You'll design and run large-scale experiments, analyze model behavior, and develop training recipes that improve core capabilities like reasoning, personalization, and other frontier paradigms. Key job responsibilities - Own the scientific roadmap for personalization initiatives, identifying high-impact research directions and translating ambiguous business problems into well-defined ML formulations - Design and lead end-to-end systems spanning recommendations, information retrieval, and LLM fine-tuning, from problem framing through offline experimentation to production A/B testing and launch - Drive technical decisions on model architecture, training methodology, and evaluation frameworks, balancing scientific rigor with business impact and operational constraints - Mentor and raise the bar for the science team through design reviews, paper discussions, and establishing best practices for experimentation and reproducibility - Influence cross-functional strategy by partnering with engineering, product, and leadership to define the product vision informed by what's technically feasible and

Team Lead - Wiring Rostraver posted: Posted 30+ Days Ago

Software Development Engineer - Big Data, Brand Metrics and Benchmarks New York, New York, USA Are you passionate about Big Data, Distributed systems, and large scale datasets can be integrated with new state-of-the-art AI agent-friendly data interfaces? Be part of a team of world-class engineers and industry leading experts operating one of the largest big data platforms for advertising at Amazon scale. Key job responsibilities Join our team and take ownership of significant initiatives that solve some of the toughest technical challenges in big data: - Design and build highly scalable, fault-tolerant data pipelines processing petabytes of advertising data - Architect new data paradigms that enable real-time analytics and machine learning applications - Collaborate with data scientists, product managers, and partner teams across Amazon Ads to deliver data solutions that drive business impact - Mentor junior engineers through code reviews, design discussions, and pair programming - Contribute to technical strategy and architectural decisions for our data platform - Build monitoring, alerting, and data quality frameworks to ensure reliability at scale Our systems are built for stability and reliability, which means our on-call shifts are manageable and focused on continuous improvement rather than firefighting. About the team We're a collaborative team of engineers who are passionate about solving complex data challenges while maintaining a healthy work-life balance. Our engineers regularly work with latest technologies-recent projects include migrating our data lake to Apache Iceberg, implementing real-time streaming pipelines with Spark, and building unified and flexible reporting solutions. We invest heavily in your

Senior Data Architect Lead 2 Locations posted: Posted 30+ Days Ago

Senior Data Architect 2 Locations posted: Posted 30+ Days Ago

Senior Applied Scientist, JP Science and Data - AVS ProServe Tokyo, JPN We are seeking a talented, customer-focused Senior Applied Scientist to join the AVS ProServe Science and Data Team. In this role, you will develop and apply machine learning algorithms to solve ambiguous business problems, leading the roadmap to help vendors understand their customers, identify opportunities for growth and define long-term strategy. The ideal candidate brings deep expertise in machine learning, interpretable models, transformers, and experimentation, along with the business acumen to translate problems into scalable science solutions. We're looking for a self-starter with an entrepreneurial spirit who is comfortable with ambiguity, demonstrates strong attention to detail, and thrives in a fast-paced, data-driven environment - with a passion for driving measurable impact. Key job responsibilities • Develop customer understanding models by designing and building orchestrated ML solutions that enable vendors to deeply understand their customers and uncover growth opportunities • Bridge science and business strategy by translating model outputs into actionable insights and recommendations that inform vendor growth strategies, customer acquisition, and long-term planning • Measure and validate business impact by closing the loop between science solutions and business outcomes - establishing measurement frameworks that quantify impact, surface new opportunities, and continuously refine the path to vendor growth • Lead cross-functional collaboration by working with engineers, scientists, consultants, and business leaders to deploy scalable solutions while communicating complex technical concepts clearly to non-technical audiences • Stay at the forefront of innovation by applying state-of-the-art techniques in machine learning, interpretable

Software Development Engineer II, Amazon Security Data Engineering Herndon, Virginia, USA If you thrive in a fast-paced, innovative environment and are interested in pushing the boundaries of what's possible with big data, cloud computing, and security analytics, Amazon Security Platform Engineering is the place for you. We support a suite of services and products to ingest, optimize and query petabyte scale datasets efficiently, and enable critical security use cases such as incident response, security analytics, threat-hunting, and low-latency detection. Successful candidates for this position will possess: Strong software engineering fundamentals, including expertise in object-oriented design, algorithms, and data structures Experience building and operating scalable, fault-tolerant, distributed systems Proficiency in Java, Scala or Python with a solid understanding of multi-threading and memory management Knowledge of big data compute engines such as open table formats like Apache Iceberg, and Apache Spark, Trino, Flink. Excellent verbal and written communication skills Self-motivation and the ability to deliver high-quality results in a fast-paced environment. Key job responsibilities Build and support Amazon Security's Data Lake, consisting of services for data cataloging, optimization, compaction, re-organization, and indexing at petabyte scale. Drive technical vision and contribute to the roadmap for systems that manage petabyte-scale data catalogs supporting Apache Iceberg, AWS Glue, Parquet, and other formats. Design and implement distributed systems for data optimization that balance multiple latency scenarios from minute-level batch detections to month-spanning threat hunting queries. Modernize security intelligence platform's data catalog and governance services to provide customers with rule-based access controls and fine-grained data access. Build

Power Platform Developer (Model-driven) 6314 Remote/Teleworker US posted: Posted Yesterday

Senior Professional, Energy & Community - Converse London, United Kingdom posted: Posted Today

Senior Applied Scientist , Buyer Risk Prevention (BRP) Bengaluru, Karnataka, IND Do you want to lead the development of advanced machine learning systems that protect millions of customers and power a trusted global eCommerce experience? Are you passionate about modeling terabytes of data, solving highly ambiguous fraud and risk challenges, and driving step-change improvements through scientific innovation? If so, the Amazon Buyer Risk Prevention (BRP) Machine Learning team may be the right place for you. We are seeking a Senior Applied Scientist to define and drive the scientific direction of large-scale risk management systems that safeguard millions of transactions every day. In this role, you will lead the design and deployment of advanced machine learning solutions, influence cross-team technical strategy, and leverage emerging technologies-including Generative AI and LLMs-to build next-generation risk prevention platforms. Key job responsibilities Lead the end-to-end scientific strategy for large-scale fraud and risk modeling initiatives Define problem statements, success metrics, and long-term modeling roadmaps in partnership with business and engineering leaders Design, develop, and deploy highly scalable machine learning systems in real-time production environments Drive innovation using advanced ML, deep learning, and GenAI/LLM technologies to automate and transform risk evaluation Influence system architecture and partner with engineering teams to ensure robust, scalable implementations Establish best practices for experimentation, model validation, monitoring, and lifecycle management Mentor and raise the technical bar for junior scientists through reviews, technical guidance, and thought leadership Communicate complex scientific insights clearly to senior leadership and cross-functional stakeholders Identify emerging scientific trends and translate

BI Engineer, Prime Data Engineering and Anaytics Bengaluru, Karnataka, IND Join Amazon's Prime Data Engineering & Analytics (PDEA) team as a Business Intelligence Engineer (BIE) to revolutionize how we understand, measure and serve our global Prime customer base. You'll architect and build enterprise-level data analytics solutions, including scalable ETL pipelines, automated AI powered reporting systems, and self-service analytics platforms that process petabytes of data daily across multiple dimensions. Working with technologies like AWS, Apache Kafka, Spark, and modern AI/ML tools, you'll create data analysis products that power critical decision-making across Amazon. As a BIE, you'll be instrumental in defining and implementing key business metrics, building efficient dimensional data models, and leveraging advanced AI technologies like QuickSuite and ML-powered analytics. You'll design intuitive self-service platforms that enable business users to independently explore data, discover insights, and create automated reports. Beyond technical implementation, you'll lead end-to-end project execution, manage worldwide Prime core services data infrastructure, and establish key relationships across Amazon's business units. This role offers the opportunity to provide technical mentorship, drive architectural decisions, and shape the future of Amazon Prime's data ecosystem, directly impacting millions of customers globally. Key job responsibilities Responsibilities 1. Own design and execution of end to end projects 2. Own managing WW Prime data infrastructure 3. Establish key relationships which span Amazon business units and Business Intelligence teams 4. Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs Basic Qualifications: - 3+ years of

Data Architect India - Hyderabad posted: Posted 25 Days Ago

Senior Software Development Engineer, AI Data Platform United States, US Oracle's Forward Deployed Engineer (FDE) team is hiring a Senior Software Development Engineer - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle's Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Strong data engineering, HPC, and data science experience. Spark, PySpark, Delta Lake, Parquet, Feature Extraction, MLOps, Flink, with a deep understanding of the distributed systems techniques that make these services work. Full stack development experience. This includes web app development, RESTful APIs, SSE, all the way to deploying your solution. Design, implement, and maintain scalable software components and services that support AI/ML workloads. Build APIs, SDKs, and automation frameworks to streamline the adoption of Oracle AI Data Platform and Gen AI services. Optimize performance, scalability, and reliability of distributed data/AI systems. Collaborate with cross-functional teams (engineering, product, and field) to solve complex technical challenges. Participate in code reviews, testing, and CI/CD to ensure high-quality deliverables. Document technical designs and contribute to knowledge-sharing (e.g., blogs, internal docs, demos). Continuously explore new tools, frameworks, and best practices in AI, cloud, and data engineering. Primary Skills: Experience with LLMs and agentic frameworks (e.g., MCP, LangChain, CrewAI, Semantic Kernel).

Midstream Facilities Engineer - Mature Assets AE-DUBAI-TECHNO PARK posted: Posted 4 Days Ago

Machine Learning Engineer II Dublin, IE About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility to do your best work. Creating a career you love? It's Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we're looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we'll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . We're looking for a machine learning engineer II in our Growth Platform engineering group. You'll join a small and focussed team who will help us to understand our users better so we can drive engagement and growth, and to improve their user experience. What you'll do: - Develop and implement ML models to improve