Spark jobs

Data Center Logistics Technician, DCC Communities Sparks, Nevada, USA AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. The Site Logistics Technician reviews Data Center inventory, inbound shipments, and ongoing demand to ensure that proper stock levels are maintained in the all locations to support build and repair activities. Working with the Logistics Manager, they create plans to optimize the flow of parts through their lifecycle; tracking inventory locations, movements, age, and turns. They work closely with Data Center Operations Technicians and Data Center Engineers to fulfill parts quickly and accurately. They work with Procurement and Hardware Engineering to purchase new parts and interface directly with vendors

Estimator, Services 2 Locations posted: Posted 30+ Days Ago

Senior Software Engineer - Data Infrastructure San Francisco HQ, San Francisco, California, United States, Seattle Office We believe that the way people interact with their finances will drastically improve in the next few years. We're dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid's network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Washington D.C., London and Amsterdam. Making data driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide tooling and guidance to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. Engineers on Data Infrastructure are domain experts in Data Warehouse, Data Lakehouse, Spark, Workflow Orchestration, and Streaming technologies. We scale our existing data pipelines in a performant and cost efficient way while creating the necessary abstractions to make developing on top of this platform

Lead Engineer- Data Solutions Bangalore, IN posted: Posted 30+ Days Ago

Senior Solutions Engineer Denmark REQ# FEQ127R23 At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team who values innovation and creativity, using your skills to create customized solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! The impact you will have: - Form successful relationships with clients throughout your assigned territory to provide technical and business value in collaboration with an Account Executive and a Senior Solutions Architect. - Gain excitement from clients about Databricks through hands-on evaluation and Spark programming, integrating with the wider cloud ecosystem and 3rd party applications. - Contribute to building the Databricks technical community through engagement at workshops, seminars, and meet-ups. - Become a Big Data Analytics advisor on aspects of architecture and design. - Support your customers by authoring

Software Engineer, Ads Remote - United States Reddit is a community of communities. It's built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 126 million daily active unique visitors, Reddit is one of the internet's largest sources of information. For more information, visit www.redditinc.com . Reddit has a flexible workforce! If you happen to live close to one of our physical office locations our doors are open for you to come into the office as often as you'd like. Don't live near one of our offices? No worries: You can apply to work remotely in any country in which we have a physical presence. Role Description: This is a generalist mid-level backend position within the Ads Organization. Ads is the fuel that powers Reddit's mission. As a backend engineer on the team, candidates might work on: - Microservices and APIs that power our advertiser-facing product, ads.reddit.com - Distributed systems that ensure the right ad gets shown to the right user at the right time - Backends that power interactive user experiences on our ads like Polls and Games - Real time, data intensive systems that measure the performance of our ad campaigns - Infrastructure that supports all of the above Technologies used on the team include: - Languages: Go, Python, Scala - Frameworks: Spark, Thrift, Baseplate, Kafka -

Senior Process Engineer Fremont, California posted: Posted 16 Days Ago

Senior Staff Engineer-NPI Office - Bangalore IT/BT Park posted: Posted 17 Days Ago

Senior ML Platform Engineer 6 Locations posted: Posted 7 Days Ago

Software Engineer, Data Platform Warsaw A Career with Point72's Technology Group As Point72 reimagines the future of investing, our Technology group is constantly improving our company's IT infrastructure, positioning us at the forefront of a rapidly evolving technology landscape. We're a team of experts experimenting, discovering new ways to harness the power of open source solutions, and embracing enterprise agile methodology. We encourage professional development to ensure you bring innovative ideas to our products while satisfying your own intellectual curiosity. We're looking for individuals that are highly proficient in their respective technology platform, articulate, solution driven, client focused, and proactive in building their technology skills. What you'll do You will be part of the team that builds a multitenant data platform to onboard internal and external data sources and perform a central role in data ingestion, consumption, and cataloguing. You will join a team of experts in data pipelines focusing on data streaming and acquisition, storage of the data in multiple forms (raw, normalized, operational vs historical), ELT, transformation, distribution, access layers for different types of technical access and entitlements. Building and enhancing our data platform includes applying data lake components with raw data, joined operational data, a warehouse for history and API, and an access layer, across on prem and cloud technologies and clients. In this role, you will be responsible for leading and providing best practices for the team managing the Data Platform on AWS for our Firm. You will work closely with the architect/business for gathering requirements

Sr. Applied Scientist, Amazon Robotics Boston, Massachusetts, USA Are you interested in how to build AI reasoning systems that give provably correct answers? Are you excited by science at the interface of classical AI reasoning and Large Language Models (LLMs)? Would you like to apply your technology to serve operations customers better? Amazon Robotics is looking for a talented Applied Scientist in Neurosymbolic AI. You will innovate on combining language models (LMs) with classical AI reasoning. You will work with a team of scientists and engineers to achieve this. You will publish your results in papers at leading venues in AI. You will be part of a larger team and have the opportunity to work on problems such as: using LMs to generate plans, using AI reasoning to verify plan correctness, learning efficient reasoning strategies, self-improving models. You will work on basic science and on business problems in robotics, automation and fulfillment across our operations. Key job responsibilities In this role you will: • Work closely with other scientists and engineers, and be part of Amazon's diverse global science community. • Publish your research in top-tier academic venues and hone your presentation skills. • Be inspired by challenges and opportunities to invent new techniques in your area(s) of expertise. A day in the life You'll meet regularly with your technical lead and your team on your ideas, get guidance and feedback, work together on architectures and algorithms, author papers, build AI systems, all with the aim of delivering results for

Machine Learning Engineer, Firefly Services 2 Locations posted: Posted 30+ Days Ago

Data Engineer Specialist Bogota Requisition ID: 257290 Thanks for your interest in ScotiaTech, Scotiabank's new and innovative Technology hub in Bogota. Join a purpose driven winning team that promotes creativity and innovation in a fast-paced environment, where we're always committed to results, in an inclusive, diverse, and high-performing culture. Purpose A Data Engineer is responsible for building and maintaining efficient, reliable, and automated data pipelines and systems to ensure seamless data flow across the IBDF. This role focuses on ensuring data infrastructure availability, performance, and scalability through the use of automation and monitoring tools. A Data Engineer collaborates with cross-functional teams to optimize data operations and troubleshoot incidents. Accountabilities o Experience in building and maintaining data pipelines using tools like Apache Airflow, Spark or BigQuery. o Strong knowledge of database management systems (SQL, and NoSQL, e.g. PostgreSQL, MySQL, MongoDB). o Familiarity with automation and monitoring tools to ensure data infrastructure performance (e.g. Cloud Logging, Apache Airflow). o Knowledge of agile methodologies for project management and delivery. o Excellent collaboration skills with operational and infrastructure teams. o Attention to detail to troubleshoot and fix system errors. o Time management skills to respond to incidents efficiently. o Proactive mindset to optimize and improve existing processes. o 2-3 years of experience in data engineering roles f

Indirect Commodity Manager Plant 6 - BMCD posted: Posted 30+ Days Ago

Senior Software Engineer, Ads Remote - United States Reddit is a community of communities. It's built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 126 million daily active unique visitors, Reddit is one of the internet's largest sources of information. For more information, visit www.redditinc.com . Reddit has a flexible workforce! If you happen to live close to one of our physical office locations our doors are open for you to come into the office as often as you'd like. Don't live near one of our offices? No worries: You can apply to work remotely in any country in which we have a physical presence. Role Description: This is a Generalist Senior Backend Engineer position within the Ads Organization. Ads is the fuel that powers Reddit's mission. As a backend engineer on the team, candidates might work on: - Microservices and APIs that power our advertiser-facing product, ads.reddit.com - Distributed systems that ensure the right ad gets shown to the right user at the right time - Backends that power interactive user experiences on our ads like Polls and Games - Real time, data intensive systems that measure the performance of our ad campaigns - Infrastructure that supports all of the above Technologies used on the team include: - Languages: Go, Python, Scala - Frameworks: Spark, Thrift, Baseplate,

Big Data Developer - Skywise Bangalore Area posted: Posted 30+ Days Ago

Sr. Applied Scientist, Last Mile Science Bengaluru, Karnataka, IND Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so fast? Have you wondered where it came from and how much it cost Amazon to deliver it to you? If so, the WW Amazon Logistics, Business Analytics team is for you. We manage the delivery of tens of millions of products every week to Amazon's customers, achieving on-time delivery in a cost-effective manner. We are looking for an enthusiastic, customer obsessed, Sr. Applied Scientist with good analytical skills to help manage projects and operations, implement scheduling solutions, improve metrics, and develop scalable processes and tools. The primary role of an Operations Research Scientist within Amazon is to address business challenges through building a compelling case, and using data to influence change across the organization. This individual will be given responsibility on their first day to own those business challenges and the autonomy to think strategically and make data driven decisions. Decisions and tools made in this role will have significant impact to the customer experience, as it will have a major impact on how the final phase of delivery is done at Amazon. Ideal candidates will be a high potential, strategic and analytic graduate with a PhD in (Operations Research, Statistics, Engineering, and Supply Chain) ready for challenging opportunities in the core of our world class operations space. Great candidates have a history of operations research, and

Senior Staff Software Engineer - App and Partner Ecosystem Seattle, Washington RDQ126R35 About Databricks At Databricks, we empower data teams to solve the world's toughest challenges-from security threat detection to cancer drug development. Our mission is to build the best data and AI infrastructure platform, enabling our customers to focus on innovation. Our engineering teams push the boundaries of data and AI technology while ensuring our platform operates with the resilience, security, and scale that businesses need to succeed. About the Role We are developing a growing ecosystem of applications and partners on the Databricks Data Intelligence Platform. Our team creates frameworks, tools, and best practices to enable seamless integrations, helping developers and partners build impactful solutions. As a Senior Staff Software Engineer, you will define the vision, architecture, and strategy for this ecosystem. You will play a key role in enabling customers to integrate cutting-edge applications, helping developers thrive on Databricks, and shaping the future of data and AI platforms. Your Impact - Define and drive the ecosystem strategy for Databricks, a crucial pillar of our platform growth. Shape how applications and integrations enhance the Databricks experience for developers, partners, and customers. - Develop frameworks, APIs, and tools that make it seamless for partners and developers to build, integrate, and scale applications within the Databricks ecosystem. - Enable customers to integrate cutting-edge applications and specialized functionalities, helping them drive competitive differentiation and expand their AI and data capabilities. - Lead and mentor engineers across teams, providing technical guidance, architectural

Equity Research Associate - Energy New York, New York posted: Posted 3 Days Ago

Solutions Architect Greenfield(New Logo) France Paris, France FEQ327R162 The location for the role should be in the Paris region (i.e. within a commutable distance for a hybrid schedule). At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data & Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team who values innovation and creativity, using your skills to create customised solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! The impact you will have: - Form successful relationships with Greenfield (New Logo) clients in France, providing technical and business value to Databricks customers in collaboration with Account Executives. - Operate as an expert in big data analytics to excite customers about Databricks. You will develop into a 'champion' and trusted advisor on multiple issues of architecture, design, and implementation to lead to the successful adoption

Cloud Platform - Senior Engineer Storage CAN Kanata (2), ON - WR posted: Posted 2 Days Ago

Solutions Architect (Indonesia) Singapore FEQ427R102 At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and creativity, using your skills to create customized solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! The impact you will have: - Form successful relationships with clients throughout Indonesia, providing technical and business value to Databricks customers in collaboration with Account Executives. - Operate as an expert in big data analytics to excite customers about Databricks. You will develop into a 'champion' and trusted advisor on multiple issues of architecture, design, and implementation to lead to the successful adoption of the Databricks Data Intelligence Platform. - Scale best practices in your field and support customers by authoring reference architectures, how-tos, and demo applications, and help build

Staff Engineer - OIC Staff Engineer - OIC

Affiliate Counsel Palo Alto - 3160 Porter; San Francisco - 1800 Owens Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare disease, and develop life-changing medicines for patients with unmet needs as fast as humanly possible. Together we define white space, push boundaries, and empower people to solve problems. If you're someone who defies convention, join us and work alongside some of the most respected minds in the industry. Together, we'll ask "why not?" and help reengineer the future of biopharma. At BridgeBio, we value curiosity and experimentation-including the ethical & thoughtful use of AI to improve clarity, speed, and quality of work. Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare disease, and