Spark jobs

AI Engineer New York | Hybrid | Remote ABOUT CINDER Cinder provides a cutting-edge platform to protect the internet. Cinder safeguards the interaction layer: the front end of products that users engage - and sometimes abuse. Our AI agents, integrated workflow platform, and deep expertise power real-time integrity at the speed of innovation. We support some of the most important and innovative companies in the world, including OpenAI, Midjourney, and ElevenLabs. Cinder is backed by Accel and Y Combinator. We care deeply about being relentless, intentional, and empathetic. We hire gritty thinkers who set ego aside, aggressively solve customer problems, and get better every day. We're building an enterprise-grade platform to make the internet safer and we need highly curious, hard-working self-starters. Cinder is seeking an AI/ML engineer to architect and deploy production AI systems at scale. You'll contribute to the strategic vision for machine learning and AI at Cinder, collaborating with data and software engineers to build world-class AI capabilities that directly impact our product and business outcomes. We're looking for an engineer first - someone who builds, ships, and maintains production systems rather than writing papers. If you've taken ML models from experimentation to production at scale, navigated the messy realities of real-world data, and understand that robust infrastructure matters as much as model performance, we want to talk. WHAT YOU'LL DO: - Own the complete lifecycle of large language model implementation: from data preparation and fine-tuning through rigorous evaluation and production deployment. - Develop automated evaluation frameworks

Solutions Architect - Emerging Enterprise United States P-344 At Databricks, our customers challenge us with solving some of the world's toughest data problems. Our customers rely on our Solutions Architect team to understand the technologies that power our platform, the broader cloud and technology ecosystems, and how they can all be brought together to solve these problems. Solutions Architects at Databricks lead the adoption of the Databricks Unified Analytics Platform. As a member of our team, you will sharpen your skills on open-source projects such as Apache Spark™, MLflow, and Delta Lake to advocate the Lakehouse paradigm on public cloud providers. You will gain expertise in cloud platforms, data engineering, data analytics, data science, and machine learning. In this customer-facing role, you will identify use cases for Databricks, develop architectures and solutions using our platform, and guide customers through implementations to deliver strategic business value. You will partner with the sales team to build relationships with our customers and establish yourself as a trusted advisor. Databricks' culture thrives on collaboration and teamwork, and you will contribute your knowledge to our teams by participating in our subject matter expert groups. In this role, you will report to the Solutions Architect Leader supporting the specific business segment. If you are a technologist interested in Data and AI, and enjoy prototyping solutions for customers, this role is for you. The impact you will have: - Provide technical leadership for customers to evaluate and adopt Data and AI solutions from Databricks - Consult on

Production Scheduler (Weekend Shift 6am-6pm) Newark, Delaware posted: Posted 2 Days Ago

Sr. Principal Electrical Engineer, Microgrid Modeling San Jose, California posted: Posted 30+ Days Ago

Senior Software Engineer, Data Engineering San Francisco, CA, United States At Ripple, we're building a world where value moves like information does today. It's big, it's bold, and we're already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more places around the world. And we get to do the best work of our career and grow our skills surrounded by colleagues who have our backs. If you're ready to see your impact and unlock incredible career growth opportunities, join us, and build real world value. At Ripple, we're building a world where value moves like information does today. It's big, it's bold, and we're already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more places around the world. And we get to do the best work of our career and grow our skills surrounded by colleagues who have our backs. If you're ready to see your impact and unlock incredible career growth opportunities, join us, and build real world value. Ripple is building the Internet of Value to move money as fast as information. To do that securely, we must establish trust at the very first interaction! As a Senior Software Engineer, you will build the platform where every customer journey begins. You are

Data Scientist NY - New York, 1407 Broadway Floor 12 posted: Posted Today

Solutions Architect: Data & AI Bengaluru, India FEQ227R52 As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible data-driven outcomes through the use of our Databricks Lakehouse Platform, helping data teams complete projects and integrate our platform into their enterprise Ecosystem. You'll grow as a leader in your field, while finding solutions to our customers' biggest challenges in big data, analytics, data engineering and data science problems. The impact you will have: - You will be a Big Data Analytics expert on aspects of architecture and design - Lead your clients through evaluating and adopting Databricks including hands-on Apache Spark™ programming and integration with the wider cloud ecosystem - Support your customers by authoring reference architectures, how-tos, and demo applications - Integrate Databricks with 3rd-party applications to support customer architectures - Engage with the technical community by leading workshops, seminars and meet-ups - Together with your Account Executive, you will form successful relationships with clients throughout your assigned territory to provide technical and business value What we look for: - Strong consulting / customer facing experience , working with external clients across a variety of industry markets - Core strength in either data engineering or data science technologies - 8+ years

Staff Engineer - Electrical Systems, EMI and Lightning Lynn posted: Posted Yesterday

Senior External Development Manager Sparks Glencoe, Maryland, United States Who We Are MAKE LIFE EPIC Founded in 1996, Firaxis Games is a world-renowned game development studio with an unwavering mission to “build games that stand the test of time”. The name Firaxis, a fusion of “fiery” and “axis,” communicates the company's dynamic development process that results in the creation of ground breaking titles with unparalleled gameplay delivered to gamers around the world. Under the creative direction of industry legend Sid Meier, Firaxis has released dozens of hit games on multiple platforms and is recognized as an industry leader in game development. CORE VALUES: GAMEPLAY FIRST Let gameplay drive decision making BE ACCOUNTABLE Deliver great work for the studio, the team & yourself PEOPLE FOCUSED Maintain an environment where people are happy EMBRACE ENTHUSIASM Find opportunities to contribute and collaborate WORK SMART Put effort where it pays off the most What We Need The Senior External Development Manager is accountable for the end-to-end management of external development partnerships at the project level. This role owns and drives the external development pipeline across all disciplines, ensuring partners deliver assets and content on schedule, within scope, and at the highest quality standards. The Senior External Development Manager establishes and evolves production practices that integrate external partner contributions with internal development teams while maintaining the flexibility to support internal production efforts as project demands shift. What You Will Do - Partner & Pipeline Management: Own the full lifecycle of external partnerships, including onboarding, offboarding,

Lead Streaming Platform Engineer London -

Senior Power Engineer Redmond, WA, US, Mountain View, CA, US

Senior Product Manager, Google Cloud Dataproc Bengaluru, Karnataka, India At Google, we put our users first. The world is always changing, so we need Product Managers who are continuously adapting and excited to work on products that affect millions of people every day. In this role, you will work cross-functionally to guide products from conception to launch by connecting the technical and business worlds. You can break down complex problems into steps that drive product development. One of the many reasons Google consistently brings innovative, world-changing products to market is because of the collaborative work we do in Product Management. Our team works closely with creative engineers, designers, marketers, etc. to help design and develop technologies that improve access to the world's information. We're responsible for guiding products throughout the execution cycle, focusing specifically on analyzing, positioning, packaging, promoting, and tailoring our solutions to our users. In this role, you will be responsible for Google Cloud Platform (GCP) Data Analytics' big data analytics portfolio for Spark and other open source components in Dataproc and Serverless Spark. Google Cloud accelerates every organization's ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. Drive the new set of innovation and growth powering open source analytics at scale on Google Cloud. Work

Sr. Staff Network Engineer San Jose, California posted: Posted 30+ Days Ago

Azure/AWS/Databricks Data Engineer 2 Locations posted: Posted 30+ Days Ago

Software Engineer III Bethesda, Maryland, United States; Waltham, Massachusetts, United States ZoomInfo is where careers accelerate. We move fast, think boldly, and empower you to do the best work of your life. You'll be surrounded by teammates who care deeply, challenge each other, and celebrate wins. With tools that amplify your impact and a culture that backs your ambition, you won't just contribute. You'll make things happen-fast. About the Role: We are seeking an experienced Software Engineer III (Data) to join our fast-paced, collaborative data team. In this role, you will have broad authority to drive the direction of our technographic data services, building world-class data pipelines and systems to process billions of signals and data points. This is an exciting opportunity to solve challenging problems and make a big impact as we invest in making technographics a first-class offering. What You'll Do: - Build and optimize big data pipelines to extract and process signals from the web, job postings, and other sources - Design and implement data architectures and storage solutions to efficiently handle massive data volumes - Collaborate closely with data scientists to support and integrate ML models into data workflows - Continuously improve data quality, performance, and scalability of our technographic data platform - Drive technical strategy and roadmap for the data processing infrastructure. What We're Looking For: - Extensive experience building and scaling big data pipelines and architectures from scratch - Deep expertise in big data frameworks (Hadoop, Spark ) and the JVM stack (Java, Scala

Senior Lead Data Engineer (Pyspark, ETL, Redshift, AWS, Data warehousing) IND - Karnataka - Bengaluru - North posted: Posted 28 Days Ago

Named Core Account Executive Remote - Massachusetts; Remote - New York; United States SLSQ227R438 Locations: East Coast As an Named Core Account Executive in Databricks', you are an enterprise sales professional experienced in selling to Enterprise accounts specifically in teh DNB space. You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about communicating its value to Customers and System Integrators. Always looking for new opportunities, you will close new accounts while maintaining existing accounts. Along with the chance to close exciting deals and solve meaningful problems, we also offer accelerators above 100% quota attainment. You will report to the Director of Enterprise Sales. The impact you will have: - Present a territory plan within first 90 days - Meet with CIOs, IT executives, LOB executives, Program Managers, and other important partners - Close both new accounts and existing accounts - Identify and close quick, small wins while managing longer, complex sales cycles - Exceed activity, pipeline, and revenue targets - Track all customer details including use case, purchase time frames, next steps, and forecasting in Salesforce - Use a solution-based approach to selling and creating value for customers - Promote Databricks' enterprise cloud data platform powered by Apache Spark - Ensure 100% satisfaction among all customers - Prioritize opportunities and applying appropriate resources - Build a plan for success internally at Databricks and externally with your accounts. What

Engineering Manager - Link Key Accounts Germany - Berlin Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $3B in revenue in our last fiscal year with extensive growth potential ahead. At the heart of Veeva are our values: Do the Right Thing, Customer Success, Employee Success, and Speed. We're not just any public company - we made history in 2021 by becoming a public benefit corporation (PBC), legally bound to balancing the interests of customers, employees, society, and investors. As a Work Anywhere company, we support your flexibility to work from home or in the office, so you can thrive in your ideal environment. Join us in transforming the life sciences industry, committed to making a positive impact on its customers, employees, and communities. The Role This is your chance to architect the data engine that powers Veeva Link. As the Engineering Manager for the Link Key Accounts team, you aren't just managing people; you are solving a complex data puzzle. Our data has massive up-and-downstream dependencies across the Link Key Accounts product. Your challenge is to define and build resilient data pipelines that can handle this complexity while balancing local autonomy with global alignment. You will lead a high-performing team to build a scalable, modern platform using Apache Spark, Lakehouses, and AWS Redshift. If you want to lead a team where technical architecture and people development

(Senior) Data Team Lead 4 Locations posted: Posted 30+ Days Ago

Omnichannel Data Steward Tokyo, Japan posted: Posted 10 Days Ago

Senior Machine Learning Engineer II, Ads Response Prediction United States - Remote We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we're building the team to help push our shopping cart forward. If you're ready to do the best work of your life, come join our table. Instacart is a Flex First team There's no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work-whether it's from home, an office, or your favorite coffee shop-while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview As a Senior Machine Learning Engineer II on the Ads Response Prediction team, you will lead the design and development of core ML models that power Instacart's ads ecosystem. This is a research-leaning role focused on theoretical problem formulation, training methodology, and model quality rather than infrastructure or full-stack engineering. You

DCEO Chief Engineer, DCC Communities Sparks, Nevada, USA AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. Amazon Web Services (AWS) is looking for an individual to join our Data Center Engineering Operations Team. This committed group works to maintain the critical physical infrastructure that supports Amazon Web Services. Specifically, this team works to ensure that the data center's MEP operates at 100% availability while maintaining first-class customer service to the teams and groups within the data centers. The Data Center Chief Engineer (CE) is responsible for ensuring that all electrical, mechanical, and fire/life safety equipment within the data center is operating at peak efficiency. This involves

Powerhouse Engineer - 2nd shift United States - Ohio - Columbus posted: Posted 4 Days Ago

Senior Software Engineer - Kafka/Streaming Team Hungary > Budapest posted: Posted 11 Days Ago