Spark jobs

Lead - Cloud Services Sysco LABS - Sri Lanka posted: Posted 30+ Days Ago

Product Marketing Lead, Consumer Remote ClassDojo's goal is to accelerate humanity's progress, by giving every child on Earth an education they love. We started by building a network that connects teachers, children, and families. ClassDojo's flagship app is the #1 communication app connecting K-8 teachers, children, and families, globally. They use it to share what's happening throughout the day through photos, videos, messages, and activities. It is actively used at an unprecedented scale: in over 95% of US schools, reaching ~51 million children in ~180 countries, with a team of just ~200 people [1]). We are now beginning to use this network to give kids the best learning experiences in the world, far beyond those a standard school can provide. We hire for talent density. Our team comprises the most talented, entrepreneurial, and innovative teammates from around the world, with experience in education and large scale consumer internet companies, including Instagram, Netflix, Dropbox, Stripe, Uber, Y Combinator, and more. We're building a company where the most talented people want to work. We believe you'll do the best work of your life here-and you'll pioneer the future of education, too. WHAT YOU'LL DO: We're looking for a Product Marketing leader to shape the future of ClassDojo's consumer products - including Dojo Islands, Dojo Sparks, and ClassDojo Plus - used by tens of millions of families weekly. You'll work across a new generation of playful, purpose-driven experiences: from Dojo Islands, where kids explore digital worlds, to Dojo Sparks, where they joyfully learn

Associate Director, Marketing – Achondroplasia Community San Francisco - 1800 Owens Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare disease, and develop life-changing medicines for patients with unmet needs as fast as humanly possible. Together we define white space, push boundaries, and empower people to solve problems. If you're someone who defies convention, join us and work alongside some of the most respected minds in the industry. Together, we'll ask "why not?" and help reengineer the future of biopharma. At BridgeBio, we value curiosity and experimentation-including the ethical & thoughtful use of AI to improve clarity, speed, and quality of work. Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “Moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare conditions and develop

Member of Technical Staff, Data Platform Engineer San Mateo, CA About Us: At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We've been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We're an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI. The Role We are looking for a Data Platform Engineer that specializes in Order-to-Cash (OTC) Revenue Transformation and AI Application Enablement to own and evolve the end-to-end billing, revenue and business data pipeline - from usage metering and invoice generation through revenue recognition and financial reporting. You will sit at the intersection of Engineering, Finance, and Data, ensuring every dollar of usage across our five revenue streams is accurately captured, billed, recognized, and reconciled. This is a high-impact, cross-functional role. You will work hands-on with our billing platform (Orb, etc), accounting systems , data warehouse (BigQuery), and cloud marketplaces (AWS, GCP) - and ultimately help design AI-enabled workflow agents that automate reconciliation, anomaly detection, and revenue operations once the core data infrastructure is hardened. What You'll Do Phase 1 - Platform & Data Foundation - Own and enhance billing infrastructure: pricing models, usage ingestion, invoicing, and revenue

Business Development/Sales & Growth Marketing North America (6-month Internship) Paris Join Pigment: Transforming Business Planning and Performance with AI Founded in 2019, Pigment stands out as one of the fastest-growing SaaS companies globally, redefining business planning and performance with our AI-powered platform. We empower organizations across diverse industries, including Consumer Packaged Goods, Retail, and Technology, to seamlessly integrate data, people, and processes, enabling them to plan and adapt rapidly. With a vibrant team of over 500 professionals across North America and Europe, and offices in New York, Toronto, London, Paris, Austin and San Francisco, Pigment has successfully secured nearly $400 million in funding from leading global venture capitalists. Our recognition as a Visionary in the 2024 Gartner® Magic Quadrant™ for Financial Planning Software underscores our commitment to excellence, as we proudly partner with industry leaders like Unilever, Vinci, Kayak, Siemens, and Coca-Cola. At Pigment, we champion smart risks, celebrate bold ideas, and challenge the status quo-all as a united team. Every team member has the opportunity to make a significant impact and tackle ambitious challenges. Together, we pursue excellence with a collaborative spirit, continuously raising the bar to ensure strong performance and a proactive approach while fostering an environment of humility. If you are passionate about innovation and wish to collaborate with some of the brightest minds in the industry, we would love to hear from you! Join Pigment: Transforming Business Planning and Performance with AI Founded in 2019, Pigment stands out as one of the fastest-growing SaaS companies globally,

Senior Full-Stack Developer - Analytics Vancouver Employment Type: Workplace Type: About our Vancouver Office Located in the heart of downtown Vancouver, between the Pacific Ocean and the Coast Mountains, Teck's Corporate Office sits in one of Canada's most culturally diverse cities. Surrounded by world-renowned nature and globally inspired cuisine, the office brings together many of Teck's corporate functions - all working toward Teck's purpose of providing the essential resources the world relies on. Reporting to the Lead, Platform Management Systems, the Senior Full Stack Developer - Analytics will maintain and improve existing analytics applications that support operations at our mining sites. The Senior Full Stack Developer - Analytics in this role serves as a senior individual contributor who takes ownership and craftsmanship seriously. They engage with all layers of the solution stack. This ranges from infrastructure using Terraform or Crossplane on Kubernetes, through deployment pipelines in Azure DevOps, to data engineering with Azure Databricks, Spark SQL, dbt, or Python containers, and report generation via PowerBI. Don't miss out on this outstanding opportunity to be part of one of Canada's leading mining companies and join our team! Responsibilities Be a courageous safety leader, adhering to and sponsoring safety and environmental rules and procedures. Serve as a senior-level individual contributor on the Analytics Sustainment team, demonstrating outstanding troubleshooting and technical skills across the entire

Associate CloudOps Engineer Associate CloudOps Engineer

Talent Acquisition Partner (Contract) Hybrid/San Francisco, CA & Palo Alto, CA Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare disease, and develop life-changing medicines for patients with unmet needs as fast as humanly possible. Together we define white space, push boundaries, and empower people to solve problems. If you're someone who defies convention, join us and work alongside some of the most respected minds in the industry. Together, we'll ask "why not?" and help reengineer the future of biopharma. At BridgeBio, we value curiosity and experimentation-including the ethical & thoughtful use of AI to improve clarity, speed, and quality of work. Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare disease, and develop

Chief of Staff to Chief Commercial Officer of BridgeBio San Francisco - 1800 Owens Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare disease, and develop life-changing medicines for patients with unmet needs as fast as humanly possible. Together we define white space, push boundaries, and empower people to solve problems. If you're someone who defies convention, join us and work alongside some of the most respected minds in the industry. Together, we'll ask "why not?" and help reengineer the future of biopharma. At BridgeBio, we value curiosity and experimentation-including the ethical & thoughtful use of AI to improve clarity, speed, and quality of work. Mavericks Wanted When was the last time you achieved the impossible? If that thought feels overwhelming, you might want to pause here, but if it sparks excitement...read on In 2015, we pioneered a “moneyball for biotech” approach, pooling projects and promising early-stage research from academia together under one financial umbrella to reduce risk and unleash innovation. This model allows science and small teams of experts to lead the way. We build bridges to groundbreaking advancements in rare

Senior Staff Engineer, Data San Jose, California As a Senior Staff Engineer, Data, you'll be a key technical leader driving the design, implementation, and evolution of FloQast's core data platform. You will define the standards and patterns that power data ingestion, governance, storage, processing, and access across all product and analytics systems. Your work will enable teams across engineering, product, and business operations to build on a reliable, scalable, and secure data foundation. What You'll Do What You'll Bring

Senior ML Engineer, Apple Ray, Apple Data Platform Cupertino, United States of America The Apple Ray team is seeking a Senior / Staff Software Engineer with strong distributed systems expertise and a solid background in machine learning. In this hybrid role, you will design and build core components of Apple's unified data+ML platform powered by open-source Ray, while also partnering with ML teams to ensure the platform meets the needs of large-scale training and inference workloads. You will contribute to the distributed runtime, orchestration layer, and system APIs that power Apple's intelligent features across products and services. This role is ideal for a software engineer who enjoys low-level systems work but is also fluent in ML workflows and models at scale. Apple Ray integrates deeply with Apple's data and ML ecosystem to provide a unified platform for building, orchestrating, and scaling complex ML and data pipelines. As a Software Engineer with ML background, you will design distributed systems that support large-scale model training, tuning, and inference across heterogeneous compute environments-from bare-metal GPU clusters to cloud-native infrastructure. You will build features that enhance developer productivity for ML engineers, improve resource efficiency, and advance the performance and reliability of Apple's ML workloads. You'll collaborate closely with ML practitioners to translate model and pipeline needs into robust platform capabilities, while also improving the underlying distributed runtime and control plane. This role requires strong engineering fundamentals, hands-on experience with ML systems, and a passion for building scalable infrastructure. Build scalable distributed systems and platform

Machine Learning Engineer, ML Systems and Infrastructure 14 Locations posted: Posted 30+ Days Ago

デリバリーソリューションアーキテクト Tokyo, Japan CSQ327R31 Databricksは、お客様がAIプラットフォームを活用して、世界で最も難しいなデータに関する課題を解決できるよう支援することをミッションとしています。デリバリーソリューションアーキテクト（DSA）は、この重要なミッションにおいて、セールスおよびフィールド・エンジニアリングチームと協力し、お客様のDatabricksプラットフォームの導入と利用拡大を加速させる重要な役割を担います。DSAとして、お客様がすでに導入を決定したDatabricksのワークロードについて、お客様がプラットフォームから最大限の価値と投資対効果を得られるよう、技術的な指導とサポートを提供し、お客様の成功を確実にします。特に、複雑な課題を抱えるお客様に対して、より重点的かつ技術的な責任を持って支援を行います。 このポジションは、技術とビジネスの両面を兼ね備えたハイブリッドな役割です。担当するお客様とユースケースにおいて、成長を推進します。ビジネス面では、お客様の意思決定者と関係を構築し、他の専門チームと連携しながら、Databricksが実行できる計画や戦略を策定・推進します。技術面ではDatabricksの全製品における、お客様導入後の技術的なリーダーとなります。組織内のあらゆるレベルの人々と、技術的な専門知識を活かしてコミュニケーションをとる能力が求められます。本ポジションは、日本のフィールド・エンジニアリング・ディレクター/Technical GM の直属となります。 あなたがもたらす影響 : - ソリューション・アーキテクトと連携し、重要顧客におけるユースケースの全体的な需要計画を把握します。 - Databricksの主要なユースケースにおいて、Technical Win後のアカウント戦略と実行計画を主導します。 - 複数の営業チームや社内関係者と連携し、特定のユースケースや顧客に対する技術的な責任者となります。お客様がDatabricksの導入を決定したワークロードについて、不確実性を取り除き、オンボーディング、有効化、成功、本稼働、そして健全な利用を推進します。 - お客様が合意したユースケースの本番稼働や運用に関する技術的な問題や質問に対し、最初の窓口として対応します。特に、大規模で複雑な組織においては、複数のユースケースを担当することが多くあります。 - 社内の専門家（共有サービス、ユーザー教育、オンボーディング／技術サービス、サポートなど）と連携し、自身の業務範囲や専門知識を超えるタスクを適切に割り振ります。必要に応じて、より専門的な技術エキスパートにもエスカレーションを行います。 - 主要なユースケースを本番環境へ迅速に移行させるための視点を構築し、プロフェッショナルサービスと連携して提案書の作成を進めます。 - Databricksの製品・エンジニアリングチームと連携し、新製品のイノベーション、プライベートプレビュー、アップグレードのニーズに対応します。 - 以下のワークストリームをカバーするため、顧客に接するすべての技術職およびチームの活動を網羅する実行計画を策定します。 - 本番環境へ移行する主要なユースケース - 有効化／ユーザー成長計画 - 製品導入（Databricksのレイクハウス・ビジョンを導入するための戦略と活動） - 現在の投資に対するオーガニックなニーズ（例：クラウドコスト管理、チューニング＆最適化） - エグゼクティブおよび運用ガバナンス - 利用状況や顧客の状態に関するKPIレポート（投資状況、重要なリスク、製品導入、ユースケースの進捗状況など）を、Technical GMに定期的に報告します。 必要な条件/経験: - データおよびAI領域における技術的なプロジェクト/プログラムのデリバリーに責任を持ち、顧客との技術的な議論や設計の選択に貢献した8年以上の経験。 - Python、SQL、またはScalaでのプログラミング経験。 - 顧客と直接対面するプリセールス、技術アーキテクト、カスタマーサクセス、またはコンサルティングの経験。 - 分散データシステムに関連するソリューション・アーキテクチャの理解。 - 特定のプロジェクト成果物に対し、ビジネス価値と成果を結びつける方法の理解。 - アカウント、ステークホルダー、リソース管理の責任を含む技術的なプログラムまたはプロジェクト管理の経験。 - 顧客企業のシニア・エグゼクティブとの間で、複雑かつ重要なエスカレーションを解決した経験。 - 自由形式のディスカバリー・ワークショップの実施、戦略的ロードマップの作成、ビジネス分析、複雑なプログラム/プロジェクトのデリバリー管理の経験。 - 目標（Quota、Goalsなど）に対する達成実績。 Databricksについて DatabricksはデータとAIの企業であり、全世界で10,000以上の組織が、Comcast、Condé Nast、Grammarly、Fortune 500の50%以上を含む、Databricks Data Intelligence Platformを利用してデータ、分析、AIを統合し民主化しています。Databricksはサンフランシスコに本社を置き、世界中にオフィスを展開しており、Lakehouse、Apache Spark™、Delta Lake、MLflowのオリジナルクリエイターによって設立されました。詳細については、 X 、 LinkedIn 、 Facebook でDatabricksをフォローしてください。 About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter , LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here . Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or

Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR) Redmond, Washington, USA Want to change the world with Big Data and Analytics? Come join us on the Amazon EMR team in Amazon Web Services! Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Apache Hadoop, Spark, Hive, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run large number of customer clusters, enabling a variety of customer use cases including analytics and web-scale machine learning. We are developing innovative new features including our next-generation cluster management system, improvements for real-time processing of big data, and ways to enable customers to more easily interact with their data. We're looking for top engineers to build them from the ground up. By joining our team, you will get to work with a minimum of technical supervision, while playing a variety of roles as needed to respond efficiently to multiple program priorities. You will get to collaborate with some of the best and brightest minds in the industry. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect! For more information: AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/ AWS EMR: https://aws.amazon.com/emr/ Key job responsibilities

Lead Mechanical Beit She'an Valley posted: Posted 30+ Days Ago

Sr. Solutions Engineer - Public Sector (Federal Civilian) Maryland; Virginia; Washington, D.C. FEQ327R25 While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. Sr. Solution Engineers at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science and machine learning. As a member of our team, you will exercise and develop expertise in those areas, using open-source projects such as Apache Spark™, MLflow, and Delta Lake. This is a customer-facing role, where you will work with customers, your teammates, the product team, and our post-sales teams, to identify use cases for Databricks, develop architectures and solutions using our platform, and guide customers through the implementation, to accomplish value. In that process, you will build relationships with our customers, find and build champions, and become a trusted advisor. You will report to the Sr. Field Engineering Manager for the team. The impact you will have: - Partner with the sales team to help customers understand how Databricks can help solve their business problems - Provide technical leadership for customers to evaluate and adopt Databricks - Consult on big data architecture, implement proof of concepts for strategic customer projects, data science and machine learning projects, and validate integrations with cloud services and other 3rd party applications - Build and present references architectures, how-tos, and demo applications for customers - Become an expert in, and promote Databricks inspired open-source

Senior Data & AI Engineer India-Karnataka-Bangalore

Solutions Architect - Field Engineering (GCC) Bengaluru, India FEQ427R298 As a Senior Solutions Architect part of a Global Capability Center(GCC) focused Field Engineering team, you will shape the future of the Data and AI landscape by working with the most sophisticated Data and AI teams in the world, including Fortune 500 enterprises and global AI-forward SaaS customers operating globally. In this role, you will be deeply embedded with our named strategic accounts, serving as a trusted long-term technical advisor while also collaborating with internal sales, product, and engineering teams. You will help our customers achieve tangible data-driven outcomes through the Databricks Data Intelligence Platform, helping data teams complete projects and integrate our platform into their enterprise ecosystem. You'll grow as a leader in your field, while finding solutions to our customers' biggest challenges in data engineering, analytics, AI and data science. Reporting to the Field Engineering Manager, you will collaborate with our most strategic global prospects and customers, partner with regional field teams across geographies, work directly with product and engineering to drive the Databricks roadmap forward, and work with the broader customer-facing team to develop architectures and solutions using our platform. You will guide customers through the competitive landscape, best practices, and implementation, and develop technical champions along the way. The impact you will have - Be the trusted technical advisor for one or more named strategic accounts - building deep, durable relationships with their data, AI/ML, and platform engineering leaders, and earning a seat at the table for

Machine Learning Research Engineer , Text Generation, Input Experience Seattle, United States of America Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build or service we create, what we deliver is the result of us making each other's ideas stronger. It's the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you'll do more than join something - you'll add something. Text generation is a key enabler for accelerated text input and intelligent interaction on Apple platforms. Our team is working on redefining user interaction with generative models for text generation. If you want to be part of an ambitious, organized and collaborative team that ships user experiences with pioneering ML, partnered with the best UI designs, come join the Input Experience NLP team. Our work has been highlighted in multiple WWDC keynotes including Intelligent Input in 2023, Writing Tools and Smart Reply in 2024! We exemplify Apple's outstanding integration of hardware and software to create seamless input experiences. You will have the opportunity to go from building offline pioneering NLP models to optimization of the models for different hardware backends and user interfaces that make the experience magical. Our vision always includes a deep dedication to strengthening Apple's privacy policy by achieving all of the above on device with powerful Machine Learning. As a

Senior Detection Creation Engineer Seattle, United States of America The people here at Apple don't just craft products - they build the kind of wonder that revolutionizes entire industries. It's the diversity of those people and their ideas that inspires the innovation that runs through everything we do, including our approach to security. Join Apple, and help us protect the services that billions of customers rely on every day. The Detection team within Apple Services Engineering (ASE) is responsible for building advanced detections that protect approximately three-quarters of Apple's systems and services. We achieve this by partnering closely with engineering teams to develop a deep technical understanding of how these systems operate, along with a comprehensive grasp of the threat landscape. This allows us to build state-of-the-art security detections that proactively defend against real-world attacks. We're looking for a Detection Creation Engineer who combines deep security intuition with technical implementation skills. In this role, you'll craft detection logic that catches active malicious activity across Apple's infrastructure. You'll need to think like an attacker, understand how malicious behaviors manifest in telemetry data, and translate that knowledge into high-fidelity detections that protect our customers. This is a hands-on technical role where you'll write detection code in Scala Spark (Databricks notebooks) and configuration files for on-host detection systems (such as Falco rules). While we don't require prior Scala experience, we do expect strong programming fundamentals and the curiosity to dive deep into new technologies. If you're passionate about understanding attacker tradecraft and translating

Ingénieur Data - Databricks F/H MONTPELLIER,FRANCE Orange Business est un intégrateur réseau et numérique qui comprend toute la chaîne de valeur du monde digital, permettant à nos clients de se concentrer sur les initiatives stratégiques qui font avan...

Software Engineer Intern- Budapest Budapest, Hungary SOFTWARE DEVELOPER INTERN Realize your potential by joining the leading performance-driven advertising company! As a Software Developer Intern on the R&D team in our Budapest Office, you'll play a vital role in building the infrastructure that powers global recommendations. You will develop and maintain high-scale systems, from internal monitoring tools to customer-facing dashboards. You'll work directly with a modern tech stack to solve complex engineering challenges and ensure our products remain robust and scalable for millions of users. To thrive in this role, you'll need: - Proficiency in Java or Python. - Foundational knowledge of SQL. - Technical level of English language proficiency. - A proactive approach to learning and adopting new technologies. - Current enrollment in or recent completion of a Computer Science degree (or equivalent). Bonus points if you have: - Interest in artificial intelligence and recommendation systems. - Experience with big data tools like Spark, Kafka, or Hadoop. How you'll make an impact: - Developing and optimizing high-performance recommendation systems. - Building internal and external dashboards to visualize complex data. - Creating systems that streamline and facilitate customer integration processes. - Designing and implementing monitoring systems to ensure platform stability. - Managing independent projects and collaborating on large-scale team initiatives. - Fully testing, documenting, and maintaining production-level code. ALGORITHM ENGINEER INTERN Realize your potential by joining the leading performance-driven advertising company! As an Algorithm Engineer Intern on the R&D team in our Budapest Office, you'll play a vital role in optimizing

Machine Learning Engineer - 5 Bangalore posted: Posted 30+ Days Ago

Staff SLAM/ML Engineer, Spot Autonomy Waltham Office (POST) posted: