Flink jobs

Senior Software Engineer - Java Streaming - Connectors United States (Remote) About ClickHouse Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With more than 3,000 customers and ARR that has grown over 250 percent year over year, ClickHouse leads the market in real-time analytics, data warehousing, observability, and AI workloads. The company's sustained, accelerating momentum was recently validated by a $400M Series D financing round. Over the past three months, customers including Capital One, Lovable, Decagon, Polymarket, and Airwallex have adopted the platform or expanded existing deployments. These customers join an established base of AI innovators and global brands such as Meta, Cursor, Sony, and Tesla. We're on a mission to transform how companies use data. Come be a part of our journey! The Connectors team is the bridge between ClickHouse and the entire data ecosystem. We build and maintain the connectors that make ClickHouse accessible to millions of developers and data practitioners worldwide. Our work spans from low-level database integrations to high-level data visualization plugins, ensuring that ClickHouse seamlessly integrates with the tools our users already know and love. We're responsible for the official data connectors (Kafka, dbt, Spark, Flink, Beam, Fivetran), and integrations with leading visualization platforms (Grafana, Tableau, Power BI, Metabase). What will you do? As a Senior Software Engineer specializing in JVM-based frameworks, you'll serve as a core contributor, owning and maintaining critical parts of ClickHouse's Data engineering ecosystem. This role sits at the

opérateur production Finishing Le Locle posted: Posted Today

售前解决方案工程师 China 工作职责： 1.与潜在客户的技术团队沟通，深入理解其需求，基于技术需求筛选并锁定目标客户群体。 2.设计并展示基于 Alluxio的解决方案，设计并完成POC。 3.协同销售团队进行市场开拓，拜访现有客户及潜在客户，收集反馈，洞察市场与技术趋势。 4.向产品团队传递客户需求及市场洞察，推动客户需求与 Alluxio的roadmap保持一致。 任职资格： 1.具备7年以上AI/ML 领域的开发、解决方案架构设计或技术架构设计的经验。 2.熟悉 Java 和 Python，有 Shell 脚本和 Go 语言经验者优先。 3.满足以下至少两项要求： 1）熟悉大数据生态系统，精通至少一种计算框架（如 Hadoop/Spark/Presto/Impala/Flink），熟悉一种及以上存储系统（如 HDFS/S3/Ceph），并具备实际开发或解决方案设计经验。 2）熟悉 AI/ML 框架（如 TensorFlow、PyTorch ），有相关工作经验。 3）熟悉 Kubernetes，具备基于 K8s 的开发经验或解决方案设计经验。 4.熟悉 Linux与 Docker，具备实际操作经验。 5.自驱力强、富有团队精神、学习能力快。

Director, Data Engineering — Customer Success Score California - San Francisco; Washington - Seattle About the Role We're building data products that will define Salesforce's next era of agentic intelligence - powering smarter, adaptive, and self-optimizing product experiences at enterprise scale. As Director of Data Engineering, you'll set the strategic direction, architectural vision, and organizational execution for the data systems behind Customer Success Score (CSS), one of Salesforce's most critical product intelligence assets. This is a high-visibility leadership role for a strategic technologist who thrives at the intersection of data, AI, and platform engineering. What You'll Do Platform Strategy & Roadmap Own the roadmap for the CSS data platform, aligning engineering investment with Salesforce's agentic and AI-first product strategy Establish architectural principles and governance standards for telemetry, semantic modeling, and metadata-driven discovery at enterprise scale Drive convergence across product analytics, ML infrastructure, and AI data foundations - breaking down silos and creating shared organizational leverage Represent data engineering at the executive level; shape organizational priorities and secure resources for strategic initiatives Technical Architecture & Excellence Set and uphold the technical bar for distributed data systems - including fault-tolerant batch and streaming architectures (Spark, Trino, Flink, Kafka, dbt, Snowflake) Define engineering standards across software quality, CI/CD, observability, and reliability Guide platform evolution to support autonomous agent reasoning, real-time adaptive decisioning, and AI-native product experiences Champion semantic consistency, metric governance, and trusted signal definition across the organization Evaluate emerging technologies and drive adoption decisions that extend the platform's strategic value Organizational Leadership

Student Worker M/F Copenhagen - Tromsogade posted: Posted Yesterday

Senior Staff Software Engineer, Indexing & Retrieval Platform Remote - United States Reddit is a community of communities. It's built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 126 million daily active unique visitors, Reddit is one of the internet's largest sources of information. For more information, visit www.redditinc.com . Team The ML Indexing & Retrieval Platform team at Reddit is responsible for building and scaling the core infrastructure that powers machine learning driven recommendations. We design and maintain systems for ML data ingestion, low-latency retrieval services, and end-to-end lifecycle management of data. With a focus on performance, reliability, and scalability, we enable real-time access to high-quality data that supports a wide range of applications, including Content Understanding, Semantic, Lexical retrieval & GenAI applications. How You'll Have Impact You'll lead the development of next-generation ML Indexing & Retrieval systems, owning the full lifecycle from ideation to production and going beyond incremental improvements to reimagine core platform capabilities. As part of a high-impact, cross-functional team, you'll solve complex technical challenges to build scalable, reliable platforms that empower developers to efficiently ship critical ML features. Languages: Go, Java, Python, or any object oriented programming language Frameworks: Flink, Airflow, Spark for large scale batch & stream processing Databases: Familiarity with Vector, Lexical & Key-Value Databases Tools: Kubernetes, Docker, AWS, GCP What

Assistant Quality Supervisor St. Petersburg/Tampa, FL posted: Posted Yesterday

Principal Software Engineer, Apple Data Platform Cupertino, United States of America The Apple Data Platform team powers analytics and machine learning across Apple. Our mission is to deliver cutting-edge, reliable, and user-friendly infrastructure for data ingestion, storage, processing, and interaction, enabling teams to build data-intensive applications with ease and success. Our team provides a fully managed Lakehouse solution powered by Apache Iceberg and the Iceberg REST Catalog, interactive querying using Trino and Druid, and data processing using Apache Spark & Flink. Our platform supports both analytical and machine learning workloads across Apple, serving key products and organizations including Siri, Search, Media, iCloud, News, Apple Intelligence, and Maps. We invest in open source technologies, and continuously innovate to meet evolving customer needs and market trends. We are seeking Principal-level engineers passionate about building world-class infrastructure products. In this role, you will serve as a technical leader on the Data Platform team, guiding team members in both technical and professional growth. You will collaborate closely with cross-functional teams to lead the planning, execution, and success of technical projects, with a focus on enhancing the experience for Apple's internal customers. The ideal candidate will have outstanding communication skills, proven data infrastructure/platform design and implementation capabilities, strong business acumen, and an innate drive to deliver results. They will be a self-starter, comfortable with ambiguity and will enjoy working in a fast-paced dynamic environment. Build and operate Apple's largest data platform supporting exabyte scale. Scale and operationalize our largest multi-tenant, highly secure, and compliant Data

Repacker Buckhead New York posted: Posted 30+ Days Ago

[Growth Engineering] Senior Staff Back-end Engineer I Shanghai, China In Growth Engineering, our goal is to increase the number of transacting Customers while also growing their purchase frequency and lifetime value. We build core platforms and services that power Coupang's growth and marketing efficiency. Various platforms under our portfolio include Search Advertising Platform, Affiliate Platform, Display targeting & re-targeting Platform, CRM, Audience Platform, Push Marketing Platform, and other core marketing services for user profile, landing, tracking & attribution. ML opportunities across these portfolios include targeting, personalization, product & offer recommendations, budget optimization, real-time bidding, creative optimization, fraud detection, and various others. As a Senior Staff Engineer within Coupang's Growth Engineering team, you will be instrumental in architecting and developing a next-generation CRM platform. You will lead initiatives to ensure the platform delivers an end-to-end campaign management including Campaign Plan, Target Customer Selection, Promotion optimization, Product Selection, Creative Management, Landing Page Creation and Campaign Performance Measurement. Design a real-time decision engine to empower downstream services across the Growth Engineering ecosystem. Your expertise will directly contribute to advancing Coupang's data-driven capabilities, aligning technical innovation with strategic business objectives. Key Responsibilities: - Design, develop, and automate large-scale, high-performance streaming data processing systems to drive business growth and enhance product experience - Build scalable infrastructure and pipelines using best-in-class software engineering practices - Ensure the platform supports high availability, reliability, and low-latency. - Take full ownership end to end: from solution investigation/benchmark, development to operational health - Establish and execute short and long-term architectural

Material Handler Broken Arrow posted: Posted 17 Days Ago

Software Development Engineer II, Amazon Security Data Engineering Herndon, Virginia, USA If you thrive in a fast-paced, innovative environment and are interested in pushing the boundaries of what's possible with big data, cloud computing, and security analytics, Amazon Security Platform Engineering is the place for you. We support a suite of services and products to ingest, optimize and query petabyte scale datasets efficiently, and enable critical security use cases such as incident response, security analytics, threat-hunting, and low-latency detection. Successful candidates for this position will possess: Strong software engineering fundamentals, including expertise in object-oriented design, algorithms, and data structures Experience building and operating scalable, fault-tolerant, distributed systems Proficiency in Java, Scala or Python with a solid understanding of multi-threading and memory management Knowledge of big data compute engines such as open table formats like Apache Iceberg, and Apache Spark, Trino, Flink. Excellent verbal and written communication skills Self-motivation and the ability to deliver high-quality results in a fast-paced environment. Key job responsibilities Build and support Amazon Security's Data Lake, consisting of services for data cataloging, optimization, compaction, re-organization, and indexing at petabyte scale. Drive technical vision and contribute to the roadmap for systems that manage petabyte-scale data catalogs supporting Apache Iceberg, AWS Glue, Parquet, and other formats. Design and implement distributed systems for data optimization that balance multiple latency scenarios from minute-level batch detections to month-spanning threat hunting queries. Modernize security intelligence platform's data catalog and governance services to provide customers with rule-based access controls and fine-grained data access. Build

Field Application Scientist, Olink Proteomics (Remote - SF Bay Area, CA) Remote, California, United States of America Embrace the opportunity to become a Field Application Scientist, Olink Proteomics, and provide expert technical support and training for cutting-edge proteomics solutions. Collaborate with cross-functional teams, deliver impactful product demonstrations, and help drive innovation in scientific research. Make a difference in global health and science with Thermo Fisher Scientific.

Junior Mould Technician Bray posted: Posted 17 Days Ago

Member of Technical Staff (Software Engineer, Data Platform) San Francisco, California, United States, New York City, Palo Alto About the Role The Data Platform team owns the end-to-end data lifecycle at Perplexity, from ingestion through processing, storage, and serving, powering product features, analytics, experimentation, AI workloads, and the company's data lake. The team defines the architecture for batch and streaming systems, the orchestration and observability stack, and a self-serve data platform, while thoughtfully combining platforms such as Databricks and Snowflake with open-source technologies including Spark, Kafka, Flink, Airflow, Dagster, dbt, Iceberg, Delta Lake, and ClickHouse. In this senior/staff role, you will shape architecture, set standards, and drive the long-term technical direction of Perplexity's data ecosystem. Key Responsibilities - Design and operate large-scale batch and streaming data pipelines that directly power Perplexity product features, AI training and evaluation workflows, analytics, and experimentation. - Build event-driven and streaming systems (Kafka, Kinesis, PubSub, or similar) for real-time ingestion, transformation, and delivery, alongside batch frameworks for backfills, aggregations, and offline computation. - Lead the architecture of data orchestration using tools like Airflow or Dagster, owning scheduling, dependency management, retries, SLAs, and end-to-end observability for critical data flows. - Set and enforce guarantees for data correctness, freshness, lineage, and recoverability, designing systems that handle rapid scale growth, partial failures, and evolving schemas without disrupting AI workloads or product experiences. - Build self-serve data platforms that let engineers, data scientists, and analysts safely discover data, define contracts, and create and operate their own pipelines with minimal

Staff Software Engineer, ISPM - India Bangalore, India - Remote All roles at JumpCloud® are Remote unless otherwise specified in the Job Description. About JumpCloud® JumpCloud® is the AI-powered unified IT management platform designed to secure the modern workforce. By consolidating identity, device, and access management, JumpCloud provides intelligent, secure IT that scales from human users to autonomous AI agents. We help organizations around the globe eliminate complexity and turn AI risk into an optimized advantage, ensuring the right people and agents have secure access to the right resources at all times. JumpCloud is Intelligent, Secure IT. The Problem Statement: The Invisible Identity Perimeter The Opportunity: Founding the ISPM Platform We're looking for: Bonus Points:

Lead Artist Helsinki,Finland

Data Engineer I Bengaluru, Karnataka, IND FBA is seeking a Data Engineer to help build AI-native data infrastructure that embeds intelligence as a foundational feature. If you enjoy innovating and want to contribute to an industry-changing business while supporting next-generation intelligent data platforms, this role is for you. Core Responsibilities: AI-Native Infrastructure & Real-Time Processing Support the development of AI-native infrastructure for real-time data processing supporting AI/ML inference, training, and continuous learning Contribute to building semantic layers and knowledge graphs that enable intelligent query routing and context-aware data access Assist in developing infrastructure components for agentic AI systems with multi-agent orchestration Implement GenAI-powered data quality checks, entity resolution pipelines, and metadata management workflows Data-as-a-Product Delivery Contribute to end-to-end data product delivery from ingestion to consumption Support data products with clear SLAs, quality metrics, and customer satisfaction measures Help build self-service platforms with embedded governance, lineage, and discovery Implement data contracts and APIs for reliable, versioned data consumption AWS Infrastructure & Pipeline Engineering Work with AWS resources: EC2, Lambda, S3, Redshift, Kinesis, EMR, SageMaker, Bedrock, Neptune Build and maintain pipelines supporting analysts, data scientists, and AI agents Implement CDC and event-driven architectures for real-time data availability Deploy infrastructure-as-code using CDK/Terraform Required Qualifications 3+ years in data engineering with cloud-native architectures Working knowledge of AWS services (Redshift, S3, Glue, Kinesis, EMR) Experience with real-time streaming technologies (Kafka, Kinesis, or Flink) Exposure to AI/ML infrastructure (SageMaker, Bedrock) Proficiency in Python, SQL, and familiarity with infrastructure-as-code Preferred Qualifications Knowledge graphs (Neptune, Neo4j) and semantic

Process engineer Singapore posted: Posted Yesterday

Senior Software Development Engineer, AI Data Platform United States, US Oracle's Forward Deployed Engineer (FDE) team is hiring a Senior Software Development Engineer - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle's Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Strong data engineering, HPC, and data science experience. Spark, PySpark, Delta Lake, Parquet, Feature Extraction, MLOps, Flink, with a deep understanding of the distributed systems techniques that make these services work. Full stack development experience. This includes web app development, RESTful APIs, SSE, all the way to deploying your solution. Design, implement, and maintain scalable software components and services that support AI/ML workloads. Build APIs, SDKs, and automation frameworks to streamline the adoption of Oracle AI Data Platform and Gen AI services. Optimize performance, scalability, and reliability of distributed data/AI systems. Collaborate with cross-functional teams (engineering, product, and field) to solve complex technical challenges. Participate in code reviews, testing, and CI/CD to ensure high-quality deliverables. Document technical designs and contribute to knowledge-sharing (e.g., blogs, internal docs, demos). Continuously explore new tools, frameworks, and best practices in AI, cloud, and data engineering. Primary Skills: Experience with LLMs and agentic frameworks (e.g., MCP, LangChain, CrewAI, Semantic Kernel).

Field Services Engineer Taiwan posted: Posted 3 Days Ago

Pipefitter Victoria, US-TX, United States

Data Engineering Bangalore, KA, India Bangalore, KA, India What success looks like in this role: End-to-End Pipeline Engineering: Build and automate robust ETL/ELT pipelines using Azure Data Factory (ADF), AWS Glue, and Apache Airflow. · Distributed Computing: Develop large-scale data processing jobs using PySpark and Scala within Databricks or EMR environments. · Streaming & Real-time Integration: Design and implement real-time data ingestion and processing layers using Apache Kafka, Confluent, or AWS Kinesis. · Data Lakehouse : Manage and optimize cloud storage using ADLS Gen2 and S3, implementing ACID transactions with Delta Lake or Apache Iceberg. · Advanced Data Modeling: Design highly performant schemas for cloud data warehouses like Snowflake, Amazon Redshift, or Google BigQuery. · Data Transformation & Quality: Use dbt (data build tool) for modeling and implement automated quality checks using Great Expectations or Soda. · Infrastructure & CI/CD: Deploy and manage data infrastructure using Terraform or CloudFormation, and maintain CI/CD pipelines via GitHub Actions or GitLab CI. Technical Stack Requirements · Cloud Platforms: Deep hands-on experience with Microsoft Azure (ADF, Synapse, Databricks) and AWS (S3, Glue, Athena, Lambda). · Programming: Strong proficiency in Python (PySpark, FastAPI), SQL, and familiarity with Java or Scala. · Big Data Tools: Experience with Apache Spark, Apache Flink, and Hadoop ecosystem. · Databases: Strong knowledge of both Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra, or DynamoDB) databases. · Containerization: Proficiency with Docker and Kubernetes (K8s) for deploying data services. · Observability: Familiarity with monitoring tools like Prometheus, Grafana, or Datadog to track pipeline

Staff Software Engineer, Data USA, Palo Alto About Us Nu is one of the largest digital financial platforms in the world, with more than 127 million customers across Brazil, Mexico, and Colombia. Guided by our mission to fight complexity and empower people, we are redefining financial services in Latin America and this is still just the beginning of the purple future we're building. Listed on the New York Stock Exchange (NYSE: NU), we combine proprietary technology, data intelligence, and an efficient operating model to deliver financial products that are simple, accessible, and human. Our impact has been recognized by global rankings such as Time 100 Companies, Fast Company's Most Innovative Companies, and Forbes World's Best Bank. Visit our institutional page Careers at Nu - Join our team! About the Role As a Staff Software Engineer (Data) , you will be the technical cornerstone of our data ecosystem. At Nu, we don't just "move data" we build the foundational platforms that empower analysts, ML engineers, and product leaders to make the decisions that drive financial inclusion for millions. You will own the data infrastructure for your domain, tackling highly complex and ambiguous challenges that span multiple departments. You aren't just a builder; you are a strategist who identifies data gaps before they become bottlenecks and treats data quality as a mission critical product. You will set the technical bar for the entire function, ensuring that downstream trust remains unbreakable as we scale. Responsibilities - Architect Data Excellence: Design and evolve high