Senior AI Infrastructure Engineer, Model Serving Platform

Benefits

Parental leave

Not verified

Non-birth-parent leave

Not verified

Family-building benefits

• Fertility benefits: Not verified
• Adoption assistance: Not verified
• Surrogacy assistance: Not verified

Mental health support

Not verified

Relocation assistance

Not verified

Childcare support

Not verified

Learning budget

Not verified

Verification

Not verified

Salary

Not verified not verified - source not recorded; timestamp not recorded

401(k) match

Not verified

Was this benefit information wrong? Tell us.

Schedule

Shift type

Not verified

Weekend work

Not verified

Application

Cover letter

Not verified

Assessment

Not verified

Deadline

Not stated

Where they hire

State eligibility is not yet verified.

About this role

Senior AI Infrastructure Engineer, Model Serving Platform San Francisco, CA; New York, NY As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and production systems, supporting both internal and external use cases across various environments. The ideal candidate combines strong ML fundamentals with deep expertise in backend system design. You'll work in a highly collaborative environment, bridging research and engineering to deliver seamless experiences to our customers and accelerate innovation across the company. You will: - Build and maintain fault-tolerant, high-performance systems for serving LLMs workloads at scale. - Build an internal platform to empower LLM capability discovery. - Collaborate with researchers and engineers to integrate and optimize models for production and research use cases. - Conduct architecture and design reviews to uphold best practices in system design and scalability. - Develop monitoring and observability solutions to ensure system health and performance. - Lead projects end-to-end, from requirements gathering to implementation, in a cross-functional environment. Ideally you'd have: - 5+ years of experience building large-scale, high-performance backend systems. - Strong programming skills in one or more languages (e.g., Python, Go, Rust, C++). - Experience with LLM serving and routing fundamentals (e.g. rate limiting, token streaming, load balancing, budgets, etc.) - Experience with LLM capabilities and concepts such as reasoning, tool calling, prompt templates, etc. - Experience with containers and orchestration tools (e.g., Docker, Kubernetes). - Familiarity with cloud infrastructure (AWS, GCP)

Read the full description at job-boards.greenhouse.io. FewerJobs shows a source-linked preview and links to the original posting.