Cloud Inference Engineer
Luminal - San Francisco | OnSite
Posted Nov 7, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- $150K-$250K From the posting source checked Nov 18, 2026
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
72% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Nov 18, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Cloud Inference Engineer San Francisco | OnSite Qualifications CUDA + GPU inference optimization vLLM, SGLang, or TensorRT-LLM experience KV caching, paged attention, batching, token streaming, etc. Distributed compute (with GPUs is a super plus) No degree required Company Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line. Role Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud. Day to day responsibilities: Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc. Conducting model performance reviews Improve scheduler, batcher, autoscaling; profile latency, cost, utilization Sometimes write kernels and, yes, occasional tasteful shitposting Location and compensation San Francisco, CA, US · Full-time · On-site. Annual base salary: $150,000-$250,000 USD. Equity: 0.15%-0.75%. Visa: US citizen/visa only.
Read the full description at jobs.ashbyhq.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Compiler Engineer
Luminal - San Francisco | OnSite
Inference Optimization Engineer
Hedra - San Francisco, California, United States
Senior Backend Engineer, Inference Platform
Together AI - San Francisco
Staff + Sr. Software Engineer, Cloud Inference Launch Engineering
Anthropic - San Francisco, CA | Seattle, WA