Senior Staff LLM Inference Engineer
d-Matrix - Santa Clara, Santa Clara, Ca, Ca, United States
Posted Aug 18, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- Not verified
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered From the posting source checked Nov 18, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Senior Staff LLM Inference Engineer Santa Clara, Santa Clara, Ca, Ca, United States Join d-Matrix and help build the future of AI inference. We've pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure's hardest challenges - and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we'd love to hear from you. Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we're looking for people who are driven by execution and energized by hard problems. D-Matrix Frontier Group sits at the leading edge of what's possible with LLM inference on heterogeneous hardware. Our charter spans the full stack: from pathfinding emerging use cases and novel deployment patterns to deep optimization of inference kernels to building proof-of-concept systems that showcase D-Matrix's unique computational fabric. We are an applied research and engineering team that moves fast, ships real systems, and works directly with product and hardware teams to shape the roadmap. We build the tools, runtimes, and frameworks that let frontier AI models run efficiently and cost-effectively across heterogeneous deployments combining D-Matrix silicon with CPUs, GPUs, and custom accelerators. Our work powers everything from benchmarking and evaluation pipelines to production-grade inference serving. This Role We are hiring end-to-end inference engineers who
Read the full description at jobs.ashbyhq.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Senior Staff Inference Performance Engineer
d-Matrix - Santa Clara, Santa Clara, Ca, Ca, United States, Remote
AIML - LLM Inference Quality Engineer
Apple - Seattle, United States of America
Distributed LLM Inference Engineer
Anyscale - San Francisco, Palo Alto
Member of Technical Staff - Inference Systems
Liquid AI - Boston, Cambridge, Massachusetts, United States