Inference Software Engineer

Benefits

Parental leave

Not verified

Non-birth-parent leave

Not verified

Family-building benefits

• Fertility benefits: Not verified
• Adoption assistance: Not verified
• Surrogacy assistance: Not verified

Mental health support

Not verified

Relocation assistance

Not verified

Childcare support

Not verified

Learning budget

Not verified

Verification

Not verified

Salary

Not verified

401(k) match

Not verified

Was this benefit information wrong? Tell us.

Schedule

Shift type

Not verified

Weekend work

Not verified

Application

Cover letter

Not verified

Assessment

Not verified

Deadline

Not stated

Where they hire

State eligibility is not yet verified.

About this role

Inference Software Engineer San Jose, CA, United States About Etched Etched is building the world's first AI inference system purpose-built for transformers - delivering over 10x higher performance and dramatically lower cost and latency than a B200. With Etched ASICs, you can build products that would be impossible with GPUs, like real-time video generation models and extremely deep & parallel chain-of-thought reasoning agents. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history. Key responsibilities - Support porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting. - Build, enhance, and scale Sohu's runtime, including multi-node inference, intra-node execution, state management, and robust error handling. - Optimize routing and communication layers using Sohu's collectives. - Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues. You may be a good fit if you have - Proficiency in C++ or Rust. - Understanding of performance-sensitive or complex distributed software systems like Linux internals, accelerator architectures (e.g. GPUs, TPUs), Compilers, or high-speed interconnects (e.g. NVLink, InfiniBand). - Familiarity with PyTorch or JAX. - Ported applications to non-standard accelerator hardware or hardware platforms. Strong candidates may also have experience with (Nice-to-have qualifications) - Developed low-latency, high-performance applications using both kernel-level and user-space networking stacks. - Deep understanding of distributed systems concepts, algorithms, and challenges, including consensus protocols, consistency models, and communication patterns. - Solid grasp of

Read the full description at jobs.ashbyhq.com. FewerJobs shows a source-linked preview and links to the original posting.