Sr. Software Engineer - AI Evaluation and Knowledge
Supermicro - San Jose, Cali, Un
Posted Nov 12, 2026
Benefits
- Parental leave
- Not verified
- Non-birth-parent leave
- Not verified
- Family-building benefits
-
- Fertility benefits: Not verified
- Adoption assistance: Not verified
- Surrogacy assistance: Not verified
- Mental health support
- Not verified
- Relocation assistance
- Not verified
- Childcare support
- Not verified
- Learning budget
- Not verified
- Verification
- Not verified
- Salary
- $160K-$200K From the posting source checked Nov 18, 2026
- 401(k) match
- Not verified
Was this benefit information wrong? Tell us.
Market context
- U.S. role benchmark (BLS OEWS)
- $116,543 U.S. median for this role
- Projected growth (BLS Employment Projections)
- +9.8% - Much faster than average
54% above the BLS role benchmark for software engineering aggregate.
Matched to SOC 15-1252 - Software Engineering aggregate by role bucket.
Source:U.S. Bureau of Labor Statistics, OEWS, May 2024andEmployment Projections, 2024-2034.
Role
Schedule
- Shift type
- Not verified
- Weekend work
- Not verified
Company
- Equity
- Offered Verified - SEC 10-K source checked Nov 18, 2026
Application
- Cover letter
- Not verified
- Assessment
- Not verified
- Deadline
- Not stated
Where they hire
State eligibility is not yet verified.
About this role
Sr. Software Engineer - AI Evaluation and Knowledge San Jose, Cali, Un Job Req ID: 30248 About Supermicro: Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us. Job Summary: We are building an AI Agent-powered platform to handle customer issues related to AI Servers and Racks. This role focuses on the quality of agent outputs, evaluation systems, and continuous improvement of the Knowledge Base, ensuring the agent produces accurate and actionable troubleshooting steps. Essential Duties and Responsibilities: Design and maintain the agent evaluation framework (test sets, automated scoring, human sampling review, regression testing) Own Prompt Engineering and structured output optimization to improve step accuracy Manage Knowledge Base quality processes (content review, version control, retirement of outdated content, writing back new cases) Analyze agent errors and hallucinations, then propose and implement improvements Work closely with Domain SMEs to validate the correctness and practicality of troubleshooting steps Establish a feedback loop from on-site execution results back into agent improvements Help define success metrics (e.g., first-time accuracy rate, step usability rate) and track them continuously Support RAG retrieval quality tuning and knowledge
Read the full description at jobs.supermicro.com. FewerJobs shows a preview and links to the original posting.
Apply link verified; last checked Nov 20, 2026.
What verified means
Verified means a displayed claim has field-level provenance to a source FewerJobs pulled: a government or employer source, or the original job posting. Posting-sourced facts are employer-stated and are labeled separately from government records.
Related jobs
Sr. Software Engineer - AI Agent and LLM Applications
Supermicro - San Jose, Cali, Un
Sr Software Engineer, Agentic Applications
Databricks - Mountain View, California
Sr. Software Engineer, Super Intelligence
xAI - Palo Alto, CA
Sr AI Software Engineer
Artos - San Francisco | Hybrid | Remote