Applied Research Scientist

Benefits

Parental leave

Not verified

Non-birth-parent leave

Not verified

Family-building benefits

• Fertility benefits: Not verified
• Adoption assistance: Not verified
• Surrogacy assistance: Not verified

Mental health support

Not verified

Relocation assistance

Not verified

Childcare support

Not verified

Learning budget

Not verified

Verification

Not verified

Salary

Not verified

401(k) match

Not verified

Was this benefit information wrong? Tell us.

Schedule

Shift type

Not verified

Weekend work

Not verified

Application

Cover letter

Not verified

Assessment

Not verified

Deadline

Not stated

Where they hire

State eligibility is not yet verified.

About this role

Applied Research Scientist US - Remote About Us At Sully.ai , We're Building the Most Impactful Healthcare Company on Earth We believe that access to a great doctor is a basic human right. Today, that's not a reality. Delays, misdiagnoses, administrative chaos, and burnout plague the system. Our Mission One Human, One Doctor . We enable our customers to staff 30% of their workforce with AI by creating a shared agent architecture for scale and efficiency. All powered by our own patented, world-class models and deployed in real-world care. Key Responsibilities - Build and scale automated evaluation pipelines (LLM-as-judge + human review) with clinical-grade benchmarks. Hard Requirements - Proven experience designing agentic processes and LLM evaluation/benchmarking frameworks. - Strong Python and ML background (PyTorch/TensorFlow, Hugging Face, LangChain/LlamaIndex). - Demonstrated ability to design rigorous experiments and translate findings into production. - Track record of published research or deep applied work in LLMs and agent evaluation. - Strong communication and technical writing skills to articulate complex findings clearly. - First-Month Focus - Audit existing evaluation approaches for clinical and agentic tasks. - Define initial benchmarks and build early automated pipelines. - Partner with engineering to land first set of CI gates for accuracy, factuality, and safety. - 90 Days - Deliver a repeatable evaluation framework with automated pipelines in production. - Demonstrate measurable improvements in robustness, hallucination reduction, or safety. - Publish or present internal research findings that directly shape product reliability. - If you've ever said, “I want to do work

Read the full description at jobs.ashbyhq.com. FewerJobs shows a source-linked preview and links to the original posting.