Machine Learning Research Scientist, Evaluations

Tech Stack

Responsibilities

• Analyze model behavior to identify, characterize, and diagnose failure modes in frontier LLMs and Agents.
• Design and build benchmarks and evaluation methods that measure LLM capabilities in both text and multimodal modalities.
• Apply post-training expertise (SFT, RLHF, reward modeling) to connect observed failures to the data and training interventions that address them.
• Publish research findings in top-tier AI conferences.

Benefits

• 401k
• Equity
• Health Insurance
• Learning Budget

Culture

Requirements