Member of Technical Staff (Answer Quality & Evals)

Tech Stack

Responsibilities

• Build shared evaluation infrastructure that helps teams run reliable evals, analyze results, and make product and model decisions
• Develop the platform for replaying and analyzing agent traces to reproduce production behavior and diagnose failures
• Build and operate scalable systems for processing, storing, and monitoring interaction, trace, and evaluation data
• Partner with data scientists, engineers, and product teams to turn answer-quality problems into evaluations, analyses, and product improvements

Culture

Requirements