Member of Technical Staff, Enterprise Evals Platform

Tech Stack

Responsibilities

• Define golden sets by decomposing real tasks and encoding the expert quality bar.
• Build verifiers over agent trajectories and outputs that are calibrated and hard to game.
• Build the eval platform that runs offline environments, task suites, and grading at scale.
• Run loss analysis over production trajectories and turn failure modes into regression tests.
• Own the rollout gates that decide whether an agent change ships.

Benefits

• Equity
• Gym Membership
• Health Insurance

Culture

Requirements