Scientific Evals

Tech Stack

Responsibilities

• Design benchmarks that capture the complexity of real biological research, building on prior work like LAB-Bench and BixBench.
• Curate and vet biological datasets to ensure scientific rigor.
• Analyze model outputs, identify failure modes, and contribute to iterative improvements in both datasets and evaluation criteria.
• Collaborate with AI/ML researchers to translate scientific intuition into training signal.
• Coordinate operations and manage workflows, including working with domain experts, tracking task progress, and maintaining documentation.

Benefits

• 401k
• Equity
• Gym Membership

Culture

Requirements