Member of Technical Staff, Data Flywheel

Tech Stack

Responsibilities

• Identify high-value data sources and translate them into representative evaluations for model behaviors
• Design and build evaluations, graders, and feedback loops that make priority real-world model behaviors measurable
• Analyze model performance and failure modes to translate insights into targeted datasets and training interventions
• Develop human and synthetic data strategies, including designing and running evaluation and data-collection programs with vendors
• Build the infrastructure and pipelines needed to ingest, inspect, version, and evaluate data reliably at scale

Benefits

• Equity
• Gym Membership
• Health Insurance
• Parental Leave

Culture

Requirements