Data Scientist, Codex

Tech Stack

Responsibilities

• Embed with the Codex product team to discover opportunities that improve developer outcomes and growth.
• Design and interpret A/B tests and staged rollouts of new coding models and product features.
• Define and operationalize metrics such as suggestion acceptance, edit distance, compile/test pass rates, task completion, latency, and session productivity.
• Build dashboards and analyses that help the team self-serve answers to product questions.
• Diagnose failure modes and partner with Research on targeted improvements.

Culture

Requirements