[2026] Data Scientist, Foundation AI - PhD Early Career

Tech Stack

Responsibilities

• Develop Evaluation Frameworks: Design and operationalize rigorous evaluation systems for GenAI features, including experiment design, dataset design, label reliability analysis, and implementing LLM-as-judge methods.
• Run Rigorous Experiments: Conduct online experiments (A/B tests) and causal inference to quantify the impact of GenAI features, identify opportunities, measure lift, and ensure statistical rigor.
• Define Success Metrics: Partner with cross-functional teams to define leading/lagging indicators for GenAI feature user satisfaction, business success, and safety.
• Build Automated Systems: Research and apply state-of-the-art methodologies to build reproducible evaluation tooling that lifts rigor and efficiency across the company.
• Conduct Applied Research at the Frontier: Maintain an active pulse on the intersection of Gen AI and Data Science, innovate on methodology, and contribute to the broader technical community.

Benefits

• Equity
• Health Insurance

Culture

Requirements