Senior Data Scientist - Generative AI
Posted
$220,300 – $262,380 USD
Tech Stack
Responsibilities
- Develop Evaluation Frameworks: Design and operationalize rigorous evaluation systems for GenAI features or internal AI Agents, including experiment design, dataset design, label reliability analysis, and implementing and finetuning LLM-as-judge methods.
- Run Rigorous Experiments: Conduct online experiments (A/B tests) and causal inference to quantify the impact of GenAI features or AI-assisted coding tools, identifying opportunities, measuring lift, and ensuring statistical rigor.
- Define Success Metrics: Partner with cross-functional teams to define leading/lagging indicators for GenAI safety and user satisfaction, or for engineering productivity and code health.
- Build Automated Systems: Research and apply state-of-the-art methodologies to build reproducible evaluation tooling and agentic workflows that lift rigor and efficiency across the company.
- Drive Strategy & Visibility: Develop dashboards and reporting frameworks that reveal trends and translate complex data into clear, prioritized recommendations for leadership.
Soft Skills
ExperimentationCausal InferenceStatistical AnalysisProblem SolvingGenerative AI
Benefits
- Equity
- Health Insurance
Culture
Cross-Functional TeamsFast-PacedContinuous Improvement
Requirements
Required: PhD or Master’s in Statistics, Economics, Computer Science, Applied Math, Physics, Engineering, or a related quantitative field
Regions: Us
Get jobs like this in your inbox
Weekly SQL, Hive, Spark hiring trends and salary data — free.
Join 6 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About Roblox
Industry: gaming
Size: enterprise
Roblox is building a platform where tens of millions of people explore, create, play, learn, and connect in 3D immersive digital experiences.
View company profile →Compensation
Base salary: $220,300 – $262,380 USD
Equity: equity compensation