Tech Stack
Causal InferenceRetention AnalyticsMulti-Armed BanditsStatistical Power AnalysisStatistical ValidityCohort AnalysisSurvival AnalysisChurn PredictionDauWauMauRolling RetentionN-Day RetentionSegmentationFunnel AnalysisPredictive ModelingPysparkSQLData PipelinesAutomated DashboardsTableauLookerMetabaseData QualityStatisticsHypothesis TestingBayesian MethodsPythonPandasNumpyScipyStatsmodelsScikit-LearnOptimizelyStatsigEppoBig Data ToolsHadoopTime-Series ForecastingUplift ModelingMachine LearningPropensity ModelsClusteringRecommendation SystemsPlotlyMatplotlibSeabornReinforcement LearningBandit AlgorithmsMlopsProductionizing ModelsMlflowAirflowDocker
Solid badges = required, outlined = preferred
Responsibilities
- Design, implement, and analyze A/B tests, multi-armed bandits, and quasi-experimental methods to measure the impact of product changes.
- Apply causal inference techniques (e.g., difference-in-differences, propensity score matching) to estimate treatment effects in non-randomized settings.
- Develop and refine retention measurement frameworks (e.g., cohort analysis, survival analysis, churn prediction).
- Build and maintain scalable data pipelines using PySpark, SQL, or big data tools, and develop automated dashboards and reports.
- Partner with product managers, engineers, and marketers to translate business questions into data-driven analyses and present findings to executive stakeholders.
Soft Skills
ExperimentationA/B TestingQuasi-Experimental MethodsExperimental DesignGrowth AnalyticsProduct AnalyticsMarketing Analytics
Benefits
- Dental
- Equity
- Health Insurance
- Vision
Culture
Mission-DrivenTransparencyCustomer-ObsessedWork-Life Balance
Requirements
Preferred: MS/PhD in Statistics, Economics, Computer Science, or a quantitative field
Regions: Us
Get jobs like this in your inbox
Weekly Causal Inference, Retention Analytics, Multi-Armed Bandits hiring trends and salary data — free.
Join 8 engineers getting weekly insights
Get market intelligence in your inbox
Free weekly insights on tech hiring trends, salaries, and in-demand stacks.
Already a subscriber? Sign in
About arena
Industry: ai
Size: startup
Arena is a platform for evaluating how AI models perform in the real world, founded by researchers from UC Berkeley's SkyLab, with a mission to measure and advance the frontier of AI for real-world use. Tens of millions of people use Arena monthly to evaluate frontier systems.
View company profile →Compensation
Equity: competitive equity