A/B test dashboards
Two interactive views of an A/B test of a feature rollout in a mobile game. Arm A is the control, arm B gets the new feature, and every figure on these pages is computed in the browser from the flat extracts in the data folder.
Start with the monitor to see what happened to revenue, engagement and retention, then open the explorer to see which players drive the lift and who leaves.
Experiment monitor
Headline metrics with confidence intervals, sample ratio check, daily trends with a lift panel, retention curves and all significance tests after Holm correction.
- Users in test
- …
- ARPU in B
- …
- ARPU, B vs A
- …
Player explorer
Payer spend distribution with percentiles, revenue concentration, and an active days view that shows whether B pushes players out or only moves them earlier.
- Paying users
- …
- ARPPU, B vs A
- …
- Conversion, B vs A
- …
Main repo with the analysis, SQL and notebook Narrative readout dashboard