A/B Experiment Monitor
… users in … arms (A control, B treatment), over … days: … to …
…
…B
A …
…95% CI … to …
…
…
…B
A …
…95% CI … to …
…
…
…B
A …
…95% CI … to …
…
…
…B
A …
…95% CI … to …
…
…
…B
A …
…95% CI … to …
…
Sample ratio check: …
… / …
Users A …Users B …
Chi-square …, p = …
Expected 50/50, pass at p > 0.01
Daily trends
A vs B by day. Hover for values and B vs A. The lower panel shows the daily lift of B over A for the selected metric.
A (control)B (treatment)
Retention
Share of each arm's cohort still active on day 1, 3, 7, 14 and 28. Lower panel: B minus A in percentage points.
A (control)B (treatment)
The early gap closes by D14 (D14 and D28 not significant). Per the README re-audit, the early gap is not extra churn: the same share of users disengages in both arms.
All 11 tests
Relative lift of B over A in % with 95% CI, grouped by metric family. Right of zero means B is higher. Color shows the Holm-adjusted verdict.
Significant after HolmNot significant
Test results
Means are per user; lift and CI are relative to A. Click a header to sort.