Expected Impact
+1.0%
+0.700 pp vs baseline
Decision Confidence
HIGH
p = 0.0084 · 95% level
Result Reliability
WEAK
Power: 74.9%
🚀
DECISION
PROCEED
Variant B outperforms control at the required confidence level — roll out the winning variant.
Conversion Rate Comparison
Where each group's true rate is likely to fall
Control A69.30%Variant B70.00%Threshold69.82%
What this means: Variant B is converting +1.0% better than Control — the gap is large enough to be confident this is a real effect, not chance.
Summary MetricsTest at 95% confidence
Control conversion rate
Baseline (Group A)
Variant conversion rate
Treatment (Group B)
Relative lift
% change over baseline
Absolute lift
Percentage point difference
Statistical significance
Result is significant — not due to chance
p-value
Probability of result under null hypothesis