MMatt Goren
← All tools
🧪
Calculator

A/B Test Significance

Did your variant actually win, or did you just get lucky? Enter visitors and conversions for each version to get the lift, the statistical confidence, and a straight-up verdict.

Variant A (control)
Conversion rate: 4.00%
Variant B (challenger)
Conversion rate: 5.50%
Verdict
Variant B wins 🎉

At 97.43%confidence — that's above the 95% bar, so this result is unlikely to be a fluke.

Relative lift
+37.5%
Confidence
97.43%
Conversion rate
Variant A4.00%
Variant B5.50%

Two-proportion z-test, two-tailed, 95% threshold. A solid gut-check for conversion tests — for high-stakes calls, also make sure the test ran long enough to cover normal day-to-day swings.