Skip to content

A/B Test Significance Calculator

Check whether the difference between two conversion rates is statistically significant. Enter visitors and conversions for variants A and B and get both rates, the relative uplift, a confidence interval for the difference, the z-score and the two-sided p-value.

Reset

Frequently asked questions

Which test is used?

A two-sided two-proportion z-test with a pooled standard error, the standard test for comparing conversion rates of two groups.

What does the p-value tell me?

The probability of seeing a difference at least this large if both variants actually converted equally well. If it is below 1 minus the confidence level, for example below 0.05 at 95%, the result counts as significant.

What is the relative uplift?

How much higher or lower B's conversion rate is than A's, as a percentage of A's rate. 2% versus 2.5% is an uplift of 25%.

Can I stop the test as soon as it is significant?

Checking repeatedly and stopping at the first significant result inflates false positives. Decide the sample size in advance, for example with the A/B Test Sample Size Calculator, and evaluate once.

What does the interval for the difference show?

The range of plausible values for B's rate minus A's rate in percentage points, at the chosen confidence level. If it includes zero, the test is not significant.

Does it work with very small numbers?

The z-test relies on a normal approximation and needs enough conversions in each group, as a rule of thumb at least 10. With fewer, the result is unreliable.

About OneClick Pro

OneClick Pro is a free collection of more than 150 web tools for everyday work: converting images and units, formatting and validating code, checking domains and SEO, and working with text, dates and numbers. Every tool runs without registration or subscription, and what you enter is only used to calculate your result and is never stored. Use it as a quick toolbox for one-off tasks, or bookmark the tools you rely on every day.