# A/B Test Significance Calculator

Check whether the difference between two conversion rates is statistically significant. Enter visitors and conversions for variants A and B and get both rates, the relative uplift, a confidence interval for the difference, the z-score and the two-sided p-value.

## Frequently asked questions

### Which test is used?

A two-sided two-proportion z-test with a pooled standard error, the standard test for comparing conversion rates of two groups.

### What does the p-value tell me?

The probability of seeing a difference at least this large if both variants actually converted equally well. If it is below 1 minus the confidence level, for example below 0.05 at 95%, the result counts as significant.

### What is the relative uplift?

How much higher or lower B's conversion rate is than A's, as a percentage of A's rate. 2% versus 2.5% is an uplift of 25%.

### Can I stop the test as soon as it is significant?

Checking repeatedly and stopping at the first significant result inflates false positives. Decide the sample size in advance, for example with the A/B Test Sample Size Calculator, and evaluate once.

### What does the interval for the difference show?

The range of plausible values for B's rate minus A's rate in percentage points, at the chosen confidence level. If it includes zero, the test is not significant.

### Does it work with very small numbers?

The z-test relies on a normal approximation and needs enough conversions in each group, as a rule of thumb at least 10. With fewer, the result is unreliable.

Your ad here?

[Email us](mailto:hi@dennn.is?subject=Advertising%20on%20OneClick%20Pro)

[Ad 433 tools for your AI agents through one MCP server.](https://multitaskai.com/?ref=oneclickpro)
