# A/B Test Sample Size Calculator

Find out how many visitors each variant of an A/B test needs before you start it. Enter the baseline conversion rate, the smallest relative improvement you want to detect, the significance level and the statistical power.

## Frequently asked questions

### How is the sample size calculated?

With the standard formula for comparing two proportions in a two-sided test, using the baseline rate, the rate after the improvement, the critical value of the significance level and the value for the power.

### What is the minimum detectable effect?

The smallest relative change you want the test to reliably detect. A baseline of 3% and an effect of 10% means detecting a change to 3.3%.

### What does power mean?

The probability that the test detects the effect if it really exists. 80% is a common choice; higher power needs more visitors.

### Why do small effects need so many visitors?

The required sample size grows roughly with the inverse square of the effect. Halving the effect you want to detect needs about four times as many visitors.

### How long will my test run?

Divide the total sample size by the visitors you get per day. Run whole weeks so weekdays and weekends are both represented.

### What significance level should I choose?

95% is the usual default. Use 99% when a false positive would be costly, which increases the sample size.

Your ad here?

[Email us](mailto:hi@dennn.is?subject=Advertising%20on%20OneClick%20Pro)

[Ad 433 tools for your AI agents through one MCP server.](https://multitaskai.com/?ref=oneclickpro)
