Skip to content

A/B Test Sample Size Calculator

Find out how many visitors each variant of an A/B test needs before you start it. Enter the baseline conversion rate, the smallest relative improvement you want to detect, the significance level and the statistical power.

Reset

Frequently asked questions

How is the sample size calculated?

With the standard formula for comparing two proportions in a two-sided test, using the baseline rate, the rate after the improvement, the critical value of the significance level and the value for the power.

What is the minimum detectable effect?

The smallest relative change you want the test to reliably detect. A baseline of 3% and an effect of 10% means detecting a change to 3.3%.

What does power mean?

The probability that the test detects the effect if it really exists. 80% is a common choice; higher power needs more visitors.

Why do small effects need so many visitors?

The required sample size grows roughly with the inverse square of the effect. Halving the effect you want to detect needs about four times as many visitors.

How long will my test run?

Divide the total sample size by the visitors you get per day. Run whole weeks so weekdays and weekends are both represented.

What significance level should I choose?

95% is the usual default. Use 99% when a false positive would be costly, which increases the sample size.

About OneClick Pro

OneClick Pro is a free collection of more than 150 web tools for everyday work: converting images and units, formatting and validating code, checking domains and SEO, and working with text, dates and numbers. Every tool runs without registration or subscription, and what you enter is only used to calculate your result and is never stored. Use it as a quick toolbox for one-off tasks, or bookmark the tools you rely on every day.