How to Run an A/B Test as a Product Manager
Netflix once ran an A/B test, back when it still shipped DVDs, on giving customers exactly what they said they wanted: faster access to new releases. The rollout cost roughly a million dollars. Retention moved by only 0.05%, about 5,000 users, a result Netflix’s former VP of Product Gibson Biddle has cited as a case…