Free Lesson
A/B Testing Myths
45 min
Feb 20, 2025 11:00 AM
Virtual (Zoom)
In this video
What you'll learn
A/B testing myths
Many myths are based on some real limitation. We will review the claim and why it is usually a myth in practice
Example myths
Overstated effect, concurrent experiments are invalid, use pre-post analysis with few users, 95% confidence has 5% error
Suggest and vote on myths
https://bit.ly/ABTestingMythsSuggestions
Why this topic matters
A/B testing has transformed many organizations and helped accelerate innovation, but there are calls to limit or stop A/B testing based on myths
You'll learn from
Ronny Kohavi
Technical fellow and VP at Microsoft & Airbnb, co-author of A/B testing book
Worked at
