Free Lesson
Quick Introduction to A/B Testing
Part of Featured Lightning Lessons
30 min
Oct 17, 2024 11:00 AM
Virtual (Zoom)
What you'll learn
The pros and cons of A/B testing
When should you run A/B tests and why?
Necessary ingredients
How many users do you need (power)? What are you optimizing for (the OEC)?
Humbling statistics
Most experiments fail to improve the metrics they were designed to improve. Plan to fail fast and pivot often.
Twyman's Law
That A/B test that improved purchases by 20% (e.g., by rounding the buttons) is bogus. Be skeptical.
Questions? Add and vote at
https://bit.ly/QuickIntoABTQuestions
Why this topic matters
A/B testing has transformed many organizations and helped accelerate innovation.
You'll learn from
Ronny Kohavi
Technical fellow and VP at Microsoft & Airbnb, co-author of A/B testing book
Microsoft, Amazon, and Airbnb
