Data Science Lead, Google

Manisha Arora

Cracking A/B Testing Interviews

Siddarth R

Director of Data Science, Microsoft

Deep dive into the key technical concepts testing in A/B Testing Interviews

Key Focus Areas in A/B Testing Interviews

Learn the key concepts that interviewers are evaluating you on during AB Testing Interviews

How Interviewers Evaluate A/B Testing Answers

A framework to confidently design AB Tests and move from business objectives to metrics, design, and decisions.

A Clear Framework to Structure Any A/B Testing Question

Learn from a world-leading expert how to design and analyze trustworthy A/B tests to evaluate ideas, integrate AI/ML, and grow your business

Author of best-selling A/B testing book

Microsoft

Airbnb

Amazon

Dr. Ronny Kohavi

Technical fellow and VP at Microsoft & Airbnb, co-author of A/B testing book

9 March 2026

1 June 2026

Through multiple real examples of well-run experiments and stories from Microsoft, Amazon, and Airbnb, you will see the humbling reality that we are terrible at assessing the value of ideas.Trivial changes can be surprisingly useful, whereas large efforts often fail. Accelerate innovation by building Minimum Viable Products (MVPs) and features, and make the organization more evidence-based and humble as it adopts and learns to use evidence from the gold standard in science—the controlled experiment.You will understand the challenges in designing and running trustworthy randomized controlled experiments (A/B tests), including the importance of the Overall Evaluation Criterion (OEC), scaling, common pitfalls, and Twyman's Law. We cover cultural challenges, institutional memory, maturity model, observational causal studies, offline evaluation, AI/Machine learning and triggering, build-vs-buy trade-offs, challenges, and requested topics. The Advanced Topics course is designed as a technical follow-on: <a target="_blank" rel="noopener noreferrer nofollow" href="https://bit.ly/AdvancedABFS">https://bit.ly/AdvancedABFS</a>

Empower your organization to be data-driven and innovative

Internalize the humbling reality: we are poor at assessing the value of ideas

Understand the key advantages and limitations of A/B testing

Learn how to design metrics and the Overall Evaluation Criterion

Learn how to design trustworthy A/B tests

Learn about the cultural challenges

Learn about the relationship to AI and Machine Learning Modeling

Data science managers and scientists will be able to design and interpret the experimental results in a trustworthy manner

Program managers focused on growth, revenue, conversions, and prioritization will understand how to provide the org with robust clear metric

Engineering leaders will be able to make organizations more data-driven and efficient with fewer severe incidents through A/B tests

Learn advanced A/B-testing topics from a world-leading expert. Ten topics in three days of 2 hours each.

⚠️ Warning: Advanced course 

23 March 2026

15 June 2026 - Advanced

We cover advanced topics not typically addressed in courses and books and leave significant time for interactions and Q&amp;A.Classes are small: typically ~15 live attendees. The course assumes you already took <a target="_blank" rel="noopener noreferrer nofollow" href="https://bit.ly/ABCourseRonKohavi">https://bit.ly/ABCourseRonKohavi</a> or have equivalent knowledge.

Improve your A/B testing capabilities and build trust

Improve your A/B Testing capabilities and trust

Discuss your own questions

Designed as a follow-on to the flagship course: https://maven.com/kohavi/abtesting. 

Take that course first, or have equivalent knowledge

Follow-on to flagship course

Good understanding of p-value misconceptions, statistical power, OEC.

Statistics of A/B Testing

Data science managers and scientists who understand the basics of A/B testing and want to better understand advanced topics

Product and program managers who want to advance their understanding of A/B testing

Learn the skills + frameworks you need to ace interviews for senior leadership roles (Engineering Manager, Senior Manager, Team Lead). 

Director of Engineering, Career Coach

Google

Apple

Alex Kliotzkin

Director of Engineering and Career Coach

EM @ Stripe, Ex-Amazon Bar Raiseer

Stripe

Uzair Khan

Engineering Manager at Stripe and ex-Amazon Bar Raiser

Cohort 8

Cohort 9

As an engineer, you’ve mastered the coding challenges, system design, and behavioral interviews. But when it comes to Engineering Manager roles, the interview process is a different beast. You’ve likely hit a frustrating wall—interviews that feel like you’re doing everything right, but still no offer. You might not even know why you’re not breaking through.The truth? Engineering Manager interviews aren’t about discussing your experience—they’re about showcasing leadership, systems, and strategy in a way that resonates with the interviewer. To land the offer, you don't just need the right answers—you need memorable ones.This course is designed to bridge that gap and help you break through to land that Engineering Manager offer. We’ll focus on how to communicate your leadership capabilities, showcase your seniority, avoid red flags, and tailor your answers to what hiring managers are truly looking for. By the end, you’ll know exactly how to approach the interview process and confidently present yourself as the leader you know yourself to be.

Break Through the Interview Process and Land Your Engineering Manager Offer!

You'll experience mock interviews with real-time coaching feedback

You'll understand the exact hiring criteria for Engineering Manager roles

You'll learn how to convince the hiring manager (Director+)

You'll learn how to nail any behavioral question, even ones you haven't seen

You'll know exactly what the interviewer is looking for

You'll learn how to tailor your answers to go from good to memorable

Managers &amp; team leads that are getting interview opportunities but are unable to break through to land offers.

Senior Tech Leaders who have not interviewed for 7+ years and are looking for new roles (Sr. Manager, Director, VP).

Senior Software Engineers in lead roles looking to promote themselves to engineering manager by landing a new job.

Master SQL for real-world data science interviews

Seasoned data scientist & educator

Atlassian

Pinterest

Dropbox

eBay

Anirban Bhattacharyya 

Seasoned Data Scientist with 10+ years solving product analytics at scale.

Alpha Cohort

Many aspiring data scientists know basic SQL, but struggle when faced with the kind of messy, ambiguous, business-driven questions that come up in interviews. The challenge is rarely just writing syntax. It is knowing how to translate a product question into the right metric, choose the right grain of analysis, join data correctly, avoid double counting, and explain your reasoning clearly.That gap can hold back otherwise strong candidates. You may understand SQL concepts in theory, but still feel stuck when asked to calculate retention, analyze an experiment, or debug a flawed query in real time.This workshop is designed to close that gap. Instead of teaching SQL as a list of commands, it teaches SQL the way it is actually used in data science interviews: through realistic product, growth, and analytics problems. Students will build confidence solving hands-on exercises that reflect real interview settings, from fundamentals to advanced topics like window functions and recursive CTEs.The goal is to help students move beyond memorizing syntax and become interview-ready problem solvers who can write clean SQL, reason through edge cases, and communicate like strong data scientists.

Master SQL interviews, think like a data scientist, and turn messy business questions into clear, confident analysis.

Solve SQL interview questions with structure:

Translate business problems into metrics

Write cleaner analytical SQL

Use joins, windows, cohorts, and funnels

Avoid common interview mistakes

Explain your approach with confidence

Aspiring Data Scientists Learners preparing for data science and analytics interviews who want to build strong, practical SQL skills.

Analysts Moving Upmarket Data and business analysts who know basic SQL and want to tackle more advanced, interview-style problems.

Product-Focused Data Professionals Data scientists and product analysts who want to sharpen SQL for funnels, retention, experimentation

Crack Your Data Science Interviews 

Agentic AI

Coding with AI

AI Workflows

Claude Code

OpenClaw

Vibe Coding

AI Evals

AI Transformation

RAG & Search

AI for PMs

AI for Engineers

AI for Designers

AI for Marketers

AI for Founders

Product Sense

Product Discovery

User Research

Prototyping

Growth

Analytics

Tech Foundations

Strategy

Influence

Leadership

Career Growth

Machine Learning

LLM Ops

Context Eng

Security

System Design

Figma

Design Systems

Visual Design

Design Strategy

Automation

Content Marketing

Demand Gen

Go-to-Market

Product Marketing

Positioning

Social Media

Brand

B2B Marketing

SEO & AEO

AI for Leaders

AI Governance

Communication

Management

People Operations

Exec Presence

Storytelling

Goal-setting

Personal Brand

Fundraising

Everyone

Operators

Data Scientists

Business Analysts

User Researchers

Customer Success

Project Managers

HR Professionals

Sales People

Lawyers

Finance

Investors

Real Estate

Educators

Creators

Product managers who drive strategy, development, and launch of products.

Data scientists who apply statistical and ML techniques to extract insights from data.

Getting promoted, navigating job transitions, and advancing to the next level in your career.

Using data and metrics to measure performance, run experiments, and inform decisions.

Cracking A/B Testing Interviews

What you'll learn

Why this topic matters

You'll learn from

Siddarth R