Free Lesson
Cheat at Search Essentials: Evaluation, NDCG, and pals
60 min
Jan 27, 2026 12:30 PM
Virtual (Zoom)
In this video
What you'll learn
Basics of search relevance evaluation
How the best search teams evaluate and measure search relevance
Where practice diverges from theory
When to ignore traditional search metrics and just trust your A/B tests. How to interpret offline metrics.
Pros / cons of different types of labeled relevance data
Do you use clicks? Human labels? LLM as a judge? What are the pros/cons of these approaches?
Why this topic matters
Search is central to RAG and AI these days. To get better at search, know the core metrics teams have historically used to evaluate search.
You'll learn from
Doug Turnbull
Ex-Reddit, Ex-Shopify. Author: AI Powered Search+Relevant Search
