.png&w=1536&q=75)
Free Lesson
Synthetic RAG evaluation
Part of The AI Evaluation Handbook
60 min
Oct 13, 2025 9:00 AM
Virtual (Zoom)
In this video
What you'll learn
Generating Data for RAG Evaluation
Learn how to create synthetic datasets to test retrieval-augmented generation systems.
Basic Information Retrieval Metrics
Understand the core IR metrics used to measure retrieval effectiveness and how they apply to RAG.
Text vs. Vector Search — What's Better?
Explore the tradeoffs between keyword-based search and dense vector search for real-world applications.
Why this topic matters
Evaluating retrieval-augmented generation (RAG) is crucial for building reliable AI systems. By understanding how to generate evaluation data, apply IR metrics, and choose the right search method, you’ll be able to design more effective and trustworthy applications. These concepts give you the foundation to test and improve RAG pipelines — with practical insights you can apply immediately
You'll learn from
Alexey Grigorev
Principal Data Scientist | Book Author | Instructor to 100k+ Students World-Wide
Doug Turnbull
Principal ML Engineer in Search
Previously at
