Free Lesson
Evaluating LLMs for Your Applications
Part of The AI Evaluation Handbook
30 min
Jul 9, 2024 12:00 PM
Virtual (Zoom)
In this video
What you'll learn
Framework for choosing the right LLMs
Identify the best GenAI model for your needs based on budget, latency and team expertise etc
Setting Evaluation Criteria
Learn how to set clear, actionable metrics despite challenges with benchmarks and real-world examples.
Case Study: Contract Processing Application
We'll use a contract processing application to illustrate how to apply the principles you just learn.
Why this topic matters
Evaluating GenAI applications is crucial for product managers to ensure that the chosen AI model meets not only technical specification but also business goals and user expectations. Understanding how to select the right model will help you get started on the path to define model specific evaluation metrics, this will allow teams to iterate quickly and create impactful solutions.
You'll learn from
Mahesh Yadav
GenAI Product Lead at Google, previously at Meta, Amazon, and Microsoft