Free Lesson
Setting up your first AI evaluation
45 min
Feb 12, 2026 7:30 AM
Virtual (Zoom)
In this video
What you'll learn
Identify your AI feature's specific evaluation metrics
Move beyond generic metrics to specifics that measure the ways your AI feature fails for your specific use case
How to choose between deterministic and LLM-based evaluation
Understand when to use zero-cost deterministic checks vs. AI-as-judge, and why you should start with deterministic first
Build your first automated evaluation
Set up practical deterministic checks: format validation, schema checks, length limits, and value ranges
Why this topic matters
Generic metrics like "helpfulness" or "hallucination" won't tell you if your AI feature solves real user problems. A product recommendation AI that's "helpful" but recommends the wrong products is useless. Having strong evaluations in place is key to building impactful AI features that work with a certain level of accuracy.
We will start from the most simple evaluations you can do, building up to
You'll learn from

Madalina Turlea
Co-founder @Lovelaice, 10+ years in Product
Catalina Turlea
Founder @Lovelaice
.png&w=1536&q=75)