Staging environment
Free Lesson

Design Metrics That Don't Lie with AI

45 min
Feb 18, 2026 1:30 PM
Virtual (Zoom)

In this video

What you'll learn

Distinguish vanity metrics from decision metrics

Identify metrics that create action vs. those that just look good in reports

Apply the Metric Spec Framework

Transform vague success criteria into precise, measurable specifications that AI can operationalize with confidence

Validate metric quality with analytical judgment

Master the workflow to define metrics with AI, sanity-check edge cases, and know when your metrics tell the truth

Join AI Builders Slack Community. Link: bit.ly/ai-connect

Learn Agentic Analytics workflows and AI Eval design. Get feedback on what you’re building from other AI builders.

Why this topic matters

Most teams track metrics that look impressive but drive little decisions. AI makes it easier to measure everything - which makes it easier to measure the wrong things. The gap between high performers isn't data literacy; it's metric judgment. Learn the framework that helps you define what actually matters, so you can trust your metrics to guide real product decisions.

You'll learn from

Hai Guan

Hai Guan

Head of Data at Ontra | Ex-Linkedin

Shane Butler

Shane Butler

Principal Data Scientist at Ontra

Sravya Madipalli

Sravya Madipalli

Senior Manager, Data Science @Superhuman (Prev. Grammarly)| Ex-Microsoft

Previously at

Ontra
Nextdoor
LinkedIn
Pinterest
Meta
See all products from AI Analyst Lab