Evaluating Agentic AI Applications Beyond Vibe Checks

Aishwarya Naresh Reganti is an Applied Science Tech Lead at the AWS Generative AI Innovation Center (GenAIIC), where she leads initiatives to develop and deploy production-ready generative AI solutions for AWS clients. With over 9 years of experience in machine learning, she has published more than 35 research papers at top-tier AI conferences, including NeurIPS, AAAI, and CVPR.

Aishwarya has taught professional courses on generative AI at renowned institutions like MIT and Oxford. She has also designed courses that have reached over 10,000 students globally and have formed the foundation for several academic programs and industry training curricula.

Recognized as one of the most prominent voices in enterprise AI, with over 90,000 professionals following her on LinkedIn, she is a sought-afte

Aishwarya actively collaborates with leading research professors and provi

Kiriti Badam is a member of the technical staff at OpenAI, with over a decade of experience designing high-impact enterprise AI systems. He specializes in AI-centric infrastructure, with deep expertise in large-scale compute, data engineering, and storage systems.

Prior to OpenAI, Kiriti was a founding engineer at Kumo.ai, a Forbes AI 50 startup, where he led the development of infrastructure that enabled training hundreds of models daily—driving significant ARR growth for enterprise clients.

Kiriti brings a rare blend of startup agility and enterprise-scale depth, having worked at companies like Google, Samsung, Databricks, and Kumo.ai. At Google Ads, he built globally distributed key-value stores that powered ad systems generating tens of billions in annual revenue.

He holds a Master’s degr

Claire Longo is an AI leader with over a decade of experience in Data Science, Machine Learning, and MLOps. From coding in R as a Statistician at DOE National Laboratories to building recommender systems at Trunk Club, she has navigated the evolving AI landscape—teaching herself Python and ML along the way. She has led cross-functional AI teams at Twilio, Opendoor, and Arize AI, focusing on the engineering best practices required to bring AI models from ideation to production at scale. Currently at Comet, Claire researches AI trends and shares best practices with the developer community. She holds a Bachelor’s in Applied Mathematics and a Master’s in Statistics from The University of New Mexico.