Guests

Hamel Husain

Parlance Labs

1 episode on Chain of Thought

Hamel Husain is an independent AI consultant and a well-known voice in the evals space, having worked with companies including Airbnb and GitHub. On Chain of Thought he explained why vanity dashboards and a "buffet of metrics" give teams a false sense of security, and why disciplined error analysis grounded in looking at real data is what actually improves AI.

AI AgentsAI Evaluation & ReliabilityAI Engineering

• Mindset Over Metrics: How to Approach AI Engineering | Hamel Husain Aug 20, 2025 · Transcript