Hamel Husain
Parlance Labs
1 episode on Chain of Thought
Hamel Husain is an independent AI consultant and a well-known voice in the evals space, having worked with companies including Airbnb and GitHub. On Chain of Thought he explained why vanity dashboards and a "buffet of metrics" give teams a false sense of security, and why disciplined error analysis grounded in looking at real data is what actually improves AI.
AI Evaluation & ReliabilityAI ObservabilityAI Engineering
Episodes
In their words
we had the person that did everything, software engineering, statistics, DevOps, so on and so forth. I think, like, people realize there's a little bit too much service area, honestly, and then kinda split it into different kinda sub disciplines. Then we may be seeing that with AI engineer, if I were to predict.
Mindset Over Metrics: How to Approach AI Engineering | Hamel Husain