AI Observability
Seeing inside AI systems once they hit production.
AI observability is the practice of instrumenting AI systems so you can see what they actually do in production — tracing each step of an agent or pipeline, collecting telemetry, and surfacing the signals that explain failures and drift.
14 episodes
- We Built Agents, Nobody Built HR | Tyler Akidau, Redpanda
- Explaining Eval Engineering | Galileo's Vikram Chatterji
- Architecting AI Agents: The Shift from Models to Systems | Aishwarya Srinivasan
- From Demo to Defensibility: How to Build an AI Business that Lasts | Aurimas Griciūnas
- Mindset Over Metrics: How to Approach AI Engineering | Hamel Husain
- Mastering Multi-Agent Systems | MongoDB’s Mikiko Chandrasekhar
- The AI Agent Trust Gap: Bridging Risk to Reliability | Elastic’s Philipp Krenn
- Architecting Reliable Agentic AI | Cisco’s Giovanna Carofiglio on the AGNTCY Collective
- The Emerging AI Agent Stack | CrewAI’s João Moura
- The 2025 AI Shift: From Chat to Task Completion & Reliable Action | Galileo Founders
- AI Won't Solve Your Toughest Engineering Problems | Honeycomb’s Charity Majors
- Inside IBM's watsonx: Building Enterprise AI That Ships | Dr. Maryam Ashoori
- The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio
- The State of AI: Open-Source Models & Enterprise Trust | May Habib
Explainers on this topic
- AI Agent Metrics Beyond Accuracy
- How to Cut AI Agent Costs
- Observability vs. Evaluation vs. Benchmarking
- What Is AI Observability
- What Is LLM-as-a-Judge
- On-Premise AI for Regulated Enterprises
Terms on this topic
Guests on this topic
Tyler AkidauVikram ChatterjiAishwarya SrinivasanAurimas GriciūnasHamel HusainMikiko ChandrasekharPhilipp KrennGiovanna CarofiglioJoão MouraAtindriyo SanyalCharity MajorsMaryam AshooriMehmet Murat EzbiderliVinnie GiarrussoGrant LedfordMay Habib