Alex Ratner
Snorkel AI
1 episode on Chain of Thought
Alex Ratner is the co-founder and CEO of Snorkel AI, which he started out of Chris Ré’s Stanford lab while helping establish data-centric AI as a field. On Chain of Thought he mapped the evaluation gap keeping enterprise agents stuck in demos and walked through Snorkel’s Open Benchmarks grant program.
AI AgentsAI Evaluation & ReliabilityEnterprise AIMultimodal AI
Episodes
In their words
that's the environment. But you also need the task itself of what you're trying to write the book report on and what themes you're supposed to be expounding on. That's often called the task, but that [37:26] Conor Bronsdon: [OVERLAP] Ancient Sumerian [37:27] Alex Ratner: [OVERLAP] was what [37:27] Conor Bronsdon: [OVERLAP] theology, obviously. [37:28] Alex Ratner: [OVERLAP] Yeah, [37:28] Conor Bronsdon: [OVERLAP] Yeah.
Every AI Agent Has an Evaluation Gap | Alex Ratner, Snorkel AI