Guests

Alex Ratner

Snorkel AI

1 episode on Chain of Thought

Alex Ratner

Alex Ratner is the co-founder and CEO of Snorkel AI, which he started out of Chris Ré’s Stanford lab while helping establish data-centric AI as a field. On Chain of Thought he mapped the evaluation gap keeping enterprise agents stuck in demos and walked through Snorkel’s Open Benchmarks grant program.

AI AgentsAI Evaluation & ReliabilityEnterprise AIMultimodal AIAI Coding

Cover art for Every AI Agent Has an Evaluation Gap | Alex Ratner, Snorkel AI

Latest episode with Alex Ratner · EP 57

Every AI Agent Has an Evaluation Gap | Alex Ratner, Snorkel AI

Alex Ratner, Snorkel AI ·

Episodes

In their words

If you want your model to do something different, you don't go and perform brain surgery on the neurons. You don't reinvent the architecture of the algorithm. Let me go and invent a new post-transformer architecture. No, you get data.

Every AI Agent Has an Evaluation Gap | Alex Ratner, Snorkel AI