Vikram Chatterji is the co-founder and CEO of Galileo, an AI reliability and evaluation company, and a recurring co-host of Chain of Thought in the show’s first season. Across several episodes he broke down eval engineering, the ROI of enterprise AI, and why evaluations need to become infrastructure rather than one-off tests.
AI AgentsAI Evaluation & ReliabilityAI ObservabilityAI EngineeringEnterprise AIOpen Source AIAI Energy & Data Centers
Latest episode with Vikram Chatterji · EP 46
Explaining Eval Engineering | Galileo's Vikram Chatterji
Vikram Chatterji, Galileo ·
Episodes
- Explaining Eval Engineering | Galileo's Vikram Chatterji
- The 2025 AI Shift: From Chat to Task Completion & Reliable Action | Galileo Founders
- AI in 2025: Agents & The Rise of Evaluation-Driven Development (ft. Dev Interrupted)
- Why Most Enterprise AI Projects Fail to Show ROI | HP, ServiceNow & Accenture
- GenAI Predictions for 2025 | Databricks & Cohere
In their words
That's the research that we've that we've been doing for the last couple of years. So continuous learning through human feedback basically means that now you add that natural language feedback, like I said, and we auto tune the LLM as a judge. And now very quickly with four or five pieces of feedback, you can get it to a fairly high degree of accuracy.
Explaining Eval Engineering | Galileo's Vikram Chatterji