Kapil Chhabra is co-founder and chief product officer of WisdomAI. On Chain of Thought he explained how companies keep business definitions current for AI agents, and how a specialized harness checks and repairs answers to questions about their data.
Episodes
What the conversations cover
These notes summarize the episodes featuring Kapil Chhabra, including other speakers in panel conversations. Follow a source link to read the discussion in context.
EP 75 Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra
- Kapil Chhabra, co-founder and CPO of WisdomAI, sees the enterprise AI stack settling into layers: company data at the bottom, the models, a context layer that bridges the model’s view of the world and the company’s data, and a harness specialized for one task on top. He says the harness is little talked about today and “will become a big deal.” In his analogy, the model is the surgeon, the context is the patient history, and the harness is the hospital system with its charts, checklists, instruments and back office. Episode takeaways
- In a WisdomAI survey of senior AI, analytics and data leaders, Chhabra says 93% were using LLMs and agents to access internal data, but only 7% could say they had scaled those operations. He puts the gap down to trust: data leaders can’t yet deliver trust in the data coming out of these chat systems, and the missing piece is context, such as the company’s own definitions of ARR, churn and when the fiscal year ends, which no model knows out of the box. Episode takeaways
- A semantic layer is necessary but not sufficient, Chhabra says. It was designed for deterministic BI tools, while a chat agent reasons on the fly over any question. The context layer adds natural-language instructions (finance may mean a fiscal quarter by Q1 while marketing means a calendar quarter) and examples of what good SQL or Python looks like. He keeps institutional context, set by a person with authority such as a subject-matter expert, separate from personal memory: his own dislike of pie charts belongs in memory, not in the company’s definitions. Episode takeaways
Positions and best quotes
What Kapil Chhabra argued on the show, as verbatim transcript excerpts. Each one links to the moment it was said.
EP 75 Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra
- Where LLMs still slip on data queries
time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times.
Transcript at 37:45Cite this quote from Kapil Chhabra
Link
“…time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times.” — Kapil Chhabra, “Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra,” Chain of Thought, hosted by Conor Bronsdon, September 24, 2026, at 37:45. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-17d8ad1537
APA
Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-17d8ad1537
Kapil Chhabra said, “…time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times” (Bronsdon, 2026, 37:45).
Title as published; APA uses sentence case for episode titles.
BibTeX
@misc{chainofthought-75-17d8ad1537, author = {Bronsdon, Conor}, title = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}}, howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75}, year = {2026}, month = sep, date = {2026-09-24}, url = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-17d8ad1537}, note = {Quote by Kapil Chhabra at 37:45: ``…time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times.''}, }Quote card
Open the quote card image (1200×630). Embed it with a link back to this quote:
<a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-17d8ad1537"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-17d8ad1537.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “…time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times.”" loading="lazy"></a>
- A specialized harness versus a frontier model given the same context
So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost.
Transcript at 54:29Cite this quote from Kapil Chhabra
Link
“So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost.” — Kapil Chhabra, “Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra,” Chain of Thought, hosted by Conor Bronsdon, September 24, 2026, at 54:29. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e1cb3c59b9
APA
Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e1cb3c59b9
Kapil Chhabra said, “So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost” (Bronsdon, 2026, 54:29).
Title as published; APA uses sentence case for episode titles.
BibTeX
@misc{chainofthought-75-e1cb3c59b9, author = {Bronsdon, Conor}, title = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}}, howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75}, year = {2026}, month = sep, date = {2026-09-24}, url = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e1cb3c59b9}, note = {Quote by Kapil Chhabra at 54:29: ``So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost.''}, }Quote card
Open the quote card image (1200×630). Embed it with a link back to this quote:
<a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e1cb3c59b9"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-e1cb3c59b9.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost.”" loading="lazy"></a>
- How much of the dashboard estate gets used
on average, and Forrester did this study, only 20% of the dashboards actually get utilized in the organization.
Transcript at 1:16:12Cite this quote from Kapil Chhabra
Link
“…on average, and Forrester did this study, only 20% of the dashboards actually get utilized in the organization.” — Kapil Chhabra, “Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra,” Chain of Thought, hosted by Conor Bronsdon, September 24, 2026, at 1:16:12. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-81c17cea7d
APA
Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-81c17cea7d
Kapil Chhabra said, “…on average, and Forrester did this study, only 20% of the dashboards actually get utilized in the organization” (Bronsdon, 2026, 1:16:12).
Title as published; APA uses sentence case for episode titles.
BibTeX
@misc{chainofthought-75-81c17cea7d, author = {Bronsdon, Conor}, title = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}}, howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75}, year = {2026}, month = sep, date = {2026-09-24}, url = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-81c17cea7d}, note = {Quote by Kapil Chhabra at 1:16:12: ``…on average, and Forrester did this study, only 20\% of the dashboards actually get utilized in the organization.''}, }Quote card
Open the quote card image (1200×630). Embed it with a link back to this quote:
<a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-81c17cea7d"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-81c17cea7d.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “…on average, and Forrester did this study, only 20% of the dashboards actually get utilized in the organization.”" loading="lazy"></a>
-
Who is in the right position to accept a change in the context that is going to impact all the agents that are using it? is something that the organizations need to decide.
Transcript at 51:20
Quotes are verbatim, with ellipses marking omitted words. Automatically selected quotes may have filler words removed.
In their words
Only 7% across the whole set were able to say that they have scaled the operations. And that's the missing gap.
Kapil Chhabra Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra · 14:27 Cite this quote from Kapil Chhabra
Link
“Only 7% across the whole set were able to say that they have scaled the operations. And that's the missing gap.” — Kapil Chhabra, “Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra,” Chain of Thought, hosted by Conor Bronsdon, September 24, 2026, at 14:27. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-45879be441
APA
Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-45879be441
Kapil Chhabra said, “Only 7% across the whole set were able to say that they have scaled the operations. And that's the missing gap” (Bronsdon, 2026, 14:27).
Title as published; APA uses sentence case for episode titles.
BibTeX
@misc{chainofthought-75-45879be441,
author = {Bronsdon, Conor},
title = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}},
howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75},
year = {2026},
month = sep,
date = {2026-09-24},
url = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-45879be441},
note = {Quote by Kapil Chhabra at 14:27: ``Only 7\% across the whole set were able to say that they have scaled the operations. And that's the missing gap.''},
} Quote card
Open the quote card image (1200×630). Embed it with a link back to this quote:
<a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-45879be441"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-45879be441.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “Only 7% across the whole set were able to say that they have scaled the operations. And that's the missing gap.”" loading="lazy"></a>
It is necessary, but it is not sufficient.
Kapil Chhabra Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra · 17:57 Cite this quote from Kapil Chhabra
Link
“It is necessary, but it is not sufficient.” — Kapil Chhabra, “Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra,” Chain of Thought, hosted by Conor Bronsdon, September 24, 2026, at 17:57. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e6db282029
APA
Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e6db282029
Kapil Chhabra said, “It is necessary, but it is not sufficient” (Bronsdon, 2026, 17:57).
Title as published; APA uses sentence case for episode titles.
BibTeX
@misc{chainofthought-75-e6db282029,
author = {Bronsdon, Conor},
title = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}},
howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75},
year = {2026},
month = sep,
date = {2026-09-24},
url = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e6db282029},
note = {Quote by Kapil Chhabra at 17:57: ``It is necessary, but it is not sufficient.''},
} Quote card
Open the quote card image (1200×630). Embed it with a link back to this quote:
<a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e6db282029"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-e6db282029.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “It is necessary, but it is not sufficient.”" loading="lazy"></a>
Transcript excerpts; ellipses mark omitted words. Some automatically selected quotes have filler words removed.
Explained on AI, decoded
- What is a context window in AI, and why does it fill up?
- How do you make an agent's memory portable across apps?
- What is the difference between a semantic layer and a context layer for AI?
- What is a token in AI, and why does it decide what AI costs?
- Why do LLMs hallucinate?
- Should you use MCP or build a custom integration to connect AI to your tools?
- What is the difference between prompt, context, and memory engineering?
- What is context in an AI agent?
- What makes an AI agent different from an LLM?
- How do you decide what information an AI assistant may receive?
- What's the difference between human in the loop and human on the loop?