Skip to content

Kapil Chhabra

WisdomAI

  • 1 episode on Chain of Thought
  • 4 topics covered
  • 1 full transcript
  • Sep 2026 first on the show
Kapil Chhabra

Kapil Chhabra is co-founder and chief product officer of WisdomAI. On Chain of Thought he explained how companies keep business definitions current for AI agents, and how a specialized harness checks and repairs answers to questions about their data.

Cover art for Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra

Episodes

What the conversations cover

These notes summarize the episodes featuring Kapil Chhabra, including other speakers in panel conversations. Follow a source link to read the discussion in context.

EP 75 Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra

  • Kapil Chhabra, co-founder and CPO of WisdomAI, sees the enterprise AI stack settling into layers: company data at the bottom, the models, a context layer that bridges the model’s view of the world and the company’s data, and a harness specialized for one task on top. He says the harness is little talked about today and “will become a big deal.” In his analogy, the model is the surgeon, the context is the patient history, and the harness is the hospital system with its charts, checklists, instruments and back office. Episode takeaways
  • In a WisdomAI survey of senior AI, analytics and data leaders, Chhabra says 93% were using LLMs and agents to access internal data, but only 7% could say they had scaled those operations. He puts the gap down to trust: data leaders can’t yet deliver trust in the data coming out of these chat systems, and the missing piece is context, such as the company’s own definitions of ARR, churn and when the fiscal year ends, which no model knows out of the box. Episode takeaways
  • A semantic layer is necessary but not sufficient, Chhabra says. It was designed for deterministic BI tools, while a chat agent reasons on the fly over any question. The context layer adds natural-language instructions (finance may mean a fiscal quarter by Q1 while marketing means a calendar quarter) and examples of what good SQL or Python looks like. He keeps institutional context, set by a person with authority such as a subject-matter expert, separate from personal memory: his own dislike of pie charts belongs in memory, not in the company’s definitions. Episode takeaways

Positions and best quotes

What Kapil Chhabra argued on the show, as verbatim transcript excerpts. Each one links to the moment it was said.

EP 75 Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra

  • Where LLMs still slip on data queries time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times. Transcript at 37:45
    Cite this quote from Kapil Chhabra

    Link

    APA

    Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-17d8ad1537

    Kapil Chhabra said, “…time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times” (Bronsdon, 2026, 37:45).

    Title as published; APA uses sentence case for episode titles.

    BibTeX

    @misc{chainofthought-75-17d8ad1537,
      author       = {Bronsdon, Conor},
      title        = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}},
      howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75},
      year         = {2026},
      month        = sep,
      date         = {2026-09-24},
      url          = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-17d8ad1537},
      note         = {Quote by Kapil Chhabra at 37:45: ``…time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times.''},
    }

    Quote card

    Open the quote card image (1200×630). Embed it with a link back to this quote:

    <a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-17d8ad1537"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-17d8ad1537.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “…time zone conversion in Clickhouse, LLMs, even the best LLMs right now are making a mistake three out of 10 times.”" loading="lazy"></a>

  • A specialized harness versus a frontier model given the same context So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost. Transcript at 54:29
    Cite this quote from Kapil Chhabra

    Link

    APA

    Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e1cb3c59b9

    Kapil Chhabra said, “So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost” (Bronsdon, 2026, 54:29).

    Title as published; APA uses sentence case for episode titles.

    BibTeX

    @misc{chainofthought-75-e1cb3c59b9,
      author       = {Bronsdon, Conor},
      title        = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}},
      howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75},
      year         = {2026},
      month        = sep,
      date         = {2026-09-24},
      url          = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e1cb3c59b9},
      note         = {Quote by Kapil Chhabra at 54:29: ``So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost.''},
    }

    Quote card

    Open the quote card image (1200×630). Embed it with a link back to this quote:

    <a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e1cb3c59b9"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-e1cb3c59b9.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “So there is a 3x difference in the time to getting the first answer. We also saw a 3.4x difference in the cost.”" loading="lazy"></a>

  • How much of the dashboard estate gets used on average, and Forrester did this study, only 20% of the dashboards actually get utilized in the organization. Transcript at 1:16:12
    Cite this quote from Kapil Chhabra

    Link

    APA

    Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-81c17cea7d

    Kapil Chhabra said, “…on average, and Forrester did this study, only 20% of the dashboards actually get utilized in the organization” (Bronsdon, 2026, 1:16:12).

    Title as published; APA uses sentence case for episode titles.

    BibTeX

    @misc{chainofthought-75-81c17cea7d,
      author       = {Bronsdon, Conor},
      title        = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}},
      howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75},
      year         = {2026},
      month        = sep,
      date         = {2026-09-24},
      url          = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-81c17cea7d},
      note         = {Quote by Kapil Chhabra at 1:16:12: ``…on average, and Forrester did this study, only 20\% of the dashboards actually get utilized in the organization.''},
    }

    Quote card

    Open the quote card image (1200×630). Embed it with a link back to this quote:

    <a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-81c17cea7d"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-81c17cea7d.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “…on average, and Forrester did this study, only 20% of the dashboards actually get utilized in the organization.”" loading="lazy"></a>

  • Who is in the right position to accept a change in the context that is going to impact all the agents that are using it? is something that the organizations need to decide. Transcript at 51:20

Quotes are verbatim, with ellipses marking omitted words. Automatically selected quotes may have filler words removed.

In their words

Only 7% across the whole set were able to say that they have scaled the operations. And that's the missing gap.

Kapil Chhabra Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra · 14:27
Cite this quote from Kapil Chhabra

Link

APA

Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-45879be441

Kapil Chhabra said, “Only 7% across the whole set were able to say that they have scaled the operations. And that's the missing gap” (Bronsdon, 2026, 14:27).

Title as published; APA uses sentence case for episode titles.

BibTeX

@misc{chainofthought-75-45879be441,
  author       = {Bronsdon, Conor},
  title        = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}},
  howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75},
  year         = {2026},
  month        = sep,
  date         = {2026-09-24},
  url          = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-45879be441},
  note         = {Quote by Kapil Chhabra at 14:27: ``Only 7\% across the whole set were able to say that they have scaled the operations. And that's the missing gap.''},
}

Quote card

Open the quote card image (1200×630). Embed it with a link back to this quote:

<a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-45879be441"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-45879be441.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “Only 7% across the whole set were able to say that they have scaled the operations. And that's the missing gap.”" loading="lazy"></a>

It is necessary, but it is not sufficient.

Kapil Chhabra Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra · 17:57
Cite this quote from Kapil Chhabra

Link

APA

Bronsdon, C. (Host). (2026, September 24). Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra (No. 75) [Audio podcast episode]. In Chain of Thought. https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e6db282029

Kapil Chhabra said, “It is necessary, but it is not sufficient” (Bronsdon, 2026, 17:57).

Title as published; APA uses sentence case for episode titles.

BibTeX

@misc{chainofthought-75-e6db282029,
  author       = {Bronsdon, Conor},
  title        = {{Why Context Alone Isn't Enough for Enterprise AI Agents | WisdomAI CPO Kapil Chhabra}},
  howpublished = {Podcast episode, \emph{Chain of Thought}, episode 75},
  year         = {2026},
  month        = sep,
  date         = {2026-09-24},
  url          = {https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e6db282029},
  note         = {Quote by Kapil Chhabra at 17:57: ``It is necessary, but it is not sufficient.''},
}

Quote card

Open the quote card image (1200×630). Embed it with a link back to this quote:

<a href="https://chainofthought.show/podcast/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/#claim-e6db282029"><img src="https://chainofthought.show/og/claims/75-why-context-alone-isnt-enough-for-enterprise-ai-agents-wisdomai-cpo-kapil-chhabra/claim-e6db282029.jpeg" width="1200" height="630" alt="Kapil Chhabra on Chain of Thought: “It is necessary, but it is not sufficient.”" loading="lazy"></a>

Transcript excerpts; ellipses mark omitted words. Some automatically selected quotes have filler words removed.