Skip to content

AI Glossary · Concepts

What is AI Hallucination?

AI Hallucination

An AI hallucination is generated content that is false, fabricated, or unsupported by the evidence it should reflect. A fluent answer can contain a hallucination even when it sounds confident or includes a citation.

Also known as: hallucination, AI hallucinations, confabulation

· Updated · Chain of Thought

AI Evaluation & Reliability

  • 4 explainers
  • 8 episodes
  • 1 source

A model can invent a reference, misstate a number, or add a claim that the supplied document never made. These failures are related but different: a statement may be true in the world yet unsupported by the given source, or faithfully repeat a source that is itself wrong.

In episode 54, at 3:30, Dan Klein argues that fluent, plausible output is insufficient for enterprise reliability. His “plausibility engine” framing describes the deployment problem; it does not mean models are incapable of producing correct facts.

Example: a support answer cites the correct returns page but invents a fee. Inspect the actual passage and compare each important claim with it. A citation’s presence is not verification.

Mitigations include better evidence selection, constrained tasks, appropriate abstention, and output checks. Their effectiveness depends on the application. Evaluate faithfulness alongside correctness and answer relevance, and use the explainer to separate model and data failure modes.

Sources

Go deeper

From the conversation