Skip to content

AI Glossary · Concepts

What is Stochastic Parrot?

Stochastic Parrot

"Stochastic parrot" is a critical metaphor for a large language model: a system that stitches together likely sequences of words from its training data without understanding what they mean or intending to communicate. It comes from the 2021 paper "On the Dangers of Stochastic Parrots" by Emily M. Bender, Timnit Gebru, Angelina McMillan-Major and Margaret Mitchell.

Also known as: stochastic parrots

· Chain of Thought

  • 2 explainers
  • 1 source

The image is a parrot that repeats phrases it has heard, with dice deciding which one comes next. “Stochastic” means random in a statistical sense. The paper’s point is that a language model learns which words tend to follow which, so it can produce text that sounds coherent while having, in Bender’s words to UW News, “no communicative intent.” Readers supply the meaning and may trust the output more than they should.

You can see the concern in a customer-service bot that confidently quotes a refund policy the company never had. The sentence is fluent and plausible, and it is wrong. That failure is what this site calls an AI hallucination.

The original paper was about more than the metaphor. It also raised the environmental cost of ever larger models, the biases baked into scraped training data and the difficulty of documenting what that data contains. Those are sourced claims from the paper as described by the University of Washington.

Whether today’s large language models are “only” stochastic parrots is still argued. Critics use the phrase to say fluency is not understanding. Others point to models solving new problems as evidence of something more. That is an open debate, not a settled fact. Editorially, the useful takeaway does not depend on who wins it: a model’s confidence is not evidence that it is right, so outputs that matter need grounding in sources and checks. For how next-word prediction works, see How Do Large Language Models Work?.

Sources

Go deeper