Skip to content

The concept behind the show

AI reasoning, explained

Chain of Thought takes its name from a sequence of intermediate reasoning steps leading to an answer. Explore how that idea appears in prompting and reasoning models, what extra computation can change, and how to evaluate the result. The glossary and conversations below cover the vocabulary and engineering choices.

  • 4 core terms
  • 6 conversations
  • 3 common questions

How the idea evolved

  1. Show the work2022

    Chain-of-thought prompting uses instructions or examples to elicit intermediate steps before an answer. In the 2022 study by Wei and colleagues, examples containing reasoning steps improved arithmetic, commonsense and symbolic reasoning results for the large language models tested. Those benchmark results do not establish that the same prompt will improve every model or task.

  2. Spend more computation answeringTest-time compute

    Reasoning models are trained to use additional computation when producing an answer. Some offer a choice: at its February 2025 launch, Claude 3.7 Sonnet supported both ordinary responses and extended thinking. Test-time compute also includes methods for searching and checking candidate answers. In Snell and colleagues’ research, prompt difficulty affected which approach used that compute most effectively.

    Training time A bigger model
    or
    Test time More computation while answering
  3. Know the limitsMeasure on your workload

    A written chain of reasoning can omit information that influenced an answer. In an April 2025 study, Claude 3.7 Sonnet and DeepSeek R1 often omitted hints they had used. Check the final answer, including factual claims that could be AI hallucinations. Measure quality, cost and latency on your workload before choosing how much computation to spend.

Prompting vs. reasoning models

The same idea, in two places: in your prompt, or inside the model.

Aspect Chain-of-thought prompting Reasoning model
How you get it Ask for intermediate steps, or give examples that contain them Trained to use additional computation; some models make extended thinking optional
What it does Elicits intermediate steps before the answer Spends additional computation while producing the answer
The lever The prompt Test-time compute: more computation while answering
Both Results depend on the model, task and method, and more computation costs latency and tokens. A written chain can omit what influenced the answer, so check the result.

The vocabulary

Browse the full AI glossary →

From the conversations

Where guests building this work through reasoning, with full transcripts.

Go deeper

Short, answer-first explainers from AI, decoded.

Common questions

What is chain of thought in AI?
Chain of thought is a sequence of intermediate reasoning steps leading to an answer. In the 2022 chain-of-thought prompting study, examples containing those steps improved results on arithmetic, commonsense and symbolic reasoning benchmarks for the large language models tested.
What is the difference between chain-of-thought prompting and a reasoning model?
Chain-of-thought prompting asks for intermediate steps or provides examples containing them. Reasoning models are trained to use additional computation when producing an answer, but extended thinking is not always the default: some models offer a choice of faster responses or extended thinking.
Does reasoning make AI more accurate?
It can, but the benefit depends on the model, task and method. Research on test-time compute found that prompt difficulty affected which approach worked best. More computation also costs time and resources. Test answer quality, cost and latency on your workload rather than assuming that a longer explanation is more accurate.

Keep reasoning with us

New conversations every week

Chain of Thought is where builders reason through what's changing in AI, hosted by Conor Bronsdon. New conversations every week.

Get the newsletter → Browse all episodes → Start here →