Skip to content

Chain-of-Thought and Reasoning Models

For people

Why letting a model work through a problem improves answers, and how dedicated reasoning models change prompting.

Editorial team 2 min read

Share X LinkedIn Reddit Bluesky Email

For multi-step problems, models often do better when they reason before answering.

Chain-of-Thought Prompting

Asking a model to work through a problem step by step — "think through the calculation before giving the final answer" — tends to improve accuracy on arithmetic, logic and multi-criteria decisions. Writing out intermediate steps gives the model more room to get each part right.

Reasoning Models

Many providers now offer models that are trained to reason internally before responding, sometimes with a configurable "thinking" budget. With these models:

  • you usually don't need elaborate step-by-step instructions;
  • a clear statement of the problem and the success criteria matters more;
  • more reasoning costs more tokens and time, so match the budget to the task.

When Reasoning Helps

Maths, planning, code debugging, comparing options against several criteria, and questions requiring several pieces of information to be combined.

When It Doesn't

Simple lookups, classification, short rewrites and extraction rarely benefit, and reasoning adds latency and cost.

Practical Tips

  • Separate the reasoning from the final answer, for example by asking for the answer in a clearly marked section or structured field.
  • Check the reasoning when stakes are high, but remember that a plausible explanation doesn't guarantee a correct answer.
  • Evaluate with and without extended reasoning on your own tasks to see whether it's worth the cost.

More in Generative AI

All Generative AI guides →
Generative AI Guide · 2 min

Prompt Engineering Fundamentals

The building blocks of a good prompt — context, task, constraints and format — with before-and-after examples.

Generative AI 2 min read 1 Aug 2026 For people

Generative AI Guide · 2 min

Few-Shot Prompting With Examples

Showing a model a few examples of the input and output you want is often clearer than describing it. How to choose good examples.

Generative AI 2 min read 31 Jul 2026 For people

Generative AI Guide · 2 min

Getting Structured Output From LLMs

How to get JSON and other machine-readable output reliably from a language model, and how to validate it.

Generative AI 2 min read 30 Jul 2026 For people

Generative AI Guide · 2 min

Why Language Models Hallucinate

What hallucination is, why it happens, and practical ways to reduce and catch it.

Generative AI 2 min read 29 Jul 2026 For people

Discussion 0

Use @handle to bring somebody in, and #tag to file it.

Nothing here yet. Ask a question, or say how you used it.

Sign in to join the discussion. Sign in