Skip to content

Chain-of-Thought and Reasoning Models

Why letting a model work through a problem improves answers, and how dedicated reasoning models change prompting.

Editorial team 2 min read

For multi-step problems, models often do better when they reason before answering.

Chain-of-Thought Prompting

Asking a model to work through a problem step by step — "think through the calculation before giving the final answer" — tends to improve accuracy on arithmetic, logic and multi-criteria decisions. Writing out intermediate steps gives the model more room to get each part right.

Reasoning Models

Many providers now offer models that are trained to reason internally before responding, sometimes with a configurable "thinking" budget. With these models:

  • you usually don't need elaborate step-by-step instructions;
  • a clear statement of the problem and the success criteria matters more;
  • more reasoning costs more tokens and time, so match the budget to the task.

When Reasoning Helps

Maths, planning, code debugging, comparing options against several criteria, and questions requiring several pieces of information to be combined.

When It Doesn't

Simple lookups, classification, short rewrites and extraction rarely benefit, and reasoning adds latency and cost.

Practical Tips

  • Separate the reasoning from the final answer, for example by asking for the answer in a clearly marked section or structured field.
  • Check the reasoning when stakes are high, but remember that a plausible explanation doesn't guarantee a correct answer.
  • Evaluate with and without extended reasoning on your own tasks to see whether it's worth the cost.

More in Generative AI

All Generative AI guides →
Generative AI Guide · 2 min

Prompt Engineering Fundamentals

The building blocks of a good prompt — context, task, constraints and format — with before-and-after examples.

Generative AI 2 min read 24 Jul 2026

Generative AI Guide · 2 min

Few-Shot Prompting With Examples

Showing a model a few examples of the input and output you want is often clearer than describing it. How to choose good examples.

Generative AI 2 min read 23 Jul 2026

Generative AI Guide · 2 min

Getting Structured Output From LLMs

How to get JSON and other machine-readable output reliably from a language model, and how to validate it.

Generative AI 2 min read 22 Jul 2026

Generative AI Guide · 2 min

Why Language Models Hallucinate

What hallucination is, why it happens, and practical ways to reduce and catch it.

Generative AI 2 min read 21 Jul 2026