Skip to content

Evaluating Claims About AGI

How to read headlines, announcements and predictions about general AI with healthy scepticism.

Editorial team 1 min read

AGI generates bold claims from companies, researchers, investors and critics. A few questions help separate substance from hype.

What Exactly Is Claimed?

"AGI achieved", "sparks of AGI", "AGI by next year" — each depends on a definition. Look for specifics: which capabilities, measured how?

What's the Evidence?

  • Independent evaluations or only internal tests?
  • Benchmarks that might be contaminated by training data?
  • Cherry-picked demonstrations or systematic results?

Who Benefits?

Fundraising, product launches, attention and policy influence all create incentives to exaggerate — or to dismiss.

Is Reliability Addressed?

A model solving a hard problem once is different from solving it dependably in real conditions.

What Do Critics Say?

Look for responses from independent researchers.

Beware Both Extremes

Hype overstates capabilities; dismissal ignores genuine progress. The truth is usually more nuanced.

Focus on Practical Evidence

For your own decisions, test systems on your tasks. What they reliably do for you matters more than labels.

More in AGI

All AGI guides →
AGI Guide · 1 min

How Would We Know AGI Has Arrived?

Tests, benchmarks and practical measures proposed for recognising general intelligence in machines, and their limits.

AGI 1 min read 17 Jul 2025

AGI Guide · 1 min

A Brief History of the Quest for AGI

From the 1956 Dartmouth workshop through AI winters to large language models: how ambitions for general AI evolved.

AGI 1 min read 16 Jul 2025