saved
Artificial intelligence now beats some of the best human forecasters
Hraness cites a source capture. The source author remains the source.
gist
An Economist Science & Technology report (read from Hindustan Times syndication after the live Economist page returned 403 and no public archive.is/ph snapshot was found) covers the Summer 2026 Metaculus Cup: for the first time an AI took first place, with other AIs second and fifth and humans third and fourth. LLM-based forecasters now approach superforecaster parity on evolving question sets, while startups add multi-model debate, paywalled data, and memory wipe for counterfactuals. Caveats remain: the cup is four months, entrants are not necessarily the world’s best, and multi-year horizons may still favor humans.
ideas
- Metaculus Cup milestone. An AI won the seasonal cup for the first time; AIs also took second and fifth, leaving third and fourth to humans across hundreds of September-resolved questions.
- LLM forecasters, not narrow models. Unlike weather-style specialized systems, these bots use general LLMs to read news and data broadly and explain reasoning—useful when persuading decision-makers.
- Startup tricks on top of scale. Multi-model investigation and debate, paywalled esoteric datasets (Mantic), pundit track-record scoring (Preseen), and memory wipe for counterfactual re-runs sit atop frontier LLM scale.
- Solo tinkerer can still win. Jeffrey Liang’s bot beat better-funded startups with under 150 hours and a couple thousand dollars of compute, and leads an AI-only Metaculus contest.
- Limits and price collapse. Four-month cups and non-elite human fields bound the claim; multi-year forecasting may still favor humans. Superforecaster work can cost over $10,000 and a week; FutureSearch sells minutes and a few dollars.
quotes
“For the first time an AI won the seasonal Metaculus Cup, a proving ground for forecasters of a wide variety of events.”
“suggested AI systems have now reached parity with the superforecasters on an evolving set of forecasting questions.”
“The human forecasters who enter Metaculus’s competitions are not necessarily the world’s best.”
“A forecast from human superforecasters can cost more than $10,000 and take a week.”