Jan 20, 2025
acx
Read on (unread)

Try The 2025 ACX/Metaculus Forecasting Contest

The 2025 ACX/Metaculus Forecasting Contest is now open, featuring 36 questions and a particular focus on comparing forecasting bots with human predictors. Longer summary
Scott Alexander announces the opening of the 2025 ACX/Metaculus Forecasting Contest, although the 2024 results are pending due to complications. He mentions hoping to compare Metaculus with Polymarket but couldn't due to recent events including FBI raids. Scott expresses particular interest in seeing how new forecasting bots will perform against top human forecasters in this year's contest, which includes 36 questions and offers $10,000 in prizes. Shorter summary

This is normally when I would announce the winners of the 2024 forecasting contest, but there are some complications and Metaculus has asked me to wait until they get sorted out.

But time doesn’t wait, and we have to get started on the new year’s forecasting contest to make sure there’s enough time for events to happen or not. That means the 2025 contest is now open!

This year I had hoped to arrange some kind of fair comparison with Polymarket so I could prove my thesis that it usually underperforms Metaculus - but with all the excitement of the election and the feds harassing Shayne we never got around to making it work.

So the aspect I’m most excited about this year is the bots. There are many new forecasting bots, some of them have been tested in slightly sketchy situations, and I want to see how they rank against some of ACX’s top forecasters.

I’m also excited about the question set. This year I worked together with Metaculus to try to find issues that were both rigorous enough to judge fairly and of broad enough interest that everyone can weigh in (no “AI benchmark #44523, really!).

Some sample questions out of the 36 in this year’s contest.

I hope this (and the $10,000) are enough justification to encourage you to go through these questions for another year, even before you know how you did last time (we will tell you, soon, really!)

So go take the contest, make some predictions, and I’ll meet you back here with the results in 2026!

If you enjoy this fan website, you can support us over here. Thanks a lot!
Send this article to your Kindle or e-reader

We'll email you this article as an EPUB attachment, ready to open on your Kindle, Kobo, or any other e-reader.

Enter your Send-to-Kindle email (it looks like [email protected]) below. For Amazon to accept the file, you first need to add our sender address to your approved list:

[email protected]

Open Amazon approved emails settings

On that page, open "Personal Document Settings", then add the address above under "Approved Personal Document E-mail List".

If your Kindle is linked to a non-US Amazon account, change the link's domain to match your country (for example amazon.fr or amazon.co.uk instead of amazon.com).

Email address
Enjoying this website? You can donate to support it! You can also check out my Book Translator tool.