Try The 2025 ACX/Metaculus Forecasting Contest

Create an account to save your favorites

With a free account, this article will be saved to your favorites, and the reading history kept in this browser will be preserved.

Email
Password

Already have an account? Log in

Log in to save your favorites
Email
Password
Remember me

New here? Create an account

acx
Jan 20, 2025 351 words 58 likes Read today Read Opened today Opened

The 2025 ACX/Metaculus Forecasting Contest is now open, featuring 36 questions and a particular focus on comparing forecasting bots with human predictors.

Listen · 4 min
Add to a reading list

Reading lists are hand-picked posts you can share with a link, like where to start with Scott Alexander for a friend.

New reading list with this post
41 comments
Original

This is normally when I would announce the winners of the 2024 forecasting contest, but there are some complications and Metaculus has asked me to wait until they get sorted out.

But time doesn’t wait, and we have to get started on the new year’s forecasting contest to make sure there’s enough time for events to happen or not. That means the 2025 contest is now open!

This year I had hoped to arrange some kind of fair comparison with Polymarket so I could prove my thesis that it usually underperforms Metaculus - but with all the excitement of the election and the feds harassing Shayne we never got around to making it work.

So the aspect I’m most excited about this year is the bots. There are many new forecasting bots, some of them have been tested in slightly sketchy situations, and I want to see how they rank against some of ACX’s top forecasters.

I’m also excited about the question set. This year I worked together with Metaculus to try to find issues that were both rigorous enough to judge fairly and of broad enough interest that everyone can weigh in (no “AI benchmark #44523, really!).

Some sample questions out of the 36 in this year’s contest.

I hope this (and the $10,000) are enough justification to encourage you to go through these questions for another year, even before you know how you did last time (we will tell you, soon, really!)

So go take the contest, make some predictions, and I’ll meet you back here with the results in 2026!

If you enjoy this fan website, you can support us over here. Thanks a lot!
Share this article

Did I buy another domain name just to have shorter sharing urls? I sure did! Enjoy.

(If you're posting on a public page, consider using the full URL to prevent link rot. I plan on running this website for many many years, but it too shall pass.)

Comparing versions…
Send this article to your Kindle or e-reader

We'll email you this article as an EPUB attachment, ready to open on your Kindle, Kobo, or any other e-reader.

To send to your Kindle, just use this link.

Enter your Send-to-Kindle email (it looks like [email protected]) below. For Amazon to accept the file, you first need to add our sender address to your approved list:

[email protected]

Open Amazon approved emails settings

On that page, open "Personal Document Settings", then add the address above under "Approved Personal Document E-mail List".

If your Kindle is linked to a non-US Amazon account, change the link's domain to match your country (for example amazon.fr or amazon.co.uk instead of amazon.com).

Email address
Enjoying this website? You can donate to support it! You can also check out my Book Translator tool.