Jan 20, 2025
acx
Read on (unread)

Try The 2025 ACX/Metaculus Forecasting Contest

The 2025 ACX/Metaculus Forecasting Contest is now open, featuring 36 questions and a particular focus on comparing forecasting bots with human predictors. Longer summary
Scott Alexander announces the opening of the 2025 ACX/Metaculus Forecasting Contest, although the 2024 results are pending due to complications. He mentions hoping to compare Metaculus with Polymarket but couldn't due to recent events including FBI raids. Scott expresses particular interest in seeing how new forecasting bots will perform against top human forecasters in this year's contest, which includes 36 questions and offers $10,000 in prizes. Shorter summary

This is normally when I would announce the winners of the 2024 forecasting contest, but there are some complications and Metaculus has asked me to wait until they get sorted out.

But time doesn’t wait, and we have to get started on the new year’s forecasting contest to make sure there’s enough time for events to happen or not. That means the 2025 contest is now open!

I’ll be honest, I haven’t been very involved in these contests for a few years and am mostly watching from the sidelines now. This year I had hoped to arrange some kind of fair comparison with Polymarket so I could prove my thesis that it usually underperforms Metaculus - but with all the excitement of the election and the feds harassing Shayne we never got around to making it work. So the aspect I’m most excited about this year is the bots. There are many new forecasting bots, some of them have been tested in slightly sketchy situations, and I want to see how they rank against some of ACX’s top forecasters. I hope this (and the $10,000) are enough justification to encourage you to go through these questions for another year, even before you know how you did last time (we will tell you, soon, really!)

Some sample questions out of the 36 in this year’s contest.

So go take the contest, make some predictions, and I’ll meet you back here with the results in 2026!

If you enjoy this fan website, you can support us over here. Thanks a lot!
Loading...
Enjoying this website? You can donate to support it! You can also check out my Book Translator tool.