The post explores recent advances in AI forecasting, discusses the concept of 'rationality engines', reviews a study on AI risk predictions, and provides updates on various prediction markets. Longer summary

This post discusses recent developments in AI-powered forecasting and prediction markets. It covers two academic teams' work on AI forecasting systems, comparing their performance to human forecasters. The post then discusses the potential for developing 'rationality engines' that can answer non-forecasting questions. It also reviews a study on superforecasters' predictions about AI risk, and provides updates on various prediction markets including political events, cryptocurrency, and global conflicts. The post concludes with short links to related articles and developments in the field of forecasting. Shorter summary

Scott Alexander analyzes the results of his 2023 forecasting contest, comparing various prediction methods and individual forecasters. Longer summary

Scott Alexander reviews the results of his 2023 annual forecasting contest, where participants predicted 50 questions about the upcoming year. He discusses the winners in both 'Blind Mode' (relying on personal knowledge) and 'Full Mode' (using aggregation algorithms). The post analyzes the performance of various forecasting methods, including individual forecasters, prediction markets, superforecasters, and aggregation techniques. Scott concludes that Metaculus, a forecasting platform, outperformed other methods, though some individual forecasters showed exceptional skill. He also examines which 2023 events were most surprising to forecasters and shares his main takeaways from the contest. Shorter summary

Scott Alexander analyzes results from a 2022 prediction contest, discussing top performers and methods for improving forecast accuracy. Longer summary

Scott Alexander reviews the results of a 2022 prediction contest where 508 participants assigned probabilities to 71 yes-or-no questions about future events. The post discusses the performance of individual forecasters, aggregation methods, and prediction markets. It highlights the success of superforecasters, the wisdom of crowds, and prediction markets. The article also announces winners, discusses demographic factors in forecasting ability, and introduces a new contest for 2023, emphasizing the potential for improving forecasting accuracy through various methods. Shorter summary

Scott analyzes Ukraine prediction markets, nuclear war risk forecasts, and compares forecasters to experts, along with various updates on prediction platforms. Longer summary

This post discusses recent changes in Ukraine-related prediction markets, analyzes the seemingly monotonic decrease in probabilities of Russian success, explores nuclear war risk forecasts, and compares the performance of forecasters vs. domain experts. Scott also covers various short updates on prediction markets and forecasting platforms. Shorter summary

Scott Alexander reviews 'Superforecasting' by Philip Tetlock, discussing the traits of highly accurate predictors and the book's validation of rationalist techniques. Longer summary

This post reviews Philip Tetlock's book 'Superforecasting', which explores the qualities of highly accurate predictors. Tetlock's Good Judgment Project identified a group of 'superforecasters' who consistently outperformed others, including CIA analysts. The review discusses the characteristics of these superforecasters, emphasizing their understanding of logic and probability, ability to break down problems, and resistance to cognitive biases. Scott Alexander notes the similarities between superforecasters' methods and rationalist techniques, suggesting the book's value lies in providing high-status validation for these approaches rather than presenting new information to those already familiar with rationality concepts. Shorter summary