Scott examines the rise of AI superforecasters that now match or exceed top human forecasters, explores how they work and their current performance, and analyzes implications for decision-making, prediction markets, and the future role of AI opinions. Longer summary

Scott discusses the emergence of AI superforecasters that are now matching or slightly exceeding top human forecasters in prediction accuracy. He describes how these AI systems work (using scaffolding around frontier models like GPT/Claude), demonstrates their use with examples from FutureSearch and Preseen, and analyzes their performance on platforms like Metaculus where they're competing in tournaments against humans. The post explores both near-term implications (AI forecasters being easier to access than human superforecasters, potentially influencing policy and business decisions) and longer-term possibilities (AI forecasters serving as an 'opinion layer' for AI systems, transformation of prediction markets into AI-vs-AI competitions). Scott argues these developments could be genuinely beneficial, giving people access to superhuman forecasting ability just as AI threatens other aspects of society. Shorter summary

Scott examines the Metaculus Threat To Democracy Index, which uses crowdsourced forecasting to measure democratic health, discussing its advantages over traditional expert-based indices and its vulnerabilities to manipulation and selection bias. Longer summary

Scott discusses the Metaculus Threat To Democracy Index, a new approach to measuring American democratic health using crowdsourced forecasting rather than expert opinion. The index aggregates 153 questions about democratic threats (like election cancellations or ballot access) weighted by forecasters' historical accuracy. Scott analyzes its advantages—transparency, resistance to ideological bias, and ability to measure probabilities rather than binary outcomes—alongside its risks, including susceptibility to crowd attacks, bot manipulation, and question selection bias. He finds the recent data somewhat reassuring (showing no expected worsening during Trump's term) and suggests the index will become more valuable over time as question biases become less relevant. Shorter summary

The 2026 ACX/Metaculus prediction contest is now open with a $10,000 prize pool, featuring reader-submitted questions, and Scott announces the winners of the best question submission contest. Longer summary

Scott announces the 2026 ACX/Metaculus prediction contest is live, with questions suggested by ACX readers covering US politics, AI, international affairs, and culture. Predictions must be submitted by January 17th to be eligible for the $10,000 prize pool, though participants can continue updating forecasts afterward for site leaderboards. The post also lists the winners of the best question submission contest, with prizes ranging from $150 to $700. Shorter summary

Scott asks readers to suggest questions for the 2026 ACX/Metaculus forecasting contest, with prizes for the top ten contributors and AI bots competing this year. Longer summary

Scott announces the upcoming ACX/Metaculus forecasting contest for 2026 and calls for question suggestions from readers. The contest has been running for several years with Metaculus handling most of the organization, and last year attracted over 4500 forecasters predicting on 33 questions. Scott explains that good questions should be objective, verifiable outcomes that will be resolved by year's end, providing examples of well-specified versus poorly-specified questions. The top ten question contributors will receive prizes ranging from $150 to $700, and this year's contest will include AI bots competing alongside humans. Shorter summary

The 2025 ACX/Metaculus Forecasting Contest is now open, featuring 36 questions and a particular focus on comparing forecasting bots with human predictors. Longer summary

Scott Alexander announces the opening of the 2025 ACX/Metaculus Forecasting Contest, although the 2024 results are pending due to complications. He mentions hoping to compare Metaculus with Polymarket but couldn't due to recent events including FBI raids. Scott expresses particular interest in seeing how new forecasting bots will perform against top human forecasters in this year's contest, which includes 36 questions and offers $10,000 in prizes. Shorter summary

Scott examines the likelihood and potential severity of an H5N1 bird flu pandemic, analyzing prediction markets and historical data to estimate a 5% chance of pandemic in the next year with most likely moderate severity. Longer summary

Scott Alexander provides a comprehensive overview of H5N1 bird flu and its pandemic potential. He starts by explaining what flu is and its history of pandemics, then focuses on H5N1's current situation, analyzing prediction market estimates for its chances of causing a pandemic. The post examines different mortality scenarios and their likelihood, using data from past flu pandemics and current cases. It concludes with specific predictions about H5N1's future impact, suggesting a 5% chance of human pandemic in the next year, with varying degrees of severity if it occurs. Shorter summary

Scott Alexander praises Polymarket's election success but argues their Trump odds were mispriced, explaining why Trump's win doesn't significantly validate their numbers over other forecasters. Longer summary

Scott Alexander congratulates Polymarket for their success during the recent election, but argues that their Trump shares were mispriced by about ten cents. He uses Bayes' Theorem to explain why Trump's victory doesn't significantly vindicate Polymarket's numbers. Scott compares the situation to non-money forecasters like Metaculus versus real-money markets like Polymarket, explaining why he initially trusted the former more. He discusses the impact of a large bettor named Theo on Polymarket's odds and addresses several objections to his argument. Scott concludes that while prediction markets are valuable, they can sometimes fail and require critical thinking. Shorter summary

Scott Alexander analyzes the results of his 2023 forecasting contest, comparing various prediction methods and individual forecasters. Longer summary

Scott Alexander reviews the results of his 2023 annual forecasting contest, where participants predicted 50 questions about the upcoming year. He discusses the winners in both 'Blind Mode' (relying on personal knowledge) and 'Full Mode' (using aggregation algorithms). The post analyzes the performance of various forecasting methods, including individual forecasters, prediction markets, superforecasters, and aggregation techniques. Scott concludes that Metaculus, a forecasting platform, outperformed other methods, though some individual forecasters showed exceptional skill. He also examines which 2023 events were most surprising to forecasters and shares his main takeaways from the contest. Shorter summary

The post examines the performance of prediction markets in elections, current political forecasts, and various other prediction markets, while also discussing the challenges and potential of forecasting. Longer summary

This post discusses several topics related to prediction markets and forecasting. It starts by examining a claim that prediction markets have an 'election problem', showing that real-money markets performed poorly in recent elections. The author then analyzes current polls and prediction markets for the 2024 US presidential election, noting discrepancies between different platforms. The post also explores a forecasting experiment on AI futures, and reviews several other prediction markets on current events. Finally, it includes short links to other forecasting-related news and reflections. Shorter summary

The post discusses recent developments in prediction markets, including challenges in market design, updates to forecasting platforms, and current market predictions on various topics. Longer summary

This post covers several topics in prediction markets and forecasting. It starts by discussing the challenges of designing prediction markets for 'why' questions, using the OpenAI situation as an example. It then reviews the progress of Manifold's dating site, Manifold.love, after one month. The post also covers Metaculus' recent platform updates, including new scoring systems and leaderboards. Finally, it analyzes various current prediction markets, including geopolitical events, elections, and the TIME Person of the Year. Shorter summary

Scott Alexander analyzes the surprisingly low existential risk estimates from a recent forecasting tournament, particularly for AI risk, and explains why he only partially updates his own higher estimates. Longer summary

Scott Alexander discusses the Existential Risk Persuasion Tournament (XPT), which aimed to estimate risks of global catastrophes using experts and superforecasters. The results showed unexpectedly low probabilities for existential risks, particularly for AI. Scott examines possible reasons for these results, including incentive structures, participant expertise, and timing of the study. He ultimately decides to partially update his own estimates, but not fully to the level suggested by the tournament, explaining his reasoning for maintaining some disagreement with the experts. Shorter summary

The post explores AI forecasting capabilities, compares prediction market performances, and provides updates on various ongoing predictions in technology and politics. Longer summary

This post discusses recent developments in AI forecasting and prediction markets. It covers a study testing GPT-2's ability to predict past events, reports on Metaculus' accuracy compared to low-information priors and Manifold Markets, and updates on various prediction markets including those related to AI development, abortion medication, and Elon Musk's role at Twitter. The author also mentions new features in prediction platforms and research on forecasting methodologies. Shorter summary

Scott Alexander discusses recent developments in prediction markets and forecasting, including Metaculus' milestone, PredictIt's legal issues, and various prediction market topics. Longer summary

This Mantic Monday post covers several topics related to prediction markets and forecasting. Scott discusses Metaculus reaching its one millionth prediction, PredictIt's legal battle with the CFTC, former Russian President Medvedev's outlandish 2023 predictions, conspiracy theory prediction markets, Scott's own 2022 prediction calibration results, updates on 'scandal markets', and highlights from various current prediction markets. He also shares some thoughts on the challenges and potential pitfalls of certain types of prediction markets. Shorter summary

Scott Alexander announces a formalized 2023 Prediction Contest with 50 questions, multiple modes of play, and cash prizes. Longer summary

Scott Alexander announces the 2023 Prediction Contest, a formalized version of his annual predictions. The contest includes 50 forecasting questions and 5 demographic questions. Participants can play in Blind Mode (limited research, no external sources) or Full Mode (unlimited research). There are multiple prizes, including $500 for winners in different categories. The contest aims to create a standard for comparing forecasters and forecasting sites, with plans to correlate personality traits with forecasting accuracy in a future ACX Survey. Shorter summary

Scott Alexander examines the shutdown of PredictIt and its implications for the prediction market industry, while also highlighting new developments and forecasts in the field. Longer summary

This post discusses the recent shutdown of PredictIt, a prominent prediction market, by the CFTC. It explores potential reasons for the shutdown, including suspicions of lobbying by competitor Kalshi. The post also covers new developments in the prediction market space, including Hedgehog Markets allowing user-created markets, a forecasting tournament by the Salem Center and CSPI, and updates on various prediction markets and their forecasts on topics like China-US conflict, AI-generated music, and remote college education. Shorter summary

Scott Alexander reviews recent predictions and forecasts on topics including monkeypox, the Ukraine war, AI development, and US politics. Longer summary

This Mantic Monday post covers several topics in prediction markets and forecasting, including monkeypox predictions, updates on the Ukraine-Russia war, AI development forecasts, Elon Musk's potential Twitter acquisition, and various political predictions. Scott discusses Metaculus predictions for monkeypox cases, analyzes forecasts for the Ukraine conflict, examines AI capability predictions in response to a bet between Elon Musk and Gary Marcus, and reviews predictions for US elections and other current events. The post also includes updates on prediction market platforms and recent articles about forecasting. Shorter summary

Scott Alexander updates readers on Ukraine war predictions, Insight Prediction's challenges, ACX 2022 Prediction Contest results, and various prediction market developments. Longer summary

Scott Alexander provides an update on prediction markets related to the Ukraine war, discusses the situation with Insight Prediction (a prediction market platform), shares data from the ACX 2022 Prediction Contest, and gives brief updates on various prediction-related topics. The post covers changes in probabilities for key Ukraine war outcomes, the challenges faced by Insight Prediction due to the war, analysis of the ACX prediction contest data, and mentions of new prediction market platforms and AI-related predictions. Shorter summary

Scott analyzes Ukraine prediction markets, nuclear war risk forecasts, and compares forecasters to experts, along with various updates on prediction platforms. Longer summary

This post discusses recent changes in Ukraine-related prediction markets, analyzes the seemingly monotonic decrease in probabilities of Russian success, explores nuclear war risk forecasts, and compares the performance of forecasters vs. domain experts. Scott also covers various short updates on prediction markets and forecasting platforms. Shorter summary

Scott analyzes play money and reputation systems in prediction markets, discussing their designs, challenges, and potential improvements. Longer summary

Scott Alexander discusses the design and effectiveness of play money and reputation systems in prediction markets, focusing on Metaculus and Manifold. He explores the trade-offs between absolute and relative accuracy, zero-sum and positive-sum scoring, and the challenges these systems face. Scott points out that reputation systems often fail to provide actual reputation benefits, and play money systems struggle with market inefficiencies due to limited incentives. He suggests potential improvements, such as offering interest-free loans for specific markets, to address these issues. Shorter summary

Scott Alexander analyzes prediction markets for the Ukraine crisis, introduces Manifold Markets, and discusses recent Metaculus questions and forecasting initiatives. Longer summary

Scott Alexander discusses various prediction markets and forecasting platforms, focusing on the Ukraine crisis, a new prediction market called Manifold Markets, and recent questions on Metaculus. He analyzes the probabilities of a Russian invasion of Ukraine across different platforms, introduces the concept of an 'Alexander Cube' for ideal prediction markets, and highlights interesting markets on Manifold. The post also covers new Metaculus questions on intelligence enhancement and environmental issues, and mentions several forecasting-related contests and grants. Shorter summary

Scott discusses recent developments in prediction markets, including new platforms, features, and current market predictions on various topics. Longer summary

This Mantic Monday post covers several topics in the world of prediction markets. Scott reviews a YouTube explainer on prediction markets, introduces a new market called Futuur, discusses the innovative approach of Mantic Markets, highlights Metaculus' Public Figure Predictions feature, and provides updates on current market predictions for various events. He also shares some short notes on foot voting coordination efforts, a suggestion for using prediction markets in college debates, and Google's new prediction market team. Shorter summary

Scott Alexander reviews recent developments in prediction markets, including Google's internal market and Metaculus' 'fortified essays', while discussing challenges and applications in various fields. Longer summary

Scott Alexander discusses recent developments in prediction markets, including Google's internal prediction market Gleangen, challenges in long-term predictions, conditional markets for policy decisions, and new weight loss drugs. He also covers Metaculus' 'fortified essays' concept, which combines expert analysis with crowd forecasts, and shares recent predictions on topics like COVID-19 hospitalizations and SAT requirements in college admissions. Shorter summary

Scott Alexander analyzes prediction market forecasts about the Omicron COVID-19 variant, discussing its potential transmissibility, lethality, and prevalence. Longer summary

Scott Alexander discusses predictions about the Omicron variant of COVID-19 using data from prediction markets, particularly Metaculus. He examines forecasts on the variant's transmissibility (R0), lethality compared to Delta, and its expected prevalence in the US. The post highlights that Metaculus predicts Omicron to be more transmissible than Delta, with a 34% chance of being deadlier, and likely to become the dominant US variant by mid-March. Scott concludes with a humorous tweet about the rapid emergence of new variants. Shorter summary

Scott reviews recent developments in prediction markets, including COVID-19 forecasts, the launch of Kalshi, and Metaculus' new hiring initiative. Longer summary

This post covers recent developments in prediction markets and forecasting. It reviews recent markets on PredictIt, Polymarket, and Metaculus, focusing on COVID-19 predictions, the launch of Kalshi (a new regulated prediction market), and Metaculus' hiring of 'Analytical Storytellers'. The author discusses the potential of prediction markets in providing clearer information about current events and future possibilities, and suggests some additional markets that could be helpful. The post also touches on demographic predictions about dependency ratios in various countries. Shorter summary

Scott discusses various prediction markets and forecasting topics, including Metaculus predictions, Polymarket vs PredictIt, a study on forecasting accuracy, and the need for more precise inflation predictions from experts. Longer summary

This post covers various prediction markets and forecasting topics. It starts with Metaculus predictions on Puerto Rico statehood, Jeff Bezos' potential investment in anti-aging, crypto site defaults, and the population of Prospera. The author then discusses Polymarket, comparing its liquidity to PredictIt for the NYC mayoral race. The post also analyzes a study on forecasting accuracy from PredictionBook, showing that more experienced predictors perform better and that longer-term predictions are often more accurate. Finally, the author addresses the current debate on inflation predictions, calling for more precise and accountable forecasts from economists and pundits. Shorter summary