Scott examines the rise of AI superforecasters that now match or exceed top human forecasters, explores how they work and their current performance, and analyzes implications for decision-making, prediction markets, and the future role of AI opinions.
Longer summary
Scott discusses the emergence of AI superforecasters that are now matching or slightly exceeding top human forecasters in prediction accuracy. He describes how these AI systems work (using scaffolding around frontier models like GPT/Claude), demonstrates their use with examples from FutureSearch and Preseen, and analyzes their performance on platforms like Metaculus where they're competing in tournaments against humans. The post explores both near-term implications (AI forecasters being easier to access than human superforecasters, potentially influencing policy and business decisions) and longer-term possibilities (AI forecasters serving as an 'opinion layer' for AI systems, transformation of prediction markets into AI-vs-AI competitions). Scott argues these developments could be genuinely beneficial, giving people access to superhuman forecasting ability just as AI threatens other aspects of society.
Shorter summary