Scott explains why Ajeya Cotra's influential 'Biological Anchors' report correctly predicted the AI scaling boom but got AGI timelines wrong by twenty years, due to severely underestimating the rate of algorithmic progress.
Longer summary
Scott analyzes why Ajeya Cotra's landmark 2020 'Biological Anchors' report predicted AGI around 2050, when current estimates now center on the late 2020s to 2040s. The report correctly predicted the scaling hypothesis and AI boom, but underestimated one crucial parameter: algorithmic progress was actually 200% per year instead of the predicted 30%. This single error, compounded across exponential growth, threw off the entire timeline by about twenty years. Scott examines various contemporary critiques of the report, finding that most concerns about the methodology were actually non-issues, while one throwaway concern (about algorithmic progress estimates being poorly researched) turned out to be the fatal flaw. He concludes this demonstrates both the power and limitations of probabilistic forecasting.
Shorter summary