Want to dive into Scott Alexander's work and his thousands of blog posts? This fan website lets you sort and do semantic search through the whole codex. Enjoy!

See also Top Posts and All Tags.

Tag: scaling laws

Minutes:
Pick a custom range (minutes). Leave a field empty for no limit.
Blog:
Year:
2026
2025
2024
2023
2022
2021
2020
2019
2018
2017
2016
2015
2014
2013
Tags:
Filter by tag...
Exclude tag...
5212 tags
Links:
Filter by linked site (twitter, substack…)
3 posts found
Compact Mode
Save Reads
May 15, 2026
acx
Read on
12 min 1,823 words 479 comments 596 likes podcast (11 min)
Scott debunks the "all exponentials become sigmoids" argument against AI risk by showing how forecasters consistently predict premature flattening of exponential trends, and argues that without deep understanding of AI dynamics, we should expect current AI progress to continue for roughly as long as it's already been going. Longer summary
Scott argues against the "all exponentials eventually become sigmoids" talking point often used to dismiss AI capability concerns. While technically true that exponential growth must eventually level off, he demonstrates through examples (UN birthrate predictions, solar power deployment forecasts, and AI capability projections) that people consistently misidentify when this flattening will occur, often predicting it prematurely. He explains that while some technological progress does follow sigmoid curves (like airspeed records), predicting when a trend will flatten requires either deep understanding of the underlying process or, in the absence of such understanding, applying Lindy's Law - which suggests a trend will continue approximately as long as it has already lasted. Scott concludes by challenging AI skeptics to either provide detailed models explaining why AI progress will slow down, or explain why they're not using Lindy's Law as their default assumption. Shorter summary
Feb 12, 2026
acx
Read on
27 min 4,045 words 269 comments 181 likes podcast (25 min)
Scott explains why Ajeya Cotra's influential 'Biological Anchors' report correctly predicted the AI scaling boom but got AGI timelines wrong by twenty years, due to severely underestimating the rate of algorithmic progress. Longer summary
Scott analyzes why Ajeya Cotra's landmark 2020 'Biological Anchors' report predicted AGI around 2050, when current estimates now center on the late 2020s to 2040s. The report correctly predicted the scaling hypothesis and AI boom, but underestimated one crucial parameter: algorithmic progress was actually 200% per year instead of the predicted 30%. This single error, compounded across exponential growth, threw off the entire timeline by about twenty years. Scott examines various contemporary critiques of the report, finding that most concerns about the methodology were actually non-issues, while one throwaway concern (about algorithmic progress estimates being poorly researched) turned out to be the fatal flaw. He concludes this demonstrates both the power and limitations of probabilistic forecasting. Shorter summary
Jun 10, 2020
ssc
Read on
24 min 3,643 words 263 comments podcast (27 min)
Scott Alexander examines GPT-3's capabilities, improvements over GPT-2, and potential implications for AI development through scaling. Longer summary
Scott Alexander discusses GPT-3, a large language model developed by OpenAI. He compares its capabilities to its predecessor GPT-2, noting improvements in text generation and basic arithmetic. The post explores the implications of GPT-3's performance, discussing scaling laws in neural networks and potential future developments. Scott ponders whether continued scaling of such models could lead to more advanced AI capabilities, while also considering the limitations and uncertainties surrounding this approach. Shorter summary
Per page:
Showing 1 to 3 of 3 results
Get these search results in an EPUB

Your filters match 3 posts.

Posts to include
Leave empty to keep the defaults. Range cannot exceed 500 posts.
Download now

Generates an EPUB right now and downloads it to your device.

Send to email

Generates an EPUB in the background and emails you a temporary download link.

Your email is not shared with anyone.

Email address

To send to your Kindle, just use this link.