Scott reviews 'Reframing Superintelligence' by Eric Drexler, which proposes future AI as specialized services rather than general agents, contrasting with Nick Bostrom's scenarios.
Longer summary
Scott Alexander reviews Eric Drexler's book 'Reframing Superintelligence', which proposes that future AI may develop as a collection of specialized superintelligent services rather than general-purpose agents. The post compares this view to Nick Bostrom's more alarming scenarios in 'Superintelligence'. Scott discusses the potential safety advantages of AI services, their limitations, and some remaining concerns. He reflects on why he didn't consider this perspective earlier and acknowledges the ongoing debate in the AI alignment community about these different models of future AI development.
Shorter summary