Scott Alexander refutes claims that existing collective entities are superintelligent AIs, emphasizing the fundamental differences between collective intelligence and true superintelligence.
Longer summary
Scott Alexander argues against the idea that existing entities like corporations, bureaucracies, teams, or civilizations are already superintelligent AIs. He distinguishes between collective intelligence and genuine superintelligence, asserting that groups have advantages but can't surpass the problem-solving ability of their smartest member. Scott emphasizes that true superintelligence would be a completely different class of entity, possessing both the advantages of collective intelligence and higher genuine problem-solving ability without the disadvantages. The post includes examples, counterarguments, and clarifications to support this distinction.
Shorter summary