Scott Alexander examines the claim that '90% of medical research is false', arguing it's an exaggeration while acknowledging real issues in the field.
Longer summary
Scott Alexander critiques the popular claim that '90% of medical research is false', which is often attributed to John Ioannidis. He argues that this statement, while pointing to important issues, creates more panic than warranted. Scott analyzes Ioannidis' work, showing that the 90% figure is likely misinterpreted from various sources. He explains that the accuracy of medical research varies greatly depending on the type of study, with large randomized trials and meta-analyses being much more reliable. Scott also discusses how multiple studies on the same topic can greatly increase confidence in results, and how doctors' beliefs are typically based on substantial evidence rather than single studies. He concludes by acknowledging the problems in medical research while cautioning against overly cynical interpretations.
Shorter summary