Scott Alexander argues that selection bias, while a concern, is not a valid reason to automatically reject amateur online surveys, as professional studies also face similar limitations.
Longer summary
Scott Alexander discusses the issue of selection bias in amateur online surveys, arguing that it's not a valid reason to dismiss their results outright. He points out that professional scientific studies also suffer from selection bias, often using unrepresentative samples like psychology students. The post explains that while selection bias is problematic for polls or census-like studies aiming to determine population-wide statistics, it's less of an issue for correlation studies. Scott argues that the key is to consider the mechanism being studied and how it might generalize, rather than dismissing studies based solely on their sample selection method.
Shorter summary