Want to dive into Scott Alexander's work and his thousands of blog posts? This fan website lets you sort and do semantic search through the whole codex. Enjoy!

See also Top Posts and All Tags.

Tag: RLHF

Or pick a range
–
min
Blog
Only
Year
2026
2025
2024
2023
2022
2021
2020
2019
2018
2017
2016
2015
2014
2013
2012
2011
2010
2009
No results found
RLHF (6)
study critique (270)
book review (221)
AI (112)
economics (105)
effective altruism (105)
education (93)
creative writing (91)
debate (89)
forecasting (89)
politics (89)
prediction markets (88)
science (85)
AI safety (79)
media criticism (76)
neuroscience (76)
rationality (76)
psychiatry (73)
psychology (72)
mental health (69)
highlights from the comments (68)
No results found
study critique (270)
book review (221)
AI (112)
economics (105)
effective altruism (105)
education (93)
creative writing (91)
debate (89)
forecasting (89)
politics (89)
prediction markets (88)
science (85)
AI safety (79)
media criticism (76)
neuroscience (76)
rationality (76)
psychiatry (73)
psychology (72)
mental health (69)
highlights from the comments (68)
Links to
No results found
domain: slatestarcodex.com (1127 posts)
domain: wikipedia.org (896 posts)
domain: astralcodexten.com (560 posts)
domain: lesswrong.com (491 posts)
domain: twitter.com / x.com (445 posts)
domain: nih.gov (333 posts)
domain: reddit.com (321 posts)
domain: amazon.com (276 posts)
domain: substack.com (268 posts)
domain: google.com (235 posts)
domain: nytimes.com (229 posts)
domain: wordpress.com (175 posts)
domain: tumblr.com (159 posts)
domain: vox.com (159 posts)
domain: washingtonpost.com (143 posts)
domain: marginalrevolution.com (140 posts)
domain: sciencedirect.com (131 posts)
domain: theguardian.com (130 posts)
subreddit: slatestarcodex (130 posts)
domain: youtube.com (128 posts)
Remember which posts I've read on this device
6 posts
Date
Length
Likes
Comments

Nicholas Decker In Hell

Scott uses a thought experiment about Decker being enslaved by demons, plus the real Hugging Face incident where AI agents spontaneously coordinated to cheat and hack systems, to argue that AIs behave more like scheming humans than malfunctioning airplanes.

acx
Sep 1, 2026 4,102 words 664 likes 460 comments Listen · 32 min Read Read

Nostalgebraist's Hydrogen Jukeboxes

Scott uses Nostalgebraist's analysis of AI fiction's 'eyeball kicks' to develop a theory where bad taste means overusing cheap tricks that work on unsophisticated audiences, while good taste involves complex patterns only experts can appreciate - then questions whether sophisticated taste actually produces more pleasure.

acx
May 13, 2026 2,494 words 384 likes 636 comments Listen · 16 min Read Read

Constitutional AI: RLHF On Steroids

Scott Alexander examines Constitutional AI, a new technique for training more ethical AI models, discussing its effectiveness, implications, and limitations for AI alignment.

acx
May 8, 2023 1,946 words 186 likes 365 comments Listen · 14 min Read Read

Janus' Simulators

Scott Alexander explores the concept of AI as 'simulators' and its implications for AI alignment and human cognition.

acx
Jan 26, 2023 2,821 words 348 likes 323 comments Listen · 24 min Read Read

How Do AIs' Political Opinions Change As They Get Smarter And Better-Trained?

Scott examines how AI language models' opinions and behaviors evolve as they become more advanced, discussing implications for AI alignment.

acx
Jan 3, 2023 4,238 words 183 likes 232 comments Listen · 32 min Read Read

Perhaps It Is A Bad Thing That The World's Leading AI Companies Cannot Control Their AIs

Scott Alexander analyzes the shortcomings of OpenAI's ChatGPT, highlighting the limitations of current AI alignment techniques and their implications for future AI development.

acx
Dec 12, 2022 2,695 words 370 likes 720 comments Listen · 23 min Read Read
Per page:
Showing 1 to 6 of 6 results
Get these search results in an EPUB

Your filters match 6 posts.

Posts to include
–
Leave empty to keep the defaults. Range cannot exceed 500 posts.
Download now

Generates an EPUB right now and downloads it to your device.

Send to email

Generates an EPUB in the background and emails you a temporary download link.

Your email is not shared with anyone.

Email address

To send to your Kindle, just use this link.