On AI Risk
“Safety progress takes time. If you don’t have enough time, at each stage of AI development, to ensure the AIs that you build in the next stage won’t destroy humanity, then you’ll fail, and humanity will be destroyed. Automated alignment research helps a lot here, and that’s a core reason I think it’s so important (human alignment researchers are too scarce and slow). But even if AIs are doing most or all of the alignment work, it still matters how much time they have.”

Joe Carlsmith · March 19, 2026

Title and organization are as of the date said.

Primary source verifiedExpertise: alignment, existential risk, philosophyExtinction riskLoss of controlPause

In context

Introduction: the basic case for the importance of capability restraint is obvious. “Safety progress takes time. If you don’t have enough time, at each stage of AI development, to ensure the AIs that you build in the next stage won’t destroy humanity, then you’ll fail, and humanity will be destroyed. Automated alignment research helps a lot here, and that’s a core reason I think it’s so important (human alignment researchers are too scarce and slow). But even if AIs are doing most or all of the alignment work, it still matters how much time they have.”

Source

Cite this quote

Carlsmith, J. (2026, March 19). On restraining AI development for the sake of safety. joecarlsmith.com. https://joecarlsmith.com/2026/03/19/on-restraining-ai-development-for-the-sake-of-safety/

More from Joe Carlsmith

All 2 quotes by Joe Carlsmith →

Others on the same topic

All quotes on extinction risk →All quotes on loss of control →All quotes on pause →

Report an error in this quote