“That seems like a kind of wild error. Like considering yourself optimistic regarding driving at 200mph to your new job if you think there’s only a 10% chance you’ll die in a fiery crash on the way there, and a 30% chance this job will radically improve your life.”
Katja Grace · Undated
Title and organization are as of the date said.
Source
- Doom as a bad method, not a utopia trade-off · LessWrong (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 b3a8fcb3e61b70dc2619bf080de5d72111c8bb844da219cf764653a64cc27b35
Cite this quote
Grace, K. (n.d.). Doom as a bad method, not a utopia trade-off. LessWrong. https://www.lesswrong.com/posts/pDyLMRoi2BDq34rFe/doom-as-a-bad-method-not-a-utopia-trade-off
Others on the same topic
“On the current path, I think it is more likely than not that humanity loses control to these AIs, and it could end in human extinction,”
Jacob Coxon, Researcher, pretraining, Anthropic · October 5, 2026
“A large part of my p(doom) comes from the fact that we have no better ways to navigate an extremely tricky strategic situation than via preference cascades and status games. The fact that AI safety is temporarily benefiting from some of these dynamics isn’t much of a consolation.”
Wei Dai · September 16, 2026
Primary source verifiedExtinction risk
“If the language models actually reach the capability threshold where they can shape the world unconstrained by human will, they will probably do something extreme and destroy humanity in the process.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026