“If the language models actually reach the capability threshold where they can shape the world unconstrained by human will, they will probably do something extreme and destroy humanity in the process.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026
Title and organization are as of the date said.
The speaker’s own caveats
I am still wrestling with it and its staggering implications. I do not have answers, but as a first step, I wanted to share my present concerns.
Source
- Personal Statement on AI Risk · Google Docs (self-published) (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 009438c42c919fd7f9380fa390c4570f9b64ad3a89056e3606a73379cba0ee3a
Cite this quote
Selsam, D. (2026, September 14). Personal Statement on AI Risk. Google Docs (self-published). https://docs.google.com/document/d/e/2PACX-1vQNl3SEX5IyA6d9qHjjFZN-qzGRZNFI6b63g-yu1Fy-ZYkVfCWm7i9WXRXw63m6yDB_auDuPLyQ7jBm/pub
More from Daniel Selsam
“The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026
Others on the same topic
“On the current path, I think it is more likely than not that humanity loses control to these AIs, and it could end in human extinction,”
Jacob Coxon, Researcher, pretraining, Anthropic · October 5, 2026
“I also work at an AI company and believe there’s plausibly a ≥10% chance that a future out-of-control AI kills everyone (IMO even 1% is unacceptably high). And higher still is the risk that we “only” get permanently disempowered by AIs that don’t deeply want the best for us.”
Dmitrii Krasheninnikov, Research fellow, AI safety (title from search snippet), Anthropic · September 11, 2026
Stated probability: ≥10%, “plausibly”; no time frame
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026
All quotes on extinction risk →All quotes on loss of control →