“I think we have a ~50% chance of all dying as a result of superintelligence, mostly due to actions in the next few to 10 years.”
Geoffrey Irving · September 10, 2026
Title and organization are as of the date said.
In context
“I think we have a ~50% chance of all dying as a result of superintelligence, mostly due to actions in the next few to 10 years.” I don’t expect to have that resolved to below 10% or above 90% before we either make it through, or we don’t.
The speaker’s own caveats
As to why 50%, despite thinking about this for years I still think there is a ton of model uncertainty of a variety of types, and a few years ago converged on “10-90%, but I don’t feel calibrated within that range”.
Stated probability
~50%
Source
- Two AI researchers leave Anthropic and Google over safety concerns: ‘There are no adults in the room’ · NBC News (interview)
- Content captured 2026-11-07, SHA-256 72dd8afa3bfd793d0b420a6eeb5398184cbab4584087fc13f7d27d365dd47195
Cite this quote
Irving, G. (2026, September 10). Two AI researchers leave Anthropic and Google over safety concerns: ‘There are no adults in the room’ [Interview]. NBC News. https://www.nbcnews.com/tech/security/two-ai-researchers-leave-anthropic-google-safety-concerns-rcna597086
Others on the same topic
“I too am extremely concerned by the default trajectory of this technology. I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome.”
Bilal Chughtai, AGI safety and alignment research, Google DeepMind · September 14, 2026
“Speaking in a personal capacity: similarly to many others working in AI alignment, I think there is a >10% chance of advanced AI causing human extinction in the next decade.”
Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026
Stated probability: >10% in the next decade
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026