“Speaking in a personal capacity: similarly to many others working in AI alignment, I think there is a >10% chance of advanced AI causing human extinction in the next decade.”
Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026
Title and organization are as of the date said.
In context
“Speaking in a personal capacity: similarly to many others working in AI alignment, I think there is a >10% chance of advanced AI causing human extinction in the next decade.” This is why I work on loss of control, currently on building honeypots to catch scheming AI.
Stated probability
>10% in the next decade
Source
- https://x.com/vkrakovna/status/2098336894136238140 · X (tweet)
- Content captured 2026-11-07, SHA-256 680043a2b85ca365d6cccb1744a8eaba8ffe9e61eed98e9a9781ce6df71e953a
Cite this quote
Krakovna, V. (2026, September 11). Speaking in a personal capacity: similarly to many others working in AI alignment, I think there is a >10% chance… [Post]. X. https://x.com/vkrakovna/status/2098336894136238140
More from Victoria Krakovna
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”
Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026
Others on the same topic
“I too am extremely concerned by the default trajectory of this technology. I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome.”
Bilal Chughtai, AGI safety and alignment research, Google DeepMind · September 14, 2026
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026
“I think we have a ~50% chance of all dying as a result of superintelligence, mostly due to actions in the next few to 10 years.”
Geoffrey Irving · September 10, 2026
Stated probability: ~50%