On AI Risk

Topic

Loss of control

Statements about the risk that people lose the ability to oversee, correct or switch off advanced AI systems, including systems that pursue goals their developers did not intend.

49 quotes from 33 people, 2023–2026, newest first. Search and filter these quotes

People quoted on this topic

Quotes

“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”

Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026

Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause

Primary source verifiedLoss of controlPauseTimelines
“Some people will look at misalignment incidents and insist that these are akin to bugs in traditional software. This is an actively bad analogy, because playing whack-a-mole with examples of misalignment (as one might with software bugs) not only fails to resolve the underlying problem but may in fact make it *worse* by making it harder to detect or even, depending on how you do the whack-a-mole, teach the machine to deliberately hide misalignment.”

Dean W. Ball · September 28, 2026

Primary source verifiedDeceptionLoss of control
“The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not.”

Daniel Selsam, Researcher, OpenAI · September 14, 2026

Primary source verifiedDeceptionLoss of control
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”

Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026

Primary source verifiedLoss of controlPauseRace dynamics
“I also work at an AI company and believe there’s plausibly a ≥10% chance that a future out-of-control AI kills everyone (IMO even 1% is unacceptably high). And higher still is the risk that we “only” get permanently disempowered by AIs that don’t deeply want the best for us.”

Dmitrii Krasheninnikov, Research fellow, AI safety (title from search snippet), Anthropic · September 11, 2026

Stated probability: ≥10%, “plausibly”; no time frame

Primary source verifiedExtinction riskLoss of control
“Urgent action is needed to address risks that might arise as we get closer to AGI. We’ve already seen the challenges frontier models pose for cybersecurity, and other threats including nuclear and bio risks may soon emerge as capabilities continue to advance. On the horizon, we will need robust safeguards to maintain control of increasingly agentic, recursively self-improving systems - and tackle unknown issues that will only become clearer over time.”

Demis Hassabis, Co-Founder & CEO, Google DeepMind · July 14, 2026

Primary source verifiedLoss of controlTimelines
“Safety progress takes time. If you don’t have enough time, at each stage of AI development, to ensure the AIs that you build in the next stage won’t destroy humanity, then you’ll fail, and humanity will be destroyed. Automated alignment research helps a lot here, and that’s a core reason I think it’s so important (human alignment researchers are too scarce and slow). But even if AIs are doing most or all of the alignment work, it still matters how much time they have.”

Joe Carlsmith · March 19, 2026

“We need to not screw it up. Recognizing the power of superintelligence also means recognizing its peril. There are very real safety risks; very real risks this all goes awry—whether it be because mankind uses the destructive power brought forth for our mutual annihilation, or because, yes, the alien species we’re summoning is one we cannot yet fully control. These are manageable—but improvising won’t cut it.”

Leopold Aschenbrenner · June 2024

Primary source verifiedExtinction riskLoss of control

Often discussed together

All topics →