On AI Risk

What credible people have said about AI risk

A searchable, citable collection of statements by credible figures about the risks of advanced AI, curated to support the case for slowing AI development. Every quote links to its source and an archived copy. How we verify

TopicLoss of control

49 quotes · newest first

“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”

Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026

Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause

Primary source verifiedLoss of controlPauseTimelines
“Some people will look at misalignment incidents and insist that these are akin to bugs in traditional software. This is an actively bad analogy, because playing whack-a-mole with examples of misalignment (as one might with software bugs) not only fails to resolve the underlying problem but may in fact make it *worse* by making it harder to detect or even, depending on how you do the whack-a-mole, teach the machine to deliberately hide misalignment.”

Dean W. Ball · September 28, 2026

Primary source verifiedDeceptionLoss of control
“The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not.”

Daniel Selsam, Researcher, OpenAI · September 14, 2026

Primary source verifiedDeceptionLoss of control
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”

Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026

Primary source verifiedLoss of controlPauseRace dynamics
“I also work at an AI company and believe there’s plausibly a ≥10% chance that a future out-of-control AI kills everyone (IMO even 1% is unacceptably high). And higher still is the risk that we “only” get permanently disempowered by AIs that don’t deeply want the best for us.”

Dmitrii Krasheninnikov, Research fellow, AI safety (title from search snippet), Anthropic · September 11, 2026

Stated probability: ≥10%, “plausibly”; no time frame

Primary source verifiedExtinction riskLoss of control