On AI Risk

Topic

Pause

Statements about pausing, slowing or halting the development of the most capable AI systems, including calls for a pause, conditions for one, and objections to it.

32 quotes from 26 people, 2024–2026, newest first. Search and filter these quotes

People quoted on this topic

Quotes

“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”

Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026

Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause

Primary source verifiedLoss of controlPauseTimelines
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”

Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026

Primary source verifiedLoss of controlPauseRace dynamics
“Safety progress takes time. If you don’t have enough time, at each stage of AI development, to ensure the AIs that you build in the next stage won’t destroy humanity, then you’ll fail, and humanity will be destroyed. Automated alignment research helps a lot here, and that’s a core reason I think it’s so important (human alignment researchers are too scarce and slow). But even if AIs are doing most or all of the alignment work, it still matters how much time they have.”

Joe Carlsmith · March 19, 2026

“On the one end there are the doomers. They have been obsessing over AGI for many years; I give them a lot of credit for their prescience. But their thinking has become ossified, untethered from the empirical realities of deep learning, their proposals naive and unworkable, and they fail to engage with the very real authoritarian threat. Rabid claims of 99% odds of doom, calls to indefinitely pause AI—they are clearly not the way.”

Leopold Aschenbrenner · June 2024

Primary source verifiedPause

Often discussed together

All topics →