On AI Risk
“I signed the “pacing letter” about slowing the rate of AI capabilities development because we either have reached or soon will reach the point where human experts cannot make robust assurances that frontier AI systems won’t do dangerous and unpredictable things.”

Dean W. Ball · September 10, 2026

Title and organization are as of the date said.

Primary source verifiedExpertise: AI policyLoss of controlPause

In context

“I signed the “pacing letter” about slowing the rate of AI capabilities development because we either have reached or soon will reach the point where human experts cannot make robust assurances that frontier AI systems won’t do dangerous and unpredictable things.” AI systems are becoming smarter than the best humans in some areas, and, almost by definition, it’s very hard to predict what something smarter than you will do.

Source

Cite this quote

Ball, D. W. (2026, September 10). I signed the “pacing letter” about slowing the rate of AI capabilities development because we either have reached or soon… [Post]. X. https://x.com/deanwball/status/2098069548893352078

More from Dean W. Ball

All 6 quotes by Dean W. Ball →

Others on the same topic

“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”

Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026

Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause

Primary source verifiedLoss of controlPauseTimelines
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”

Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026

Primary source verifiedLoss of controlPauseRace dynamics
“Safety progress takes time. If you don’t have enough time, at each stage of AI development, to ensure the AIs that you build in the next stage won’t destroy humanity, then you’ll fail, and humanity will be destroyed. Automated alignment research helps a lot here, and that’s a core reason I think it’s so important (human alignment researchers are too scarce and slow). But even if AIs are doing most or all of the alignment work, it still matters how much time they have.”

Joe Carlsmith · March 19, 2026

All quotes on loss of control →All quotes on pause →

Report an error in this quote