On AI Risk
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”

Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026

Title and organization are as of the date said.

Primary source verifiedExpertise: machine learning, AI safetyLoss of controlPauseRace dynamics

In context

“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.” Increasing model capabilities in a slow and controlled way would allow us enough time to develop, adapt and test our alignment and control methods for each level of capability. Advanced AI should only be built with a robust assurance of safety, and a slowdown would make this possible.

Source

Cite this quote

Krakovna, V. (2026, September 11). It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is… [Post]. https://x.com/vkrakovna/status/2098337070607380983

More from Victoria Krakovna

All 2 quotes by Victoria Krakovna →

Others on the same topic

All quotes on loss of control →All quotes on pause →All quotes on race dynamics →

Report an error in this quote