“At the current pace, every couple of weeks there will be new models which significantly increase the consequences of model misuse and misalignment. I worry that efforts to mitigate these risks may fail to keep up with the pace of development, and that margins for error will become increasingly small under international competitive pressures.”
Micah Carroll, Misalignment Preparedness, OpenAI · July 2026
Title and organization are as of the date said.
The speaker’s own caveats
Personal capacity.
Source
- Pacing the Frontier (personal comments from signatories) · Pacing the Frontier (letter)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 bca5c2fac325e2905cf180e7af2826feadf74df9dec667883656e17cf7a02791
Cite this quote
Carroll, M. (2026, July). Pacing the Frontier (personal comments from signatories) [Letter]. Pacing the Frontier. https://www.pacingthefrontier.com/
More from Micah Carroll
“It’s a cross-partisan position within misalignment teams across all frontier AI companies that business-as-usual AI development poses unacceptable catastrophic risk.”
Micah Carroll, Misalignment Preparedness, OpenAI · September 10, 2026
Others on the same topic
“There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn’t focus on alignment will fall behind.”
Mark Zuckerberg, CEO, Meta · September 15, 2026
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”
Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026
“Now is a good time to build institutional mechanisms to pace the frontier of AI development. The industry is locked into an all-out scaling race to build superintelligence as quickly as possible, and we may need to give everyone more time for safety and alignment mitigations.”
Jan Leike, Alignment Science (title from search snippet), Anthropic · September 10, 2026