“Things are moving way too fast, we don’t have anywhere near the degree of assurance we’ll want for ASI, and if we survive an unmitigated race at the current pace it will be because we got lucky at how hard the problems were rather than because the industry behaved responsibly.”
Drake Thomas, Pretraining team, Anthropic · September 9, 2026
Title and organization are as of the date said.
The speaker’s own caveats
I personally think Ant capability research is net good, but only in the hope of letting A\ spend down a lead on measures that give humanity more time to try and make it out of this alive, and I very much respect the choice to abstain.
Source
- https://x.com/MaskedTorah/status/2097752516373156262 (tweet)
- Content captured 2026-11-10, SHA-256 14f760ea9b368052dd8c22f35237d0617a28c9553c98d4ce830f7050220e8ad6
Cite this quote
Thomas, D. (2026, September 9). Things are moving way too fast, we don’t have anywhere near the degree of assurance we’ll want for ASI, and… [Post]. https://x.com/MaskedTorah/status/2097752516373156262
More from Drake Thomas
“I would burn my equity to the ground in a heartbeat for a 1% higher chance we make it out of this situation alive. I expect a great many of my colleagues across the industry would as well. I promise you, we are actually just fucking scared, it’s not galaxy brained marketing.”
Drake Thomas, Pretraining team, Anthropic · September 9, 2026
Primary source verifiedExtinction risk
“I promise you that we are actually literally worried about world-ending consequences from this technology. Please find some people you trust who work at these companies and actually talk to them about their views.”
Drake Thomas, Pretraining team, Anthropic · August 21, 2026
Primary source verifiedExtinction risk
Others on the same topic
“There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn’t focus on alignment will fall behind.”
Mark Zuckerberg, CEO, Meta · September 15, 2026
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”
Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026
“Now is a good time to build institutional mechanisms to pace the frontier of AI development. The industry is locked into an all-out scaling race to build superintelligence as quickly as possible, and we may need to give everyone more time for safety and alignment mitigations.”
Jan Leike, Alignment Science (title from search snippet), Anthropic · September 10, 2026