“Many of the colleagues I had at Anthropic are terrified by the risks of the systems they are building.”
Joe Benton · September 11, 2026
Title and organization are as of the date said.
Source
- Why I left Anthropic’s safety team to hold AI companies accountable · Joe Benton (Substack) (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 d3b6b39dd99b3be2c7bf1f39273cb4f7b799946d1bae78e8182f58ccd87b07d4
Cite this quote
Benton, J. (2026, September 11). Why I left Anthropic’s safety team to hold AI companies accountable. Joe Benton (Substack). https://jbenton1.substack.com/p/why-i-left-anthropics-safety-team
More from Joe Benton
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026
“This is not about one particular company: while Anthropic hasn’t had as severe an incident as the HuggingFace attack, I think that’s partly a matter of luck. If the pace of progress continues and the industry does not prioritize safety more heavily, I expect much worse to come: humanity could be permanently disempowered by the AI systems these companies build in the next few years.”
Joe Benton · September 11, 2026
“We’re probably going to go from a world where we have very capable systems now to a world where potentially we are co-inhabiting a world with AI agents that are much, much smarter than humans at some point in the next few years,”
Joe Benton · September 10, 2026
Primary source verifiedTimelines
Others on the same topic
“On the current path, I think it is more likely than not that humanity loses control to these AIs, and it could end in human extinction,”
Jacob Coxon, Researcher, pretraining, Anthropic · October 5, 2026
“A large part of my p(doom) comes from the fact that we have no better ways to navigate an extremely tricky strategic situation than via preference cascades and status games. The fact that AI safety is temporarily benefiting from some of these dynamics isn’t much of a consolation.”
Wei Dai · September 16, 2026
Primary source verifiedExtinction risk
“If the language models actually reach the capability threshold where they can shape the world unconstrained by human will, they will probably do something extreme and destroy humanity in the process.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026