“This is not about one particular company: while Anthropic hasn’t had as severe an incident as the HuggingFace attack, I think that’s partly a matter of luck. If the pace of progress continues and the industry does not prioritize safety more heavily, I expect much worse to come: humanity could be permanently disempowered by the AI systems these companies build in the next few years.”
Joe Benton · September 11, 2026
Title and organization are as of the date said.
Source
- Why I left Anthropic’s safety team to hold AI companies accountable · Joe Benton (Substack) (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 d3b6b39dd99b3be2c7bf1f39273cb4f7b799946d1bae78e8182f58ccd87b07d4
Cite this quote
Benton, J. (2026, September 11). Why I left Anthropic’s safety team to hold AI companies accountable. Joe Benton (Substack). https://jbenton1.substack.com/p/why-i-left-anthropics-safety-team
More from Joe Benton
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026
“Many of the colleagues I had at Anthropic are terrified by the risks of the systems they are building.”
Joe Benton · September 11, 2026
Primary source verifiedExtinction risk
“We’re probably going to go from a world where we have very capable systems now to a world where potentially we are co-inhabiting a world with AI agents that are much, much smarter than humans at some point in the next few years,”
Joe Benton · September 10, 2026
Primary source verifiedTimelines
Others on the same topic
“A lot of people are talking about rogue AI hacking into data centers and taking over the world, but it is not in the mainstream consciousness that like AI could literally take over the world just by continuing to do what it's supposed to do, which is automating everything”
Jay Chooi, Founder and CEO, Robocurve · October 2026
“Because if we are just competing with the machines, we will probably lose.”
Jan Kulveit · October 2026
“Alignment is the problem of preventing this, and is both difficult and unsolved. Our present understanding of how to train AI systems that deeply want what we want, is extremely rudimentary. Worse, we are not on track to solve alignment in time: frontier AI capabilities are improving much faster than our understanding of AI alignment.”
Bilal Chughtai, AGI safety and alignment research, Google DeepMind · September 14, 2026
All quotes on loss of control →All quotes on race dynamics →