“We’re probably going to go from a world where we have very capable systems now to a world where potentially we are co-inhabiting a world with AI agents that are much, much smarter than humans at some point in the next few years,”
Joe Benton · September 10, 2026
Title and organization are as of the date said.
Source
- Two AI researchers leave Anthropic and Google over safety concerns: ‘There are no adults in the room’ · NBC News (interview)
- Content captured 2026-11-07, SHA-256 72dd8afa3bfd793d0b420a6eeb5398184cbab4584087fc13f7d27d365dd47195
Cite this quote
Benton, J. (2026, September 10). Two AI researchers leave Anthropic and Google over safety concerns: ‘There are no adults in the room’ [Interview]. NBC News. https://www.nbcnews.com/tech/security/two-ai-researchers-leave-anthropic-google-safety-concerns-rcna597086
More from Joe Benton
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026
“Many of the colleagues I had at Anthropic are terrified by the risks of the systems they are building.”
Joe Benton · September 11, 2026
Primary source verifiedExtinction risk
“This is not about one particular company: while Anthropic hasn’t had as severe an incident as the HuggingFace attack, I think that’s partly a matter of luck. If the pace of progress continues and the industry does not prioritize safety more heavily, I expect much worse to come: humanity could be permanently disempowered by the AI systems these companies build in the next few years.”
Joe Benton · September 11, 2026
Others on the same topic
“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”
Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026
Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause
“Scaling laws (predictable increases in model intelligence) could still plateau. They haven’t so far, and it’s just a few more steps up the ladder to hit the finish line, but it’s certainly possible.”
Jacob Coxon, Researcher, pretraining, Anthropic · September 15, 2026
Primary source verifiedTimelines
“I too am extremely concerned by the default trajectory of this technology. I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome.”
Bilal Chughtai, AGI safety and alignment research, Google DeepMind · September 14, 2026