On AI Risk
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”

Joe Benton · September 11, 2026

Title and organization are as of the date said.

Primary source verifiedExpertise: machine learning, AI safetyExtinction riskLoss of controlTimelines

In context

“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.” We need a lot more preparation to make this world safe.

Source

Cite this quote

Benton, J. (2026, September 11). Why I left Anthropic’s safety team to hold AI companies accountable. Joe Benton (Substack). https://jbenton1.substack.com/p/why-i-left-anthropics-safety-team

More from Joe Benton

All 4 quotes by Joe Benton →

Others on the same topic

All quotes on extinction risk →All quotes on loss of control →All quotes on timelines →

Report an error in this quote