“I think a lot of people had this fantasy that [alignment] was going to get easier as these things got smarter, and now it’s getting harder. And they’re like, ‘Oh shit,’”
Nate Soares · Undated
Title and organization are as of the date said.
Source
- Why So Many AI Researchers Think the Machines Could Kill Everyone · WIRED (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 47f9c06d382d81bb9ddf860edb7394d9fb3e7cabab03ab790899dea0ceebf7da
Cite this quote
Soares, N. (n.d.). Why So Many AI Researchers Think the Machines Could Kill Everyone. WIRED. https://www.wired.com/story/why-so-many-ai-researchers-think-the-machines-could-kill-everyone/
More from Nate Soares
“Sometimes they say ~"I think the bad stuff could happen" and other times they say ~"it's riskier than any other threat" and other times they say ~"the bad stuff would be like, they destroy humanity and we can't do anything to stop it" but they rarely say all three together.”
Nate Soares, President, Machine Intelligence Research Institute · March 20, 2026
Primary source verifiedExtinction risk
Others on the same topic
“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”
Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026
Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause
“We will need to move extremely carefully here, because otherwise we could lose control of the technology. We will also likely need rules to govern this.”
Jack Clark, Co-founder, Anthropic · October 17, 2026
“Our ability to even notice misalignment problems is already quite poor and is set to get much worse in the near future,”
Daniel Kokotajlo, Lead, AI Futures Project · October 5, 2026
Via news reportLoss of control