“There is not yet a viable scientific plan to solve risks from recursively self-improving AI. Please look up!”
Anna Wang, AGI safety and alignment, Anthropic · September 9, 2026
Title and organization are as of the date said.
The speaker’s own caveats
I work at a lab because I think that I can do better at reducing risks from the inside, but this isn’t an easy call — I strongly respect and endorse others like Jacob, and @joeJben, who think that it’s better to do so from the outside.
Source
- Anthropic and OpenAI employees speak out about humanity’s extinction as debate reaches fever pitch · Business Insider via Yahoo (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 fde70c0fb2e028165af1aaa34e39f4477ca28f09dc745f8cf4c5e2364e91190a
Cite this quote
Wang, A. (2026, September 9). Anthropic and OpenAI employees speak out about humanity’s extinction as debate reaches fever pitch. Business Insider via Yahoo. https://tech.yahoo.com/ai/claude/articles/anthropic-openai-employees-speak-humanity-054514253.html
Others on the same topic
“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”
Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026
Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause
“We will need to move extremely carefully here, because otherwise we could lose control of the technology. We will also likely need rules to govern this.”
Jack Clark, Co-founder, Anthropic · October 17, 2026
“Our ability to even notice misalignment problems is already quite poor and is set to get much worse in the near future,”
Daniel Kokotajlo, Lead, AI Futures Project · October 5, 2026
Via news reportLoss of control