“If I had to quantify my uncertainty I would estimate an all-things-considered risk of 4% over the next year and 15% over the next three years.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
Title and organization are as of the date said.
The speaker’s own caveats
These numbers are a way of stating my subjective beliefs and communicating roughly how big I think the problem is, not a claim to have a model that produces precise or stable estimates.
Stated probability
4% over the next year; 15% over the next three years
Source
- Personal statement on joining the OpenAI nonprofit board · Paul Christiano (Substack) (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 4cb86f65591a7ef3386ce1ba50b8adf1b17a77721e5e7e5b240dd18991f8b072
Cite this quote
Christiano, P. (2026, September 9). Personal statement on joining the OpenAI nonprofit board. Paul Christiano (Substack). https://paulfchristiano.substack.com/p/personal-statement-on-joining-the
More from Paul Christiano
“Based on the recent trajectory of capabilities and the continued difficulty of alignment, I now believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
“If we build superintelligence without more robust alignment I expect we will permanently lose control of it. If that happens then most people could die.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
“I think there is meaningful risk even in the next 6-12 months [of AI takeover]. I think the trajectory in the field has been extremely alarming over the last 3-6 months to people who have been tracking closely. We have seen roughly the things we might expect to see shortly before something really bad were to happen.”
Paul Christiano · Undated
Stated probability: 50%
Others on the same topic
“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”
Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026
Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026
“Urgent action is needed to address risks that might arise as we get closer to AGI. We’ve already seen the challenges frontier models pose for cybersecurity, and other threats including nuclear and bio risks may soon emerge as capabilities continue to advance. On the horizon, we will need robust safeguards to maintain control of increasingly agentic, recursively self-improving systems - and tackle unknown issues that will only become clearer over time.”
Demis Hassabis, Co-Founder & CEO, Google DeepMind · July 14, 2026