“If we build superintelligence without more robust alignment I expect we will permanently lose control of it. If that happens then most people could die.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
Title and organization are as of the date said.
Source
- Personal statement on joining the OpenAI nonprofit board · Paul Christiano (Substack) (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-07, SHA-256 4cb86f65591a7ef3386ce1ba50b8adf1b17a77721e5e7e5b240dd18991f8b072
Cite this quote
Christiano, P. (2026, September 9). Personal statement on joining the OpenAI nonprofit board. Paul Christiano (Substack). https://paulfchristiano.substack.com/p/personal-statement-on-joining-the
More from Paul Christiano
“Based on the recent trajectory of capabilities and the continued difficulty of alignment, I now believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
“If I had to quantify my uncertainty I would estimate an all-things-considered risk of 4% over the next year and 15% over the next three years.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
Stated probability: 4% over the next year; 15% over the next three years
“I think there is meaningful risk even in the next 6-12 months [of AI takeover]. I think the trajectory in the field has been extremely alarming over the last 3-6 months to people who have been tracking closely. We have seen roughly the things we might expect to see shortly before something really bad were to happen.”
Paul Christiano · Undated
Stated probability: 50%
Others on the same topic
“On the current path, I think it is more likely than not that humanity loses control to these AIs, and it could end in human extinction,”
Jacob Coxon, Researcher, pretraining, Anthropic · October 5, 2026
“If the language models actually reach the capability threshold where they can shape the world unconstrained by human will, they will probably do something extreme and destroy humanity in the process.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026
“I also work at an AI company and believe there’s plausibly a ≥10% chance that a future out-of-control AI kills everyone (IMO even 1% is unacceptably high). And higher still is the risk that we “only” get permanently disempowered by AIs that don’t deeply want the best for us.”
Dmitrii Krasheninnikov, Research fellow, AI safety (title from search snippet), Anthropic · September 11, 2026
Stated probability: ≥10%, “plausibly”; no time frame
All quotes on extinction risk →All quotes on loss of control →