On AI Risk
“Based on the recent trajectory of capabilities and the continued difficulty of alignment, I now believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term.”

Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026

Title and organization are as of the date said.

Primary source verifiedExpertise: machine learning, AI safetyLoss of controlTimelines

In context

“Based on the recent trajectory of capabilities and the continued difficulty of alignment, I now believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term.” I do not think that the AI industry in general, including OpenAI, is currently on track to reduce this risk to an acceptable level.

The speaker’s own caveats

My joining is not an endorsement or criticism of OpenAI’s safety practices in particular

Source

Cite this quote

Christiano, P. (2026, September 9). Personal statement on joining the OpenAI nonprofit board. Paul Christiano (Substack). https://paulfchristiano.substack.com/p/personal-statement-on-joining-the

More from Paul Christiano

All 4 quotes by Paul Christiano →

Others on the same topic

“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”

Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026

Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause

Primary source verifiedLoss of controlPauseTimelines
“Urgent action is needed to address risks that might arise as we get closer to AGI. We’ve already seen the challenges frontier models pose for cybersecurity, and other threats including nuclear and bio risks may soon emerge as capabilities continue to advance. On the horizon, we will need robust safeguards to maintain control of increasingly agentic, recursively self-improving systems - and tackle unknown issues that will only become clearer over time.”

Demis Hassabis, Co-Founder & CEO, Google DeepMind · July 14, 2026

Primary source verifiedLoss of controlTimelines

All quotes on loss of control →All quotes on timelines →

Report an error in this quote