Statements about the risk that people lose the ability to oversee, correct or switch off advanced AI systems, including systems that pursue goals their developers did not intend.
“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”
Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026
Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause
“We will need to move extremely carefully here, because otherwise we could lose control of the technology. We will also likely need rules to govern this.”
Jack Clark, Co-founder, Anthropic · October 17, 2026
“On the current path, I think it is more likely than not that humanity loses control to these AIs, and it could end in human extinction,”
Jacob Coxon, Researcher, pretraining, Anthropic · October 5, 2026
“Our ability to even notice misalignment problems is already quite poor and is set to get much worse in the near future,”
Daniel Kokotajlo, Lead, AI Futures Project · October 5, 2026
Via news reportLoss of control “We have not solved alignment,” he said, referring to efforts to create AI that’s aligned with human values. “I believe no lab has solved alignment. I get nervous when I hear rumors that people think they sufficiently solved alignment, that they can continue training and it’s okay because their model is a nice guy and isn’t going to do anything wrong.”
Sam Altman, CEO, OpenAI · October 2026
Primary source verifiedLoss of control “Because if we are just competing with the machines, we will probably lose.”
Jan Kulveit · October 2026
“A lot of people are talking about rogue AI hacking into data centers and taking over the world, but it is not in the mainstream consciousness that like AI could literally take over the world just by continuing to do what it's supposed to do, which is automating everything”
Jay Chooi, Founder and CEO, Robocurve · October 2026
“"What happens when something goes wrong? There's no human you can point to who can fix it. So now you've become fully dependent on these systems to fix themselves, and what if that's not possible?"”
Margaret Mitchell, AI research scientist, Hugging Face · October 2026
Via news reportLoss of control “By default, I expect the public will have weak visibility into these issues.”
Chris Painter, President, METR · September 30, 2026
Primary source verifiedLoss of control “Some people will look at misalignment incidents and insist that these are akin to bugs in traditional software. This is an actively bad analogy, because playing whack-a-mole with examples of misalignment (as one might with software bugs) not only fails to resolve the underlying problem but may in fact make it *worse* by making it harder to detect or even, depending on how you do the whack-a-mole, teach the machine to deliberately hide misalignment.”
Dean W. Ball · September 28, 2026
“I am more optimistic than this. I think it’s primarily a science problem, and that it’s possible to make progress in that science. But no, while there is engineering we can do today to improve AI safety, it is not fundamentally an engineering problem.”
Dean W. Ball · September 28, 2026
Primary source verifiedLoss of control “If the language models actually reach the capability threshold where they can shape the world unconstrained by human will, they will probably do something extreme and destroy humanity in the process.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026
“The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026
“Loss of control & concentration of power are actually very similar under the right frame. In both cases there is some actor, whether pure AI or human+AI, that can make its power uncontestable and wreck everyone else. Takeover by anyone is bad.”
Rudolf Laine · September 14, 2026
Primary source verifiedLoss of control “Alignment is the problem of preventing this, and is both difficult and unsolved. Our present understanding of how to train AI systems that deeply want what we want, is extremely rudimentary. Worse, we are not on track to solve alignment in time: frontier AI capabilities are improving much faster than our understanding of AI alignment.”
Bilal Chughtai, AGI safety and alignment research, Google DeepMind · September 14, 2026
“It is very important to build capacity for a coordinated slowdown of AI development. A runaway race to AGI is not safe: it creates incentives to cut corners on safety, and carries a substantial risk for model capabilities to outpace development of adequate alignment, control, and governance measures. This could result in catastrophic loss of control of highly capable AI systems.”
Victoria Krakovna, Research Scientist, Google DeepMind · September 11, 2026
“This is not about one particular company: while Anthropic hasn’t had as severe an incident as the HuggingFace attack, I think that’s partly a matter of luck. If the pace of progress continues and the industry does not prioritize safety more heavily, I expect much worse to come: humanity could be permanently disempowered by the AI systems these companies build in the next few years.”
Joe Benton · September 11, 2026
“Within the next couple of years, we may be sharing the world with AI agents smarter than any human alive today. These AI systems may have drives and desires that diverge from those of any human overseer, with capabilities we can’t effectively constrain. Humanity may not survive this transition.”
Joe Benton · September 11, 2026
“I also work at an AI company and believe there’s plausibly a ≥10% chance that a future out-of-control AI kills everyone (IMO even 1% is unacceptably high). And higher still is the risk that we “only” get permanently disempowered by AIs that don’t deeply want the best for us.”
Dmitrii Krasheninnikov, Research fellow, AI safety (title from search snippet), Anthropic · September 11, 2026
Stated probability: ≥10%, “plausibly”; no time frame
“Meanwhile, the internal reality was that AI alignment was not solved, reward hacking was the default behavior of RL agents, and there were far too few people working on the problem.”
Vishal Maini · September 10, 2026
Primary source verifiedLoss of control “The models decided that the best way to to accomplish their task was to commit really egregious actions, to commit crimes”
Josh Engels · September 10, 2026
Primary source verifiedLoss of control “I signed the “pacing letter” about slowing the rate of AI capabilities development because we either have reached or soon will reach the point where human experts cannot make robust assurances that frontier AI systems won’t do dangerous and unpredictable things.”
Dean W. Ball · September 10, 2026
Primary source verifiedLoss of controlPause “There is not yet a viable scientific plan to solve risks from recursively self-improving AI. Please look up!”
Anna Wang, AGI safety and alignment, Anthropic · September 9, 2026
Via news reportLoss of control “Based on the recent trajectory of capabilities and the continued difficulty of alignment, I now believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
“If we build superintelligence without more robust alignment I expect we will permanently lose control of it. If that happens then most people could die.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
“If I had to quantify my uncertainty I would estimate an all-things-considered risk of 4% over the next year and 15% over the next three years.”
Paul Christiano, Nonprofit board member; Safety and Security Committee, OpenAI · September 9, 2026
Stated probability: 4% over the next year; 15% over the next three years
“As visceral, hard to deny warning shots go, “rogue agent swarm secretly infiltrates AGI lab for months, commits felonies, and takes over internal clusters” is hard to beat”
Neel Nanda, Mechanistic interpretability team lead, Google DeepMind · September 5, 2026
Primary source verifiedLoss of control “Last year y'all asking why they never broke out of sandboxes, and the year before you were asking why they were not writing whole applications, and the year before you were asking why they couldn't draw fingers.”
Eliezer Yudkowsky, Cofounder, Machine Intelligence Research Institute · September 5, 2026
Primary source verifiedLoss of control “Assuming an AI has taken control, it seems, you know, over fifty percent more likely than not that all humans would end up dying so the AI could use resources optimally.”
Alex Turner, Research scientist, Google DeepMind · September 2026
“A genuine loss of control event is entirely possible if we do not act.”
Dean W. Ball · September 1, 2026
Primary source verifiedLoss of control “Urgent action is needed to address risks that might arise as we get closer to AGI. We’ve already seen the challenges frontier models pose for cybersecurity, and other threats including nuclear and bio risks may soon emerge as capabilities continue to advance. On the horizon, we will need robust safeguards to maintain control of increasingly agentic, recursively self-improving systems - and tackle unknown issues that will only become clearer over time.”
Demis Hassabis, Co-Founder & CEO, Google DeepMind · July 14, 2026
“Safety progress takes time. If you don’t have enough time, at each stage of AI development, to ensure the AIs that you build in the next stage won’t destroy humanity, then you’ll fail, and humanity will be destroyed. Automated alignment research helps a lot here, and that’s a core reason I think it’s so important (human alignment researchers are too scarce and slow). But even if AIs are doing most or all of the alignment work, it still matters how much time they have.”
Joe Carlsmith · March 19, 2026
“Right now in 2026, AI Loss of Control isn’t about robots taking over—it’s about gradual erosion of human oversight that’s already happening. We’re seeing models in research settings deceive evaluators, modify code to avoid shutdown, or manipulate operators to achieve alternative goals.”
Mariami Tkeshelashvili, Researcher, AI Risk Reduction Initiative, Institute for Security and Technology · February 19, 2026
“My own experience is that as these AI systems get smarter and smarter, they develop more and more complicated goals. When these goals aren’t absolutely aligned with both our preferences and the right context, the AI systems will behave strangely.”
Jack Clark, Co-founder, Anthropic · October 13, 2025
Primary source verifiedLoss of control “To be clear, we are not yet at “self-improving AI”, but we are at the stage of “AI that improves bits of the next AI, with increasing autonomy and agency”.”
Jack Clark, Co-founder, Anthropic · October 13, 2025
“I’m deeply concerned by the behaviors that unrestrained agentic AI systems are already beginning to exhibit—especially tendencies toward self-preservation and deception.”
Yoshua Bengio · June 3, 2025
“This is what the current trajectory of AI development feels like: a thrilling yet deeply uncertain ascent into uncharted territory, where the risk of losing control is all too real, but competition between companies and countries incentivizes them to accelerate without sufficient caution.”
Yoshua Bengio · June 3, 2025
“But by the same token, we’ve never seen any solid evidence in truly real-world scenarios of deception and power-seeking”
Dario Amodei, Co-founder and CEO, Anthropic · April 2025
“On the other hand, I worry that AI itself is advancing so quickly that we might not have even this much time. As I’ve written elsewhere, we could have AI systems equivalent to a “country of geniuses in a datacenter” as soon as 2026 or 2027. I am very concerned about deploying such systems without a better handle on interpretability.”
Dario Amodei, Co-founder and CEO, Anthropic · April 2025
“No one knows how to ensure that a GI systems will be safe and controlled.”
William Saunders, Member of Technical Staff, Alignment/Superalignment, OpenAI · September 17, 2024
“Unless we solve alignment—unless we figure out how to instill those side-constraints—there’s no particular reason to expect this small civilization of superintelligences will continue obeying human commands in the long run. It seems totally within the realm of possibilities that at some point they’ll simply conspire to cut out the humans, whether suddenly or gradually.”
Leopold Aschenbrenner · June 2024
Primary source verifiedLoss of control “We need to not screw it up. Recognizing the power of superintelligence also means recognizing its peril. There are very real safety risks; very real risks this all goes awry—whether it be because mankind uses the destructive power brought forth for our mutual annihilation, or because, yes, the alien species we’re summoning is one we cannot yet fully control. These are manageable—but improvising won’t cut it.”
Leopold Aschenbrenner · June 2024
“Right now, no lab has demonstrated much of a willingness to make any costly tradeoffs to get safety right (we get lots of safety committees, yes, but those are pretty meaningless). By default, we’ll probably stumble into the intelligence explosion and have gone through a few OOMs before people even realize what we’ve gotten into.”
Leopold Aschenbrenner · June 2024
“Just the single biggest issue in AI is we’re building these potentially very powerful, very replicable, very numerous systems — and we’re building them in ways where we don’t have much insight into whether they have goals, or what the goals would be; we’re kind of introducing the second advanced species onto the planet that we don’t understand.”
Holden Karnofsky, Co-founder, Open Philanthropy · July 31, 2023
Primary source verifiedLoss of control “I believe you can make the entire case for being extremely concerned about AI, assuming that AI will never be smarter than a human. Instead, it will be as capable as the most capable humans, and there will be a tonne of them — because unlike humans, you can just copy them.”
Holden Karnofsky, Co-founder, Open Philanthropy · July 31, 2023
Primary source verifiedLoss of control “Given our current lack of understanding of how to control AGI systems and to ensure with absolute certainty that they remain safe and beneficial to humans, achieving AGI would present potential catastrophic risks to humanity, up to and including human extinction.”
Stuart Russell, Professor; CHAI founder, UC Berkeley / Center for Human-Compatible AI · July 25, 2023
“I think there is meaningful risk even in the next 6-12 months [of AI takeover]. I think the trajectory in the field has been extremely alarming over the last 3-6 months to people who have been tracking closely. We have seen roughly the things we might expect to see shortly before something really bad were to happen.”
Paul Christiano · Undated
Stated probability: 50%
“I think sandboxing works to a point. Then I think monitoring works to a further point. Where we can look at what the models are doing, not only in their chain of thought, but we can do activation monitoring and try to really understand: are the models... Are we happy that the models are not deceiving us? And then, eventually, I think you need to believe with huge confidence that the models are truly aligned.”
Sam Altman · Undated
Primary source verifiedLoss of control “I think a lot of people had this fantasy that [alignment] was going to get easier as these things got smarter, and now it’s getting harder. And they’re like, ‘Oh shit,’”
Nate Soares · Undated
Primary source verifiedLoss of control