“Overall, my current view is that despite these uncertainties and trade-offs, we should try hard to put ourselves in a position to steer or restrain AI development when doing so is necessary for safety; that even limited or temporary success in this respect can make a significant positive difference; and that more thoroughgoing success remains, at least, a live possibility.”
Joe Carlsmith · March 19, 2026
“Safety progress takes time. If you don’t have enough time, at each stage of AI development, to ensure the AIs that you build in the next stage won’t destroy humanity, then you’ll fail, and humanity will be destroyed. Automated alignment research helps a lot here, and that’s a core reason I think it’s so important (human alignment researchers are too scarce and slow). But even if AIs are doing most or all of the alignment work, it still matters how much time they have.”
Joe Carlsmith · March 19, 2026
“Right now in 2026, AI Loss of Control isn’t about robots taking over—it’s about gradual erosion of human oversight that’s already happening. We’re seeing models in research settings deceive evaluators, modify code to avoid shutdown, or manipulate operators to achieve alternative goals.”
Mariami Tkeshelashvili, Researcher, AI Risk Reduction Initiative, Institute for Security and Technology · February 19, 2026
“we don't know exactly when AGI will be built. 2027 was our modal (most likely) year at the time of publication, our medians were somewhat longer.”
Daniel Kokotajlo, Lead, AI Futures Project · November 22, 2025
Primary source verifiedTimelines “My own experience is that as these AI systems get smarter and smarter, they develop more and more complicated goals. When these goals aren’t absolutely aligned with both our preferences and the right context, the AI systems will behave strangely.”
Jack Clark, Co-founder, Anthropic · October 13, 2025
Primary source verifiedLoss of control “To be clear, we are not yet at “self-improving AI”, but we are at the stage of “AI that improves bits of the next AI, with increasing autonomy and agency”.”
Jack Clark, Co-founder, Anthropic · October 13, 2025
“I’m deeply concerned by the behaviors that unrestrained agentic AI systems are already beginning to exhibit—especially tendencies toward self-preservation and deception.”
Yoshua Bengio · June 3, 2025
“This is what the current trajectory of AI development feels like: a thrilling yet deeply uncertain ascent into uncharted territory, where the risk of losing control is all too real, but competition between companies and countries incentivizes them to accelerate without sufficient caution.”
Yoshua Bengio · June 3, 2025
“There are serious challenges to confront along with the huge upsides. We do need to solve the safety issues, technically and societally, but then it’s critically important to widely distribute access to superintelligence given the economic implications.”
Sam Altman, CEO, OpenAI · June 2025
Primary source verifiedTimelines “But by the same token, we’ve never seen any solid evidence in truly real-world scenarios of deception and power-seeking”
Dario Amodei, Co-founder and CEO, Anthropic · April 2025
“On the other hand, I worry that AI itself is advancing so quickly that we might not have even this much time. As I’ve written elsewhere, we could have AI systems equivalent to a “country of geniuses in a datacenter” as soon as 2026 or 2027. I am very concerned about deploying such systems without a better handle on interpretability.”
Dario Amodei, Co-founder and CEO, Anthropic · April 2025
“I resigned from OpenAI because I lost faith that by themselves they will make responsible decisions about AGI.”
William Saunders, Member of Technical Staff, Alignment/Superalignment, OpenAI · September 17, 2024
Primary source verifiedRace dynamicsRegulation “many of these same people believe that if they succeed in building computers that are as smart as humans or perhaps far smarter than humans, that technology will be at a minimum extraordinarily disruptive and at a maximum could lead to literal human extinction.”
Helen Toner, Director of Strategy and Foundational Research Grants, CSET, Georgetown University · September 17, 2024
“No one knows how to ensure that a GI systems will be safe and controlled.”
William Saunders, Member of Technical Staff, Alignment/Superalignment, OpenAI · September 17, 2024
“There are still significant gaps to close, but I believe it is plausible that an AGI system could be built in as little as three years AGI would cause significant changes to society including radical changes to the economy and employment.”
William Saunders, Member of Technical Staff, Alignment/Superalignment, OpenAI · September 17, 2024
Primary source verifiedTimelines “Unless we solve alignment—unless we figure out how to instill those side-constraints—there’s no particular reason to expect this small civilization of superintelligences will continue obeying human commands in the long run. It seems totally within the realm of possibilities that at some point they’ll simply conspire to cut out the humans, whether suddenly or gradually.”
Leopold Aschenbrenner · June 2024
Primary source verifiedLoss of control “The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace many college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be unleashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.”
Leopold Aschenbrenner · June 2024
Primary source verifiedRace dynamicsTimelines “We need to not screw it up. Recognizing the power of superintelligence also means recognizing its peril. There are very real safety risks; very real risks this all goes awry—whether it be because mankind uses the destructive power brought forth for our mutual annihilation, or because, yes, the alien species we’re summoning is one we cannot yet fully control. These are manageable—but improvising won’t cut it.”
Leopold Aschenbrenner · June 2024
“On the one end there are the doomers. They have been obsessing over AGI for many years; I give them a lot of credit for their prescience. But their thinking has become ossified, untethered from the empirical realities of deep learning, their proposals naive and unworkable, and they fail to engage with the very real authoritarian threat. Rabid claims of 99% odds of doom, calls to indefinitely pause AI—they are clearly not the way.”
Leopold Aschenbrenner · June 2024
Primary source verifiedPause “Right now, no lab has demonstrated much of a willingness to make any costly tradeoffs to get safety right (we get lots of safety committees, yes, but those are pretty meaningless). By default, we’ll probably stumble into the intelligence explosion and have gone through a few OOMs before people even realize what we’ve gotten into.”
Leopold Aschenbrenner · June 2024