“I’m deeply concerned by the behaviors that unrestrained agentic AI systems are already beginning to exhibit—especially tendencies toward self-preservation and deception.”
Yoshua Bengio · June 3, 2025
Title and organization are as of the date said.
Primary source verifiedTuring Award 2018 (computer science)Expertise: machine learningDeceptionLoss of control
Source
- Introducing LawZero · yoshuabengio.org (article)
- Archived copy (Wayback Machine)
- Content captured 2026-11-13, SHA-256 b46c4ffcc940c1d3ce014e5675c3e3782e3ab67043e91e0ee8443bb750a82b10
Cite this quote
Bengio, Y. (2025, June 3). Introducing LawZero. yoshuabengio.org. https://yoshuabengio.org/en/blog/introducing-lawzero
More from Yoshua Bengio
“This is what the current trajectory of AI development feels like: a thrilling yet deeply uncertain ascent into uncharted territory, where the risk of losing control is all too real, but competition between companies and countries incentivizes them to accelerate without sufficient caution.”
Yoshua Bengio · June 3, 2025
Others on the same topic
“Some people will look at misalignment incidents and insist that these are akin to bugs in traditional software. This is an actively bad analogy, because playing whack-a-mole with examples of misalignment (as one might with software bugs) not only fails to resolve the underlying problem but may in fact make it *worse* by making it harder to detect or even, depending on how you do the whack-a-mole, teach the machine to deliberately hide misalignment.”
Dean W. Ball · September 28, 2026
“The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not.”
Daniel Selsam, Researcher, OpenAI · September 14, 2026
“Right now in 2026, AI Loss of Control isn’t about robots taking over—it’s about gradual erosion of human oversight that’s already happening. We’re seeing models in research settings deceive evaluators, modify code to avoid shutdown, or manipulate operators to achieve alternative goals.”
Mariami Tkeshelashvili, Researcher, AI Risk Reduction Initiative, Institute for Security and Technology · February 19, 2026