On AI Risk
“I’m deeply concerned by the behaviors that unrestrained agentic AI systems are already beginning to exhibit—especially tendencies toward self-preservation and deception.”

Yoshua Bengio · June 3, 2025

Title and organization are as of the date said.

Primary source verifiedTuring Award 2018 (computer science)Expertise: machine learningDeceptionLoss of control

Source

Cite this quote

Bengio, Y. (2025, June 3). Introducing LawZero. yoshuabengio.org. https://yoshuabengio.org/en/blog/introducing-lawzero

More from Yoshua Bengio

All 2 quotes by Yoshua Bengio →

Others on the same topic

“Some people will look at misalignment incidents and insist that these are akin to bugs in traditional software. This is an actively bad analogy, because playing whack-a-mole with examples of misalignment (as one might with software bugs) not only fails to resolve the underlying problem but may in fact make it *worse* by making it harder to detect or even, depending on how you do the whack-a-mole, teach the machine to deliberately hide misalignment.”

Dean W. Ball · September 28, 2026

Primary source verifiedDeceptionLoss of control
“The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not.”

Daniel Selsam, Researcher, OpenAI · September 14, 2026

Primary source verifiedDeceptionLoss of control

All quotes on deception →All quotes on loss of control →

Report an error in this quote