On AI Risk

Leopold Aschenbrenner on AI risk

Leopold Aschenbrenner: Founder at AGI-focused investment firm (Situational Awareness LP). Previously Superalignment team researcher at OpenAI (2023–2024). This page collects 5 quotes from 2024, newest first, on loss of control (3), race dynamics (2), extinction risk (1), pause (1).

Expertise: AI alignment, AI forecasting, economicsLoss of control (3)Race dynamics (2)Extinction risk (1)Pause (1)Timelines (1)

Affiliations

Quotes (5), newest first

“On the one end there are the doomers. They have been obsessing over AGI for many years; I give them a lot of credit for their prescience. But their thinking has become ossified, untethered from the empirical realities of deep learning, their proposals naive and unworkable, and they fail to engage with the very real authoritarian threat. Rabid claims of 99% odds of doom, calls to indefinitely pause AI—they are clearly not the way.”

Leopold Aschenbrenner · June 2024

Primary source verifiedPause
“We need to not screw it up. Recognizing the power of superintelligence also means recognizing its peril. There are very real safety risks; very real risks this all goes awry—whether it be because mankind uses the destructive power brought forth for our mutual annihilation, or because, yes, the alien species we’re summoning is one we cannot yet fully control. These are manageable—but improvising won’t cut it.”

Leopold Aschenbrenner · June 2024

Primary source verifiedExtinction riskLoss of control
“The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace many college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be unleashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.”

Leopold Aschenbrenner · June 2024

Primary source verifiedRace dynamicsTimelines

Colleagues in this collection

People who have worked at the same organization, at any time.