On AI Risk
“Yudkowsky and his Sequences 20 years ago. I remember thinking: even if these people talk and act like crazy cultists, still, let me bend over backwards to be epistemically virtuous, and entertain their ideas on their merits, as very few academics would. Even if, of course, I ultimately end up rejecting the ideas, on the simple ground that powerful AI is such an absurdly remote prospect that it’s almost impossible to say anything useful about it today, outside the realm of speculative fiction. For my failure to see what was coming, it seems like an appropriate punishment that I’m now, in 2026, effectively teaching a course on Yudkowsky Studies. And it’s the most important course I can teach.”

Scott Aaronson, Professor of Computer Science, University of Texas at Austin · October 4, 2026

Title and organization are as of the date said.

Primary source verifiedExpertise: complexity theory, quantum computing, AI alignment theoryExtinction riskLoss of control

In context

He recalls encountering Yudkowsky's Sequences 20 years ago and ultimately rejecting the ideas "on the simple ground that powerful AI is such an absurdly remote prospect that it’s almost impossible to say anything useful about it today, outside the realm of speculative fiction." “Yudkowsky and his Sequences 20 years ago. I remember thinking: even if these people talk and act like crazy cultists, still, let me bend over backwards to be epistemically virtuous, and entertain their ideas on their merits, as very few academics would. Even if, of course, I ultimately end up rejecting the ideas, on the simple ground that powerful AI is such an absurdly remote prospect that it’s almost impossible to say anything useful about it today, outside the realm of speculative fiction. For my failure to see what was coming, it seems like an appropriate punishment that I’m now, in 2026, effectively teaching a course on Yudkowsky Studies. And it’s the most important course I can teach.” The thing about AI alignment is that there’s no textbook

Source

Cite this quote

Aaronson, S. (2026, October 4). My new course at UT Austin: AI Alignment Theory. https://scottaaronson.blog/?p=10125

More from Scott Aaronson

All 2 quotes by Scott Aaronson →

Others on the same topic

All quotes on extinction risk →All quotes on loss of control →

Report an error in this quote