On AI Risk
“Just the single biggest issue in AI is we’re building these potentially very powerful, very replicable, very numerous systems — and we’re building them in ways where we don’t have much insight into whether they have goals, or what the goals would be; we’re kind of introducing the second advanced species onto the planet that we don’t understand.”

Holden Karnofsky, Co-founder, Open Philanthropy · July 31, 2023

Title and organization are as of the date said.

Primary source verifiedExpertise: AI safety, AI policy, grantmakingLoss of control

In context

“Just the single biggest issue in AI is we’re building these potentially very powerful, very replicable, very numerous systems — and we’re building them in ways where we don’t have much insight into whether they have goals, or what the goals would be; we’re kind of introducing the second advanced species onto the planet that we don’t understand.” And if that advanced species becomes more numerous and/or more capable than us, we don’t have a great argument to think that’s going to be good for us.

The speaker’s own caveats

And despite the feeling that I feel it is fairly overrated in some circles, I still think it’s the number one thing for me.

Source

Cite this quote

Karnofsky, H. (2023, July 31). #158 – Holden Karnofsky on how AIs might take over even if they're no smarter than humans [Podcast episode]. 80,000 Hours. https://80000hours.org/podcast/episodes/holden-karnofsky-how-ai-could-take-over-the-world/

More from Holden Karnofsky

All 2 quotes by Holden Karnofsky →

Others on the same topic

All quotes on loss of control →

Report an error in this quote