“Meanwhile, the internal reality was that AI alignment was not solved, reward hacking was the default behavior of RL agents, and there were far too few people working on the problem.”
Vishal Maini · September 10, 2026
Title and organization are as of the date said.
Source
- https://x.com/v_maini/status/2097863067690475727 · X (tweet)
- Content captured 2026-11-07, SHA-256 2095f038cf9a6330cea7c68430b7fb9a4d4e7384c13591439bc4bf1707c755f7
Cite this quote
Maini, V. (2026, September 10). Meanwhile, the internal reality was that AI alignment was not solved, reward hacking was the default behavior of RL agents,… [Post]. X. https://x.com/v_maini/status/2097863067690475727
More from Vishal Maini
“When I first joined GDM, external communication about the possibility of human extinction was not permitted, by anyone, at any level of the organization.”
Vishal Maini · September 10, 2026
Primary source verifiedSuppression
“I do believe there’s a real risk of human extinction through the AI transition.”
Vishal Maini · September 2026
Primary source verifiedExtinction risk
Others on the same topic
“If we achieve ASI within 6-12 months, I estimate that the chance of an AI takeover is roughly 75%. (In a recent talk, Paul Christiano said it would be a coin flip.) Paired with the timelines above, unless we achieve aggressive pacing or a pause within 6-12 months, we incur something like a 1-in-4 to 1-in-3 chance of AI takeover within 12 months.”
Nikola Jurkovic, Member of Technical Staff, METR · November 13, 2026
Stated probability: ~75% AI takeover if ASI within 6-12 months; 1-in-4 to 1-in-3 chance of AI takeover within 12 months absent pacing/pause
“We will need to move extremely carefully here, because otherwise we could lose control of the technology. We will also likely need rules to govern this.”
Jack Clark, Co-founder, Anthropic · October 17, 2026
“Our ability to even notice misalignment problems is already quite poor and is set to get much worse in the near future,”
Daniel Kokotajlo, Lead, AI Futures Project · October 5, 2026
Via news reportLoss of control