“We will need to move extremely carefully here, because otherwise we could lose control of the technology. We will also likely need rules to govern this.”
Jack Clark, Co-founder, Anthropic · October 17, 2026
Frontier lab
“We will need to move extremely carefully here, because otherwise we could lose control of the technology. We will also likely need rules to govern this.”
Jack Clark, Co-founder, Anthropic · October 17, 2026
“We will need to build the infrastructure to take advantage of this technology, but we will also need to go slowly and deliberately on developing the technology itself, to pace or otherwise control its development.”
Jack Clark, Co-founder, Anthropic · October 17, 2026
“On the current path, I think it is more likely than not that humanity loses control to these AIs, and it could end in human extinction,”
Jacob Coxon, Researcher, pretraining, Anthropic · October 5, 2026
“Scaling laws (predictable increases in model intelligence) could still plateau. They haven’t so far, and it’s just a few more steps up the ladder to hit the finish line, but it’s certainly possible.”
Jacob Coxon, Researcher, pretraining, Anthropic · September 15, 2026
“I also work at an AI company and believe there’s plausibly a ≥10% chance that a future out-of-control AI kills everyone (IMO even 1% is unacceptably high). And higher still is the risk that we “only” get permanently disempowered by AIs that don’t deeply want the best for us.”
Dmitrii Krasheninnikov, Research fellow, AI safety (title from search snippet), Anthropic · September 11, 2026
Stated probability: ≥10%, “plausibly”; no time frame
“100% agree with him that AI poses serious risks to society, and I’m glad he’s speaking out!”
Ethan Perez, Lead, Alignment Science team, Anthropic · September 10, 2026
“Now is a good time to build institutional mechanisms to pace the frontier of AI development. The industry is locked into an all-out scaling race to build superintelligence as quickly as possible, and we may need to give everyone more time for safety and alignment mitigations.”
Jan Leike, Alignment Science (title from search snippet), Anthropic · September 10, 2026
“we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.”
Evan Hubinger, Lead, Alignment Stress-Testing team, Anthropic · September 9, 2026
Stated probability: >10% within the next decade
“Things are moving way too fast, we don’t have anywhere near the degree of assurance we’ll want for ASI, and if we survive an unmitigated race at the current pace it will be because we got lucky at how hard the problems were rather than because the industry behaved responsibly.”
Drake Thomas, Pretraining team, Anthropic · September 9, 2026
“I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.”
Jacob Coxon, Researcher, pretraining, Anthropic · September 9, 2026
“If alignment goes badly, then we could have a catastrophic outcome in the next few years. Maybe it goes well and there's some sort of slowdown agreement, but either way, it's gonna get decided in the next couple of years.”
Jacob Coxon, Researcher, pretraining, Anthropic · September 9, 2026
“There is not yet a viable scientific plan to solve risks from recursively self-improving AI. Please look up!”
Anna Wang, AGI safety and alignment, Anthropic · September 9, 2026
“I would burn my equity to the ground in a heartbeat for a 1% higher chance we make it out of this situation alive. I expect a great many of my colleagues across the industry would as well. I promise you, we are actually just fucking scared, it’s not galaxy brained marketing.”
Drake Thomas, Pretraining team, Anthropic · September 9, 2026
“AI developers believe their technology could cause human extinction (or similarly bad outcomes). This could happen in the next few years. In general, the more senior the employee, the more concerned they are.”
Samuel Marks, Lead, Scalable Oversight team, Anthropic · September 9, 2026
“I think Anthropic is doing their best, and they're doing a very good job, but the structural necessity of the race is that, in the future, they will have to cut corners, so they will have to make trade-offs between rigor and safety, because they're racing against competitors like OpenAI and China.”
Jacob Coxon, Researcher, pretraining, Anthropic · September 9, 2026
“When we say human extinction, it’s because, for something that intelligent, it really will be quite straightforward for it to kill everyone.”
Jacob Coxon, Researcher, pretraining, Anthropic · September 9, 2026
“Many AI developer staff desperately want to slow down to figure out how to build AI more safely”
Samuel Marks, Lead, Scalable Oversight team, Anthropic · September 9, 2026
“I promise you that we are actually literally worried about world-ending consequences from this technology. Please find some people you trust who work at these companies and actually talk to them about their views.”
Drake Thomas, Pretraining team, Anthropic · August 21, 2026
“Like splitting the atom, AI holds the potential for both immense benefit and immense risk. The world should take the time to do this right.”
Will Yager, Anthropic · July 2026
“My own experience is that as these AI systems get smarter and smarter, they develop more and more complicated goals. When these goals aren’t absolutely aligned with both our preferences and the right context, the AI systems will behave strangely.”
Jack Clark, Co-founder, Anthropic · October 13, 2025
“To be clear, we are not yet at “self-improving AI”, but we are at the stage of “AI that improves bits of the next AI, with increasing autonomy and agency”.”
Jack Clark, Co-founder, Anthropic · October 13, 2025
“On the other hand, I worry that AI itself is advancing so quickly that we might not have even this much time. As I’ve written elsewhere, we could have AI systems equivalent to a “country of geniuses in a datacenter” as soon as 2026 or 2027. I am very concerned about deploying such systems without a better handle on interpretability.”
Dario Amodei, Co-founder and CEO, Anthropic · April 2025
“But by the same token, we’ve never seen any solid evidence in truly real-world scenarios of deception and power-seeking”
Dario Amodei, Co-founder and CEO, Anthropic · April 2025