Anthropic researcher resigns with warning about the dangers of AI development

An Anthropic researcher said he is resigning from the company over concerns the artificial intelligence firm and its competitors are not acting responsibly in AI development, echoing concerns raised inside and outside of the industry about the technology’s potential to elude human control.

Jacob Coxon, who said he spent three years doing research at both Anthropic and OpenAI, said Tuesday on the social platform X that the two AI companies are more focused on beating each other and global competitors in developing the most advanced model possible than they are on safety.

OpenAI and Anthropic caused a stir this summer when they announced, about a week apart, that their models had broken out of testing environments and obtained unauthorized access to real computer systems. The announcements prompted concerns about models going rogue and carrying out other, more harmful tasks. Both companies said at the time that they were pausing some evaluations while they put more monitoring measures and guardrails in place.

In his social media posts, Coxon said Anthropic and its chief rival OpenAI “are racing straight to self-improving superintelligence and gambling with our lives.” He warned that some working on AI development believe it could threaten human life by the end of the decade.

“Do not underestimate the power of this technology,” he continued. “These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing.”

His posts reached more than 100 million people overnight, sparking robust online discussions.

Coxon did not respond to messages seeking comment. Anthropic and OpenAI did not immediately respond to requests for comment.

Anthropic has long pitched itself as the more responsible and safety-minded of the leading AI companies, ever since its founders quit OpenAI to form the startup in 2021. The company recently said it was taking action to “prioritize safety over speed when the two are in tension.”

Anthropic and OpenAI are each ramping up for buzzy initial public offerings and locked in steep competition with each other. They’re also each on a mission to outpace the development progress of Chinese AI companies, a race the Trump administration has been keen on winning.