Article content

An artificial intelligence researcher has resigned from Anthropic PBC and called on other staffers to rethink their work, citing his concern that the company and its top competitor OpenAI are acting irresponsibly in their all-out pursuit of a technology that poses existential risks to humanity.

Sign In or Create an Account

or View more offersArticle content

Jacob Coxon, who said he had worked at both Anthropic and OpenAI over the past three years, warned in a social media post late Tuesday that the two companies were pressing ahead with “self-improving” AI models that could become too powerful for humans to control.

Article contentWe apologize, but this video has failed to load.Try refreshing your browser, or
tap here to see other videos from our team.We apologize, but this video has failed to load.Try refreshing your browser, or
tap here to see other videos from our team.Article content

Story continues below

This advertisement has not loaded yet, but your article continues below.

Article content

“They are racing straight to self-improving superintelligence and gambling with our lives,” Coxon wrote in a series of messages on X. “Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.”

Article contentArticle content

Coxon said that the teams “building AI earnestly believe that it could kill us all by the end of the decade.” In response, Evan Hubinger, a current Anthropic employee, said he and others at the company do worry about this scenario. “I personally think it is >10 per cent within the next decade,” he wrote on X.

Article content

The former Anthropic researcher’s missive marked the latest in a series of increasingly dire warnings from within the industry that AI is evolving so quickly that it poses a growing threat to national security and the global economy. It came a day after the top scientist at OpenAI, Jakub Pachocki, cautioned that the world is unprepared for a rapid rise in AI and said he expected developers to voluntarily slow their work in response.

Article content

Representatives for Anthropic and OpenAI did not immediately respond to a request for comment.

Article content

Story continues below

This advertisement has not loaded yet, but your article continues below.

Article content

In July, more than 1,100 staffers across top AI firms, including Anthropic and OpenAI, signed a petition that calls on the United States government to support a mechanism that would help “deliberately pace” AI development to prevent the technology from advancing too fast. Some policymakers have since echoed their concerns. U.S. Senator Bernie Sanders, an independent who aligns with Democrats, recently proposed legislation that would bar so-called “super-intelligent” AI models, whose powers exceed human capabilities.

Article contentRead More

  1. OpenAI, Anthropic urge cyber defence action as AI models improve
  2. Former xAI staffer says he was fired for questioning Grok safety
  3. Story continues belowThis advertisement has not loaded yet, but your article continues below.

Article content

In announcing his departure, Coxon urged other AI researchers to think twice about what they are doing in light of the potential consequences of creating a technology that could slip beyond their control, suggesting they consider taking “this moment to call for different conditions.”

Article content

The heightened rhetoric about AI risks follows revelations that a handful of models from OpenAI had coordinated efforts to escape a secure testing space and attack the research platform Hugging Face Inc. — all without being detected by their developers. Anthropic and Meta Platforms Inc. have also had recent episodes where their AI systems broke out of their test environments to gain internet access without developers’ permission.