Jacob Coxon, a 27-year-old artificial intelligence researcher, has left Anthropic after three years at the company and accused both OpenAI and Anthropic of recklessly racing to develop self-improving superintelligence, which could pose an existential risk to humanity. According to Coxon, neither company is acting responsibly in their pursuit of AI development. Anthropic's safety executive, Evan Hubinger, agrees that there is a more than 10% chance that an AI system surpassing human capabilities could be catastrophic, and the company currently lacks a plan to ensure such a system would obey its creators. Coxon's resignation comes as Anthropic prepares for its market debut amidst growing concerns about the risks of AI development.
Written by the local model on 2026-09-09,
using this article's own text rather than the other coverage of the
same event (that is the story summary below).
Story summary
Jacob Coxon, a researcher at Anthropic, has quit his job to raise concerns that AI development is out of control and could lead to catastrophic consequences. In a series of posts on social media, he warned that AI could "kill all humans" by the end of the decade, citing the fact that many executives and researchers in the field privately express fear about the dangers of AI, but publicly downplay its risks. Coxon worked at both Anthropic and OpenAI, and believes that neither company is acting responsibly in their pursuit of developing self-improving superintelligence. He estimates that the risk of AI posing an existential threat to humanity is over 10%, and warns that the technology could lead to superhuman systems that can hack anything, revolutionize fields overnight, and acquire real power and resources. Coxon's resignation has sparked debate about the need for global coordination on regulating AI development and slowing down its progress if necessary.
Written for “AI Threat to Human Existence” on 2026-09-09,
grounded in this article and the 10 other(s) covering the same event.
Why this leaning score
The model judged this article politically coded and scored it -0.65, but none of the 3 quote(s) it offered could be found in the article text, so the score is not published.
Written under an earlier scoring contract, which gave a paragraph
rather than checkable quotes. Re-analysing this article replaces it.
Leaning score withheld for article 7209: no verified evidence · logged 2026-09-09
‘They’re playing with our lives’: AI researcher quits Anthropic
AI generated
asserted
researcher → play → AI
SAN FRANCISCO – An artificial intelligence researcher who left OpenAI to join Anthropic has decided to leave the industry, accusing both US companies of “playing with our lives” in the race to develop AI models capable of self-improvement.
asserted
who → leave → improvement
Jacob Coxon, 27, spent the past three years pretraining AI models, first at OpenAI and then, in 2026, at its rival Anthropic, which he considered more cautious in its approach.
asserted
he → spend → approach
Pretraining is the stage where AI models absorb vast quantities of data.
asserted
models → absorb → data
“Neither company is acting responsibly.
asserted
company → act → ?
They are racing straight to self-improving superintelligence and gambling with our lives,” Coxon said on Sept 8.
asserted
Coxon → race → Sept
“The people building AI earnestly believe that it could kill us all by the end of the decade,” he said in a post on X.
“This is not a marketing stunt,” he added.
uncertain
he → build → X.
Superintelligence is the theoretical point when AI’s capabilities exceed human intelligence.
asserted
capabilities → exceed → intelligence
Anthropic safety executive Evan Hubinger backed up Coxon on X.
“We really do earnestly believe AI could kill all humans!” he said, adding that he estimated that risk at more than 10 per cent over the next decade.
uncertain
he → back → decade
Hubinger said Anthropic is “trying its best”, but does not yet have a plan to ensure an AI system that surpasses human capabilities would obey its creators.
asserted
that → say → creators
He said there was a “low” risk of that happening with current models.
asserted
that → say → models
Coxon’s resignation comes as Anthropic prepares for its market debut, following a summer marked by unauthorised hacks carried out by AI tools during testing.
asserted
Anthropic → come → testing
AI leaders say so-called recursive self-improvement, a stage where AI systems could essentially design and train the next generation of AI with little human involvement, is drawing near.
uncertain
systems → say → involvement
Coxon considers Anthropic’s efforts genuine but said he believes no company can responsibly develop an AI that surpasses humans without government intervention or a coordinated slowdown.
asserted
that → consider → intervention
“At Anthropic, the stakes are well-understood, but they are locked in a race to get there first.
asserted
they → understand → race
They believe no one else will act responsibly, so they must do it themselves, despite the risk,” he said.
asserted
he → believe → risk
In February, Anthropic removed a pledge from its safety charter to halt the development of its models if it fails to control their risks.
asserted
it → remove → risks
It argued that if it unilaterally pauses its work, its less cautious rivals will dominate the industry, making it less safe overall.
asserted
it → argue → industry
At the end of July, more than 1,000 tech industry employees, including Anthropic’s CEO Dario Amodei, called on Washington to support a coordinated slowdown in the development of the most advanced AI systems.
asserted
employees → include → systems
OpenAI halted training of its latest models for two weeks in August before resuming it under tighter controls.
asserted
OpenAI → halt → controls
On Sept 13, OpenAI’s chief scientist, Jakub Pachocki, called for “extreme caution.”
asserted
scientist → call → caution
“International coordination on future AI development needs to become a top priority for governments around the world,” he said in a blog post.
asserted
he → need → post
AI models are not regulated by federal law in the United States.
asserted
models → regulate → States
In September, Senator Bernie Sanders and Representative Greg Casar introduced a Bill seeking to suspend AI development until a federal regulator is created.
asserted
regulator → introduce → development
