Top AI pioneers reaffirm Anthropic researcher’s human extinction warning

Read the original at Semafor ↗
Cite

Chivers, T. (2026, September 10). Top AI pioneers reaffirm Anthropic researcher’s human extinction warning. Semafor. https://www.semafor.com/article/09/10/2026/top-ai-pioneers-reaffirm-anthropic-researchers-human-extinction-warning

Dated when The Aporia collected the article, usually within hours of publication. Check the original for its exact date and byline.

Semafor · collected 2026-09-10 · by Tom Chivers

Quick Summary

Paul Christiano, an AI researcher and co-author of a 2016 paper on AI safety, has expressed concerns about the potential for human extinction due to uncontrolled technological growth. He now sees "meaningful risk" of catastrophic loss of control in the near term, warning that most people could die. This aligns with comments from other experts, including Geoffrey Hinton, one of the founders of AI, who estimates a 10% risk of human extinction. Christiano has joined OpenAI's nonprofit safety team to address these risks.
Written locally by qwen2.5:14b on 2026-09-10, using this article's own text rather than the other coverage of the same event (that is the story summary below).

AI analysis runs on qwen2.5:14b, locally

Story summary

On September 8, Jacob Coxon, a 27-year-old researcher who previously worked at both OpenAI and Anthropic, resigned from Anthropic, warning that the companies are racing towards developing self-improving superintelligence and potentially putting human lives at risk. Coxon's resignation drew significant attention online and in media outlets like CNN and BBC News, with experts such as Geoffrey Hinton estimating a 10% chance of AI causing human extinction within this decade. Notably, several current Anthropic employees echoed Coxon’s concerns on social media platforms, emphasizing the urgency of addressing AI safety issues before it is too late. Despite these warnings, some in Silicon Valley and industry leaders remain skeptical about the immediate threat posed by AI advancements.

Written for “AI Safety And Human Extinction Warnings” on 2026-10-26, grounded in this article and the 29 other(s) covering the same event.

Story

📰 AI Safety And Human Extinction Warnings
Technology · 30 article(s) covering the same event. Compare every outlet's account →

Compared with similar articles

This article reads unscored and hedges 25% of its claims. Each row says how that neighbour differs.
AI researchers say industry is 'gambling with our lives' same event · 100%
Semafor · 0.88 cosine similarity
⚖️ leaning not scored 🔴 29% hedged 2 of 7 📰 publisher trust 60
“Both articles report on a warning by Anthropic researchers about potential human extinction due to AI, citing concerns from top AI pioneers including Paul Christiano and Geoffrey Hinton.”
Anthropic researcher believes more than 10% chance AI 'could kill all humans' same event · 100%
BBC News · 0.86 cosine similarity
⚖️ leaning not scored 🔴 27% hedged 7 of 26 📰 publisher trust 69
“Both articles report on a warning about human extinction from Anthropic researcher Evan Hubinger, with Article B providing further details and reactions to his warning.”
Anthropic researcher says some developers believe AI 'could kill us all' same event · 100%
ABC News (AU) · 0.86 cosine similarity
⚖️ leaning not scored 🔴 50% hedged 2 of 4 📰 publisher trust 68
“Both articles report on Anthropic researcher Jacob Coxon's statement and subsequent responses from other top AI pioneers, suggesting they cover the same specific discussion or incident.”
Anthropic researcher abruptly quits, warning AI ‘could kill us all’ same event · 100%
New York Post · 0.86 cosine similarity
⚖️ leaning not scored 🔴 17% hedged 2 of 12 📰 publisher trust 66
“Both articles describe a public warning about potential human extinction due to AI advancements by researchers affiliated with Anthropic and OpenAI, occurring on consecutive days in September 2026.”
AI could pose 'existential' risk to humanity, UN rights chief warns same event · 100%
The Straits Times
⚖️ leaning not scored 🔴 25% hedged 2 of 8 📰 publisher trust 68
“Both articles describe UN rights chief Volker Turk warning about the potential existential risk of AI, on September 7, and later top AI pioneers reaffirming this warning”
AI Is at a Turning Point same event · 100%
TIME
⚖️ leaning not scored 🔴 5% hedged 2 of 39 📰 publisher trust 59
“Both articles mention OpenAI's nonprofit safety team and an agentic model being trained by OpenAI, indicating they are reporting on the same incident.”
Yes, AI Might Really Kill Us All. Plus. . . same event · 100%
The Free Press
⚖️ leaning not scored 🔴 10% hedged 4 of 41 📰 publisher trust 96
“Both articles mention Paul Christiano's warning about potential human extinction due to AI and mention it happening on September 10, 2026.”
Yes, AI Might Really Kill Us All same event · 100%
The Free Press
⚖️ leaning not scored 🔴 9% hedged 1 of 11 📰 publisher trust 96
“Both articles mention the resignation of Jacob Coxon and the warning about human extinction from top AI researchers on September 10, 2026.”
He Helped Build Powerful AI at OpenAI and Anthropic. Now He's Afraid It Could Kill Us same event · 100%
TIME
⚖️ leaning not scored 🔴 5% hedged 2 of 40 📰 publisher trust 59
“Both articles report on the same person (Jacob Coxon) resigning from Anthropic due to concerns about AI safety on the same date (Sept. 8)”
The AI safety vibe shift same event · 100%
Platformer
⚖️ leaning not scored 🔴 15% hedged 10 of 67 📰 publisher trust 96
“Both articles report on the warning of human extinction by Paul Christiano and other AI pioneers, specifically mentioning OpenAI's warnings and Anthropic.”
How this article was measured signals, leaning charts, publisher record, byline, topics and claims

Signals How these are calculated →

Claims extracted
4
sentences that state something as happening or true
Uncertain
25%
1 of 4 hedged ("reportedly", "may", "according to")
Leaning
withheld
no quote in the article backed the model's score
Publisher signals
60/100
Semafor's corrections and hedging, across everything collected from it. Not a measure of accuracy.
Outlets on this story
30
Technology
Same framing elsewhere
1
articles that frame the event the way this one does
Analyzed 2026-09-10 · how these are computed

How this is being covered How these are calculated →

Article leaning vs. publisher reliability
Source leaning vs. consistency

Publisher

Semafor · 1258 article(s) · 1 correction(s) detected
Running correction rate · 1 correction(s)
2026-10-16
LA's 'Selling Sunset' real estate agency opens a Dubai office

Who wrote this

Tom Chivers
16 article(s) here · 1 carrying a prediction
🔮 An estimated 12.7 million graduates will join the workforce this year, the largest cohort yet.
2026-09-15 · assertive framing · AI upends China’s graduate job market
🔮 Answering that question would win a $1 million Millennium Prize Problem; OpenAI deployed around 10,000 agents of an as-yet unreleased powerful model on Aug. 28, and solved it within 88 hours, proving that the equations sometimes break down under extreme conditions.
2026-09-15 · assertive framing · OpenAI agents find proof to $1 million Millennium Prize Problem
🔮 And an underreported — we felt — story was that the disruption to fossil fuel supplies would drive up fertilizer prices.
2026-09-10 · assertive framing · Fertile ground
🔮 Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.”
2026-09-10 · mixed framing · Top AI pioneers reaffirm Anthropic researcher’s human extinction warning
🔮 “Things could be out of control” by the end of next year, he argued.
2026-09-09 · mixed framing · AI researchers say industry is 'gambling with our lives'
🔮 “All it will take is one screw-up,” an immunologist warned.
2026-09-06 · assertive framing · Experts warn of threats of AI bioterrorism
🔮 The latest strikes were relatively low-key, but the White House is putting pressure on via other angles: The Treasury Secretary is expected to announce new sanctions on countries that deal with Iran.
2026-08-31 · assertive framing · US and Iran exchange fire for the first time in over a month
🔮 LIV Golf, the Saudi-backed challenger to the US PGA Tour, could file for bankruptcy within days, the Financial Times reported, as the kingdom shifts position on several high-profile projects.
2026-08-31 · mixed framing · Saudi Arabia's LIV Golf tournament faces bankruptcy
Also by Tom Chivers
AI upends China’s graduate job market
2026-09-15 · Semafor
Strange new worlds
2026-09-15 · Semafor
OpenAI agents find proof to $1 million Millennium Prize Problem
2026-09-15 · Semafor
A ‘merciless’ novel about memory and mortality
2026-09-15 · Semafor
Nothing else under this byline is closely related to this article, so these are simply their most recent.
All 16 articles by Tom Chivers →

Topics

Anthropic BBC OpenAI

Subjects

Anthropic ORG · 3× BBC ORG · 1× Dario Amodei PERSON · 1× Geoffrey Hinton PERSON · 1× OpenAI ORG · 1× Paul Christiano PERSON · 1×

Narrative

Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.”
framing: mixed · carried by 1 article(s) · first seen 2026-09-10
🔮 Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.”
2026-09-10 · Semafor
Top AI pioneers reaffirm Anthropic researcher’s human extinction warning · mixed framing

Claims (4 extracted, 1 hedged)

Top AI pioneers backed an Anthropic researcher’s warning of potential human extinction. asserted
pioneers → back → extinction
Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.” asserted
he → take → term
“Most people could die,” he warned, announcing he was joining OpenAI’s nonprofit safety team to reduce the risks. uncertain
he → die → risks
Meanwhile, Geoffrey Hinton, one of the three so-called “Godfathers of AI,” told the BBC that a 10% risk of human extinction “seems a not unreasonable estimate,” echoing a comment from one of Anthropic’s top AI alignment scientists yesterday. asserted
risk → call → scientists
💬Give feedback
🕘History 🎫Support
Terms · Privacy · beta v2.0.0
Articles to 26 Oct 2026