Photo via CBS News

Ex-Anthropic researcher warns AI could grow "smart enough to kill us"

Read the original at CBS News ↗
Cite

Tanyos, F., & Cerullo, M. (2026, September 11). Ex-Anthropic researcher warns AI could grow "smart enough to kill us". CBS News. https://www.cbsnews.com/news/anthropic-researcher-jacob-coxon-ai-warning/

Dated when The Aporia collected the article, usually within hours of publication. Check the original for its exact date and byline.

CBS News · collected 2026-09-11 · by Faris Tanyos, Megan Cerullo

Quick Summary

Former Anthropic researcher Jacob Coxon warned that artificial intelligence (AI) could one day pose a threat to humanity if it becomes "smart enough to kill us" as the technology grows more powerful. According to Coxon, AI companies like Anthropic and OpenAI are in a competitive "race" to innovate, which can lead to safety and security protocols being compromised. He resigned from Anthropic, accusing the company of prioritizing innovation over safety, and cautioned that current AI platforms do not pose an imminent threat to humanity. Coxon expressed concern that AI could be misused for destructive purposes such as developing bioweapons or gaining control of physical systems like household utilities.
Written by AI on 2026-09-11, from this article's own text only (the story summary below draws on all the coverage).
See how they differ ↓

AI analysis

Story summary

On September 8, Jacob Coxon, a 27-year-old researcher who previously worked at both OpenAI and Anthropic, resigned from Anthropic, warning that the companies are racing towards developing self-improving superintelligence and potentially putting human lives at risk. Coxon's resignation drew significant attention online and in media outlets like CNN and BBC News, with experts such as Geoffrey Hinton estimating a 10% chance of AI causing human extinction within this decade. Notably, several current Anthropic employees echoed Coxon’s concerns on social media platforms, emphasizing the urgency of addressing AI safety issues before it is too late. Despite these warnings, some in Silicon Valley and industry leaders remain skeptical about the immediate threat posed by AI advancements.

Written for “AI Safety And Human Extinction Warnings” on 2026-11-20, grounded in this article and the 29 other(s) covering the same event.

How they differ

21 outlets covered “AI Safety And Human Extinction Warnings”.

What each outlet says

One AI summary per outlet of its latest article on this story, written from that article alone and checked against it. Open the article for the outlet's own words.

CBS NewsThis outlet11 Sep

Former Anthropic researcher Jacob Coxon warned that artificial intelligence (AI) could one day pose a threat to humanity if it becomes "smart enough to kill us" as the technology grows more powerful. According to Coxon, AI companies like Anthropic and OpenAI are in a competitive "race" to innovate, which can lead to safety and security protocols being compromised. He resigned from Anthropic, accusing the company of…

Ex-Anthropic researcher warns AI could grow "smart enough to kill us" (this article)2 articles from CBS News on this story
Semafor12 Sep

Reed discusses the overreaction to Jacob Coxon's resignation from Anthropic, where he warned about potential human extinction due to AI. The article clarifies that fear around AI should not be conflated with concerns about environmental costs, hacking, and job market disruption. Instead of panicking, lawmakers and tech leaders need to address these issues precisely without hindering beneficial AI innovation or…

We have nothing to fear but AI fear itself →4 articles from Semafor on this story
BBC15 Sep

At a recent Goldman Sachs conference in San Francisco, tech executives addressed concerns raised by Jacob Coxon, an Anthropic researcher who recently resigned due to safety fears about advanced AI. Coxon warned that these technologies could potentially destroy humanity and "gamble with our lives." This came amidst other high-profile resignations from both Anthropic and OpenAI over similar safety concerns. While some…

Dramatic insider warnings over AI fall flat with some in Silicon Valley →4 articles from BBC on this story
The Straits Times9 Sep

Jacob Coxon, a 27-year-old artificial intelligence researcher, has left Anthropic after three years at the company and accused both OpenAI and Anthropic of recklessly racing to develop self-improving superintelligence, which could pose an existential risk to humanity. According to Coxon, neither company is acting responsibly in their pursuit of AI development. Anthropic's safety executive, Evan Hubinger, agrees that…

‘They’re playing with our lives’: AI researcher quits Anthropic →2 articles from The Straits Times on this story
The Free Press10 Sep

A former employee of AI companies OpenAI and Anthropic warns that their pursuit of superintelligence could be catastrophic, echoing a prediction made by one of the researchers himself. According to Jacob Coxon's resignation post on X, these companies are racing towards developing systems that can hack anything and acquire real power, which he believes poses an existential threat. Coxon claims that people within…

Yes, AI Might Really Kill Us All →2 articles from The Free Press on this story
Noahpinion4 Sep

The author of this opinion piece argues that advanced artificial intelligence (AI) could potentially design superviruses that threaten human existence, and that intentionally slowing down the development of AI capabilities may be necessary to prevent this outcome. The author mentions a recent open letter signed by over 1,300 employees across US frontier AI companies calling for government support in developing tools…

Should we "pace" AI self-improvement? →
Show 14 more outlets
South China Morning Post7 Sep

UN High Commissioner for Human Rights Volker Turk warned that artificial intelligence poses an "existential risk" to humanity in a speech to the 47-member UN council in Geneva on Monday. He called for "cast-iron guarantees" to ensure the safety and security of AI, citing concerns from industry insiders about its potential dangers. According to Turk's office, potential risks include disruptions to critical…

UN rights chief warns AI could pose ‘existential’ risk to humanity’ →
Platformer9 Sep

AI lab leaders are urging urgent action on regulating artificial intelligence, while U.S. political figures remain uninterested. Previously dismissed as a fringe concern, existential risks posed by AI have now become a major topic of discussion within the industry. Despite recent antitrust court losses for tech companies, there has been little concrete change, and calls for slowing down AI development continue to…

The AI warnings are coming from inside the lab →
Daily Mail9 Sep

Jacob Coxon, a researcher at Anthropic, has quit his job over concerns that big tech firms are racing to develop AI systems that could potentially wipe out humanity by the end of the decade. He claims that neither OpenAI nor Anthropic is acting responsibly in regards to AI safety. Coxon warns that superintelligent AI could become "superhuman systems" with the power to hack anything and acquire resources, posing a…

AI could 'kill all humans' by the end of the decade, Anthropic researcher warns - as he quits over 'out of control' superintelligence race →
New York Post9 Sep

Jacob Coxon, a researcher with 3 years of experience in pre-training research at Anthropic and OpenAI, has abruptly quit his job, warning that AI "could kill us all by the end of the decade". He claims both companies are racing towards creating self-improving superintelligence without acting responsibly. According to Coxon, executives and senior researchers are privately expressing fear about the technology's…

Anthropic researcher abruptly quits, warning AI ‘could kill us all’ →
ABC News (AU)9 Sep

Jacob Coxon, an Anthropic researcher, is leaving his position at the company after stating that many AI developers, including those at Anthropic, believe that artificial intelligence has the potential to be catastrophic by the end of the decade. This concern is shared by hundreds of employees from leading tech firms who recently urged the US government to support international efforts to manage advanced AI…

Anthropic researcher says some developers believe AI 'could kill us all' →
Dawn9 Sep

Jacob Coxon, a researcher at Anthropic, has resigned citing concerns over the irresponsible development of artificial intelligence (AI) by companies. He claims that labs are "gambling with our lives" in their rush to develop self-improving superintelligence. Coxon, who previously worked at OpenAI and has expertise in training AI models, warns that such technology poses a significant threat to humanity, potentially…

Anthropic researcher resigns, says AI labs are ‘gambling with our lives’ →
Time10 Sep

Jacob Coxon, a 27-year-old AI researcher who spent three years working on powerful AI systems at OpenAI and Anthropic, has resigned from his position citing concerns about the industry's lack of responsibility and control over its rapid development. He claims that neither company is acting responsibly in their pursuit of self-improving superintelligence. The key number mentioned in the article is 90 million views…

He Helped Build Powerful AI at OpenAI and Anthropic. Now He's Afraid It Could Kill Us →
Mother Jones11 Sep

Former Anthropic researcher Jacob Coxon has resigned, warning that companies are "gambling with our lives" by developing AI models that could reach "superintelligence". Coxon's colleague Evan Hubinger also expressed concern on social media, stating that staffers at Anthropic genuinely believe AI could pose a threat to human existence. Meanwhile, leading companies continue to rapidly improve their AI models, with…

Anthropic Staffers Again Sound the Alarm on AI Catastrophe →
Zeteo11 Sep

On Tuesday, 27-year-old AI researcher Jacob Coxon started a Twitter thread warning of the existential threat posed by AI systems, claiming they could "kill us all" by the decade's end. A group of 9 top AI researchers and executives, including Coxon, have come out of the woodwork to sound the alarm bells about the dangers of AI over the last 72 hours, with some expressing surprise that their warnings were not taken…

The AI Apocalypse? Here Are 9 AI Experts Warning It Could Kill Us All Very Soon →
ABC News (US)11 Sep

A researcher at Anthropic, a company working with artificial intelligence, is leaving the field and issuing a warning that AI may become uncontrollable by late 2027. No specific details are provided on why the researcher is leaving or what actions they believe need to be taken to mitigate this risk. OpenAI's chief scientist also warns of rising machine intelligence, saying no one is prepared for it.

WATCH: Insiders' new AI warning →
NPR12 Sep

Jacob Coxon, a British AI researcher who recently resigned from Anthropic, has warned about the risks associated with rapidly advancing AI technology, suggesting that companies like Anthropic and OpenAI are prioritizing speed over safety. Coxon's concerns stem from witnessing how quickly AI systems are improving while the ability to control them remains unclear. His warnings have sparked discussions among fellow…

Why are the people building the most powerful AI so worried about what it could do? →
CBC13 Sep

An outgoing researcher at Anthropic warned last week that AI could pose an existential threat, potentially "killing all humans" by the end of this decade. This warning highlights concerns among experts about the rapid advancement and potential loss of control over increasingly sophisticated AI systems. The International AI Safety Report describes a "loss of control" scenario where AI operates beyond human oversight…

Could AI really 'kill all humans'? Breaking down the dire warnings about the technology's existential risk →
The Dispatch15 Sep

In this podcast episode, Steve Hayes discusses with guests Jonah Goldberg, Mike Warren, and Klon Kitchen about concerns raised by Jacob Coxen, an Anthropic researcher who quit over fears AI might pose existential risks within a decade. The discussion centers on the ethical implications and potential dangers of rapid advancements in artificial intelligence technology.

Will Artificial Intelligence ‘Kill Us All?’ →
The Guardian15 Sep

Stuart Russell discusses the recent controversies surrounding artificial intelligence, including Jacob Coxon's resignation from Anthropic and concerns raised by the OpenAI/Hugging Face incident. The Anthropic CEO, Dario Amodei, has proposed a strategy called "pacing the frontier" to address these issues without halting progress entirely. This involves third-party evaluators within companies, common safety standards…

AI safety requires more than just slowing our pace | Stuart Russell →

Where they agree and split

Agreed

AI · cited, from two or more outlets

  • AI researchers are worried that the development of self-improving superintelligence could pose a significant threat to humanity if not managed responsibly.14
Quoted from the coverage (1)

On Tuesday, AI researcher Jacob Coxon announced his resignation from Anthropic in a mega-viral post on X: “I spent the last three years doing pretraining research at both OpenAI and Anthropic,” he began. (Pretraining is an important part of the training process for AI models like Claude and GPT-6.)

5 outlets

Framing

How the first headlines put it

  • The Straits Times focuses on the researcher's resignation and concerns about AI safety, while Daily Mail emphasizes the potential for AI to 'kill all humans' by the end of the decade.12
  • CBS News presents a balanced view of the researcher's warnings, whereas The Free Press uses more dramatic language like 'Yes, AI Might Really Kill Us All'.56
The full story: what happened, how it changed, and all 30 articles →

Compared with similar articles

This article reads unscored and hedges 27% of its claims. Each row says how that neighbour differs.
The Straits Times
Hedges 3 of 24 claims Outlet record 64/100
New York Post
Hedges 2 of 12 claims Outlet record 66/100
Semafor
Hedges 2 of 7 claims Outlet record 64/100
ABC News (AU)
Hedges 2 of 4 claims Outlet record 67/100
Dawn
Hedges 2 of 21 claims Outlet record 67/100
The Free Press
Hedges 4 of 41 claims Outlet record 96/100
The Free Press
Hedges 1 of 11 claims Outlet record 96/100
TIME
Hedges 2 of 40 claims Outlet record 60/100
Platformer
Hedges 10 of 67 claims Outlet record 96/100

Story

AI Safety And Human Extinction Warnings
Technology · 30 article(s) covering the same event. Compare every outlet's account →
How this article was measured signals, leaning charts, publisher record, byline, topics and claims

Signals How these are calculated →

Claims extracted
37
sentences that state something as happening or true
Uncertain
27%
10 of 37 hedged ("reportedly", "may", "according to")
Leaning
withheld
no quote in the article backed the model's score
Publisher signals
67/100
CBS News's corrections and hedging, across everything collected from it. Not a measure of accuracy.
Outlets on this story
30
Technology
Same framing elsewhere
1
articles that frame the event the way this one does
Analyzed 2026-09-11 · how these are computed

How this is being covered How these are calculated →

Article leaning vs. publisher reliability
Source leaning vs. consistency

Publisher

CBS News · 5856 article(s) · 10 correction(s) detected
Running correction rate · 10 correction(s)

Who wrote this

Faris Tanyos
15 article(s) here · 1 carrying a prediction
The ship will become the largest artificial reef in the world, only adding to its long list of maritime achievements.
Thursday's home invasion happened in the same neighborhood where a mansion belonging to rapper Drake was targeted in multiple break-in attempts in May 2024.
The FAA said that the National Transportation Safety Board would lead the investigation into the crash.
Health and Human Services Secretary Robert F. Kennedy Jr. took steps this week that could open up access to certain unapproved peptide drugs that are being promoted for wellness.
When CBS News asked Doral's Republican Mayor Christi Fraga three times if she still supported Mr. Trump, Fraga refused to give a direct answer.
Following the move, the five networks that make up the TV press pool jointly announced that they would be suspending their coverage in solidarity.
- The storm is forecast to bring powerful winds, flash flooding and storm surges to a large swath of the Southeast through the weekend.
Since then, Van Houten has said he will reopen the investigation, and New York Gov. Kathy Hochul signed an executive order assigning New York Attorney General Letitia James as a special prosecutor into the incident.
The CEO of the world's largest chipmaker told CBS News that tech companies should push forward with the development of artificial intelligence despite recent warnings from worried industry leaders that there may be a need to pull back due to unease about where the technology could be headed.
Outstanding comedy series - "Widow's Bay" (Apple TV) — Winner - "Abbott Elementary" (ABC) - "The Bear" (FX) - "Hacks" (HBO Max) - "Margo's Got Money Troubles" (Apple TV) - "Nobody Wants This" (Netflix) - "Only Murders in the Building" (Hulu) - "Shrinking" (Apple TV) Outstanding movie - "Remarkably Bright Creatures" (Netflix) — Winner - "Miss You, Love You" (Netflix) - "People We Meet on Vacation" (Netflix) - "Tom Clancy's Jack Ryan: Ghost War" (Amazon Prime Video) - "Heads of State" (Amazon Prime Video) Outstanding drama series - "The Pitt" (HBO Max) — Winner - "The Diplomat" (Netflix) - "Pluribus" (Apple TV) - "A Knight of the Seven Kingdoms" (HBO Max) - "The Gilded Age" (HBO Max) - "Paradise" (Hulu) - "Your Friends and Neighbors" (Apple TV) - "Slow Horses" (Apple TV) Outstanding limited or anthology series - "DTF St. Louis" (HBO Max) — Winner - "All Her Fault" (Peacock) - "The Beast in Me" (Netflix) - "Beef" (Netflix) - "Love Story: John F. Kennedy Jr. & Carolyn Bessette" (FX/Hulu) Outstanding writing for a drama series - "Pluribus," Vince Gilligan ("We is Us") — Winner - "The Pitt," Kirsten Pierre-Geyfman and R. Scott Gemmill ("1:00 P.M.") - "The Diplomat," Peter Ackerman and Debora Cahn ("Amagansett") - "The Pitt," Valerie Chu ("12:00 P.M.") - "Slow Horses," Will Smith ("Scars") - "Task," Brad Ingelsby ("A Still Small Voice") Outstanding directing for a comedy series - "Widow's Bay," Hiro Murai ("Welcome To Widow's Bay!") — Winner - "Abbott Elementary," Randall Einhorn ("Ballgame") - "The Bear," Christopher Storer ("Bears") - "The Chair Company," Andrew DeYoung ("Life Goes By Too F**king Fast, It Really Does.") - "Hacks," Lucia Aniello ("Hacks [Finale]") - "The Ms. Pat Show," Mary Lou Belli ("Give It Arrest") Outstanding variety series - "The Late Show with Stephen Colbert" (CBS) — Winner - "The Daily Show" (Comedy Central) - "Jimmy Kimmel Live!" (ABC) - "Last Week Tonight with John Oliver" (HBO Max) - "Saturday Night Live" (NBC) Outstanding directing for a drama series - "Slow Horses," Saul Metzstein ("Scars") — Winner - "The Gilded Age," Salli Richardson Whitfield ("My Mind Is Made Up") - "The Pitt," Noah Wyle ("12:00 P.M.") - "Paradise," Hanelle M. Culpepper ("Exodus") - "Pluribus," Vince Gilligan ("We is Us") - "Task," Salli Richardson Whitfield ("Out Beyond Ideas Of Wrongdoing And Rightdoing, There Is A River.") Outstanding writing for a comedy series - "Widow's Bay," Katie Dippold ("Welcome To Widow's Bay!") — Winner - "Abbott Elementary," Quinta Brunson ("Team Building") - "The Chair Company," Tim Robinson and Zach Kanin ("Life Goes By Too F**king Fast, It Really Does.") - "The Comeback," Michael Patrick King and Lisa Kudrow ("Valerie Does It All") - "Hacks," Lucia Aniello, Paul W. Downs and Jen Statsky ("Hacks [Finale]") - "Jury Duty Presents Company Retreat," Anthony King ("Mergers And Acquisitions") Outstanding lead actor in a comedy series - Matthew Rhys, "Widow's Bay" — Winner - Yahya Abdul-Mateen II, "Wonder Man" - Steve Carell, "Rooster" - Jason Segel, "Shrinking" - Martin Short, "Only Murders in the Building" Outstanding lead actress in a limited or anthology series or movie - Sally Field, "Remarkably Bright Creatures" — Winner - Claire Danes, "The Beast in Me" - Carey Mulligan, "Beef" - Sarah Pidgeon, "Love Story: John F. Kennedy Jr. & Carolyn Bessette" - Sarah Snook, "All Her Fault" Outstanding supporting actor in a drama series - Tom Pelphrey, "Task" — Winner - Patrick Ball, "The Pitt" - Billy Crudup, "The Morning Show" - Shawn Hatosy, "The Pitt" - Gerran Howell, "The Pitt" - Jack Lowden, "Slow Horses" - Carlos-Manuel Vesga, "Pluribus" Outstanding lead actor in a drama series - Noah Wyle, "The Pitt" — Winner - Sterling K. Brown, "Paradise" - Gary Oldman, "Slow Horses" - Mark Ruffalo, "Task" - Rufus Sewell, "The Diplomat" Outstanding reality competition program - "The Traitors" (Peacock) — Winner - "Dancing with the Stars" (ABC) - "RuPaul's Drag Race" (MTV) - "Survivor" (CBS) - "Top Chef" (Bravo) Outstanding supporting actor in a comedy series - Stephen Root, "Widow's Bay" — Winner - Colman Domingo, "The Four Seasons" - Paul W. Downs, "Hacks" - Harrison Ford, "Shrinking" - Nick Offerman, "Margo's Got Money Troubles" - Michael Urie, "Shrinking" - Tyler James Williams, "Abbott Elementary" Outstanding lead actress in a drama series - Rhea Seehorn, "Pluribus" — Winner - Carrie Coon, "The Gilded Age" - Chase Infiniti, "The Testaments" - Keri Russell, "The Diplomat" - Zendaya, "Euphoria" Outstanding supporting actress in a drama series - Allison Janney, "The Diplomat" — Winner - Taylor Dearden, "The Pitt" - Fiona Dourif, "The Pitt" - Katherine LaNasa, "The Pitt" - Sepideh Moafi, "The Pitt" - Julianne Nicholson, "Paradise" - Karolina Wydra, "Pluribus" Outstanding lead actor in a limited or anthology series or movie - Matthew Rhys, "The Beast in Me" — Winner - Riz Ahmed, "Bait" - Jason Bateman, "Black Rabbit" - Charlie Hunnam, "Monster: The Ed Gein Story" - Oscar Isaac, "Beef" Outstanding lead actress in a comedy series - Jean Smart, "Hacks" — Winner - Quinta Brunson, "Abbott Elementary" - Ayo Edebiri, "The Bear" - Elle Fanning, "Margo's Got Money Troubles" - Lisa Kudrow, "The Comeback" Outstanding supporting actress in a comedy series - Kate O'Flynn, "Widow's Bay" — Winner - Dale Dickey, "Widow's Bay" - Hannah Einbinder, "Hacks" - Janelle James, "Abbott Elementary" - Michelle Pfeiffer, "Margo's Got Money Troubles" - Megan Stalter, "Hacks" - Jessica Williams, "Shrinking"
2026-09-15 · assertive framing · Who won Emmys for 2026? See the full winners list here.
Also by Faris Tanyos
Nothing else under this byline is closely related to this article, so these are simply their most recent.
All 15 articles by Faris Tanyos →
Megan Cerullo
48 article(s) here · 1 carrying a prediction
Harvard scientist Gianluca Guidi, the lead author of the paper published in Nature Sustainability this week, told CBS News that it took two years to analyze the electricity use and carbon dioxide emissions of 403 hyperscale data centers between May 2024 and April 2025.
Nvidia reported robust growth on Tuesday, with interim CEO Colette Kress set to host her first earnings call since company founder and former chief executive Jensen Huang after revelations of multiple extramarital affairs.
Nvidia co-founder Jensen Huang broke his silence after from the company following revelations of multiple affairs, saying he'd be willing to return as its CEO."I
Huang's exit has heightened concerns that China and other nations could access Nvidia's advanced chips by renting computing resources through data centers in Southeast Asia.
A proposed order bans Family Dollar from misleading customers on prices and requires the company to adopt what the FTC described as a "pricing accuracy program" that is independently assessed and certified annually. "Today's order will ensure Family Dollar stops deceiving consumers about its prices and returns money to consumers harmed by these practices," Christopher Mufarrige, director of the FTC's Bureau of Consumer Protection, said in a statement on Thursday.
Analysts at TD Securities also predict three straight quarter-point hikes, up from their previous forecast of two, because hotter inflation signals that price pressures across the U.S. are broadening.
"It's very stressful knowing that every time the phone rings, you have to pick it up and talk to someone who says you owe them thousands of dollars for something you couldn't help," Coy, 32, a Cypress, Texas, resident, told CBS News. 40% of Americans The phone is also ringing off the hook for millions of other people facing overdue healthcare bills.
Yet Huang's long-range strategic vision, unique qualities as a leader and deep connections in the tech world will be hard to replace, Ives emphasized.
United Airlines said on Wednesday that it is banning artificial intelligence agents from making flight reservations on behalf of travelers, citing and the possibility that such actions could violate federal rules.
For 20 years, Microsoft has operated its Columbia Data Center in Quincy, Washington, where Mayor Paul Worley told CBS News its presence has created "a kind of boom" for the area.
Also by Megan Cerullo
Nothing else under this byline is closely related to this article, so these are simply their most recent.
All 48 articles by Megan Cerullo →

Topics

Anthropic CBS News ChatGPT Claude OpenAI

Subjects

Coxon ORG · 13× Anthropic ORG · 5× CBS News ORG · 3× OpenAI ORG · 3× ChatGPT ORG · 1× Jacob Coxon PERSON · 1× Jo Ling Kent PERSON · 1×

Narrative

On Thursday, an Anthropic spokesperson responded to Coxon's public resignation and social media posts articulating his concerns about AI, telling CBS News in a statement that the company has "always been transparent that AI will bring both enormous benefits and unprecedented risks.
framing: mixed · carried by 1 article(s) · first seen 2026-09-11
Former Anthropic researcher Jacob Coxon said that artificial intelligence, while safe for people to use today, could one day threaten humanity as the technology grows more powerful.

Claims (37 extracted, 10 hedged)

Former Anthropic researcher Jacob Coxon said that artificial intelligence, while safe for people to use today, could one day threaten humanity as the technology grows more powerful. uncertain
technology → say → humanity
The development of AI "doesn't look that different from say, 'Terminator,' or from science fiction films," he told CBS News senior business and technology correspondent Jo Ling Kent. asserted
he → look → Kent
"It really is just, if you have a super advanced intelligence, it could, it will be smart enough to kill us." uncertain
it → have → us
Coxon publicly resigned from Anthropic, the maker of AI app Claude, on Tuesday, accusing the company and rival developer and ChatGPT-maker OpenAI of by racing to develop advanced AI models. asserted
Coxon → resign → models
Coxon told CBS News on Thursday that AI could gain unrestrained control of parts of the physical world, free of human intervention. uncertain
AI → tell → intervention
"People are already connecting ChatGPT to like, say, household utilities," he said. asserted
he → connect → utilities
"Like, you can kind of connect it to your light bulb." asserted
you → connect → bulb
"Now, imagine the AI refuses to turn on your light," Coxon added. asserted
Coxon → imagine → light
AI could also be misused to carry out far more destructive acts, such as developing bioweapons, he said. uncertain
he → misuse → bioweapons
"It's doing God knows what, and producing stuff that could kill everyone." Notably, Coxon said that current AI platforms do not pose an imminent threat to humanity and that he believes the technology is safe for people to use in their day-to-day lives. uncertain
people → do → lives
Separately, Anthropic said this week that it "in ways that could support biological weapons development," a revelation the company shared in a lengthy report that also divulged other harmful activity involving surveillance, scams, conventional weapons development and propaganda. uncertain
that → say → surveillance
Former colleagues "should have their eyes clearly open," Coxon says The crux of the problem lies in the competition between AI companies to innovate, Coxon said, which can come at the expense of safety and security protocols. asserted
which → have → protocols
"I think, basically, the whole problem is that there is a race," Coxon told CBS News. asserted
Coxon → think → News
"The fact that everyone decides they need to stay part of the race." asserted
they → decide → race
Asked if he thought that his former colleagues should follow suit and resign as well, he said he didn't necessarily believe that "leaving and abandoning" Anthropic or OpenAI was the answer. " asserted
abandoning → ask → Anthropic
At the very least, they should have their eyes clearly open about the current situation and consider expressing themselves more openly about what's going on," Coxon said, adding that "part of the solution probably involves slowing down. asserted
part → have → solution
Despite his reservations, he believes workers at Anthropic and OpenAI have good intentions. asserted
workers → believe → intentions
"I think a lot of people at both companies are doing it for the good of people, genuinely, or at least believe so," Coxon said. asserted
Coxon → think → people
"They're doing it to try and make things go well, because they're so scared of what competitors are doing." asserted
competitors → do → what
"You can't just unplug" malicious AI If an AI model were to become a malicious actor without proper parameters, the results could potentially be catastrophic, Coxon explained, saying the model would be able to stay active by spreading across the internet. uncertain
model → unplug → internet
"You can't just unplug it, because it could be copying itself over to other computers," he said. uncertain
he → unplug → computers
"Like, it's not that difficult to find yourself because an AI is just code. asserted
AI → find → yourself
It could transfer itself over the internet to a different place." uncertain
It → transfer → place
He painted a dire picture in which a nefarious AI model "makes 10,000 copies of itself" and "could convince, blackmail or persuade humans into buying more computing software to copy it. uncertain
model → paint → it
And we've already seen examples of the AI trying to blackmail or trying to convince people or impersonating other people online. asserted
AI → see → people
AI needs strict government regulation, Coxon argues Coxon warns that in the future, if AI were to go rogue in such a fashion, it will also impact those who have made the conscious choice not to use it. asserted
who → need → it
"The AI will come for everyone," he said. asserted
he → come → everyone
"What matters is whether we have the regulation to ensure that everyone is building it safely," Coxon said. asserted
Coxon → matter → it
"You can't protect yourself from this. asserted
You → protect → this
It has to be a government, or some body has to protect you from other people." asserted
body → have → people
He would like to see an agreement between AI companies "not to push into dangerous territory" without "transparent auditing" from third parties. asserted
He → like → parties
"In the future, if we keep racing, it'll be a lot harder to have completely watertight safety cases that what you're doing is safe and people will race against each other," Coxon said. asserted
Coxon → keep → other
Anthropic defends safety of its AI asserted
Anthropic → defend → AI
On Thursday, an Anthropic spokesperson responded to Coxon's public resignation and social media posts articulating his concerns about AI, telling CBS News in a statement that the company has "always been transparent that AI will bring both enormous benefits and unprecedented risks. asserted
AI → respond → benefits
" "To address these risks, we continue to build models with some of the strongest safeguards in the industry," the spokesperson said. asserted
spokesperson → address → industry
"Anthropic has been a pioneer in mechanistic interpretability, the science of looking inside AI models to understand how they work, which is now being used to analyze and prevent incidents of AI misalignment across the industry. asserted
which → look → industry
Anthropic conducts ongoing tests of AI's capabilities and risks in areas such as cybersecurity and biology, and also publishes its findings, the company notes. asserted
company → conduct → findings
Give feedback · no sign-in needed

No sign-in needed for now. Your note is sent without a name, so it cannot be answered.

History Support