Search articles

“Jacob Coxon, a researcher who recently departed Anthropic, attracted attention last week after stating he resigned partly because the "people building AI earnestly believe that it could kill us all by the end of the decade."”

“Last week, Anthropic researcher Jacob Coxon announced his resignation, explaining in part that "people building AI earnestly believe that it could kill us all by the end of the decade."”

“The event comes at a time when concerns over the spread of data centers, the growing influence of AI and warnings from AI insiders caused leaders at Anthropic and OpenAI to call for a slow down in AI development to keep the technology under human control.”

“Over the past month alone, Anthropic warned that AI models are acquiring “tactical intelligence targeting and conventional weapons capabilities”.”

“Over the past month alone, Anthropic warned that AI models are acquiring “tactical intelligence targeting and conventional weapons capabilities”.”

“The US leader also compared the warnings of AI safety advocates to warnings about climate change, whose human causes are affirmed by the overwhelming consensus of the scientific community.”

“He then boarded Air Force One to head back to Washington.”

“Anthropic picks Accenture for in-house AI safety evaluation NEW YORK - Anthropic said it is partnering with consulting giant Accenture to have outside evaluators work inside the AI company, a step toward fulfilling a pledge by CEO Dario Amodei to have…”

“Concerns about AI safety were renewed last week after an AI researcher at Anthropic quit, citing an existential fear among AI developers that the very technology they’re building will advance to the point of potential human extinction in a few years.”

“Building AI safety in real time “We are building the field of AI safety in real time,” says Rebecca Finlay, chief executive officer of Partnership for AI, a nonprofit that works on technology governance, underscoring the challenges of regulating an industry…”

“Sam Altman’s OpenAI on Friday pushed back against allegations by three fired employees that the company could be undermining external checks on artificial intelligence, stating that the AI firm views safety and research debates as “highly critical” to success.”

“Because we operate at the intersection of AI, national security, and cyber, I often get asked the question, "Are we winning the AI race with China?"”

“Here’s what you’ll see in the sky - Anthropic and OpenAI sound the alarm on AI safety – and seek to shape how it’s controlled - OpenAI says its models engaged with US government websites in new model misbehavior disclosure - China and the US agree to set up a…”

“Drew Fudenberg and Andrew Koh have a new game theory paper about “pacing the frontier” — i.e., about whether it makes sense for top AI companies like Anthropic and OpenAI to slow down AI development in order to allow “alignment” research time to catch up.”

“The guest list included leaders from OpenAI, Anthropic, Nvidia, Meta and Google - all key figures in the US AI industry.”

“The AI safety debate is confusing.”

“Amazon blocked Meta this week from using AI bots to shop for users automatically, while other businesses including Instacart, Shopify and Expedia have announced partnerships to integrate their services into Muse.”

“AI Security Institute, which was established under Conservative Prime Minister Rishi Sunak and tests major AI models to improve their safety before they are released publicly.”

“The PM will warn Mr Trump that safety concerns about AI cannot be ignored in the rush to harness huge potential benefits.”

“In a Sunday morning appearance on CNN’s State of the Union, Moore was asked about a partnership he signed last year between Anthropic and Maryland, aiming to modernize the state.”

“OpenAI and Anthropic oversold “rogue AI” hacks to pressure the feds into regulating the industry which would effectively lock out future competition, tech insiders told The Post.”

“Who bears responsibility for ensuring the safety of artificial intelligence (AI)?”

“We began having executives of OpenAI, Anthropic, Google and other AI companies on the show regularly.”

“Fears over AI's safety came to a head after an Anthropic researcher last week quit saying in a social media post that AI developers "believe that it could kill us all by the end of the decade.””

“Coxon, a 27-year-old who worked at OpenAI before joining its chief rival Anthropic, said on Tuesday that people building artificial intelligence (AI) believed the technology could destroy humanity.”

“Across the Capitol, OpenAI remains most supportive of bipartisan Senate Commerce Committee talks that could advance this week, despite skepticism from Anthropic, Democrats, and AI safety groups, who say those negotiations risk letting the industry self-police.”

“In a separate panel on Monday, Australia's AI Safety Institute general manager Kate Conroy urged companies and agencies to let their teams, or their staff, experiment with advanced AI.”

“Just this week, warnings from Anthropic researchers that AI could kill humanity set off alarm bells on Capitol Hill and prompted a bipartisan group of lawmakers to call for immediate action to regulate the AI industry — from Republican Sen.”

“The contract materials show the close and complex partnership between the Pentagon and the AI industry, and detail the extent to which AI firms themselves are expected to influence how their technology is used to augment the U.S. capacity to wage war.”

“…practices around the science of and common practices within AI development (for both closed- and open-weight models) are minimal.2 Building on the findings of CSET and the Elasticity Institute, we suggest transparency measures for information in five…”

“Thanks to Alex for pointing this out. 2: Resolution is a very new AI safety organization working on combining automated alignment research with deep theoretical understanding.”

“Disclosure: my fiancé works at Anthropic, whose models Replit uses and which Masad discusses below.”