The Aporia
The Aporia
138 articles about 86 events for “AI Safety And Security Concerns” in Technology.
“The executives called for a slowdown in AI development, citing concerns that increasingly capable systems could improve on their own and eventually slip beyond human control.”
“AI bosses, including the leaders of OpenAI and Anthropic, are calling for a slowdown in the technology's development over safety concerns.”
“OpenAI's announcement comes as US AI executives, including the heads of OpenAI and Anthropic, call for a slowdown in the development of the technology amid concerns over its safety.”
“Steve Hayes is joined by Jonah Goldberg, Mike Warren, and Klon Kitchen to discuss the resignation of an Anthropic researcher over concerns that AI may “kill us all,” yet another flip-flop by the Trump administration on Ukraine, and President Trump’s $5,000…”
“Difficulty of shutting down AI systems AI is also becoming so integrated into our everyday lives that shutting down a rogue system could be difficult to do before it's too late, according to Hamza Chaudry, AI and national security lead at the Future of Life…”
“Researchers who spoke to NPR say the leading AI companies are too focused on racing to develop more capable and autonomous AI systems while safety is falling behind.”
“AI safety fears Concerns about AI safety have escalated in recent months after models developed by OpenAI and rival lab Anthropic were involved in security incidents during testing.”
“OpenAI delays latest model over security concerns, as industry faces pressure OpenAI said Monday it was delaying the release of a new artificial intelligence model out of security concerns voiced by its researchers, the latest in the company's effort to…”
“… have additional safeguards.' Saachi Jain, OpenAI’s head of safety systems, said the company has a high bar in terms of safety and alignment OpenAI says it is delaying the release of a new artificial intelligence model out of security concerns voiced by its…”
“Not since the invention of the nuclear bomb more than 80 years ago has humanity grappled so seriously with its own demise, according to some AI safety advocates and researchers.”
“AI: 10 days that changed the course of artificial intelligence Not since the invention of the nuclear bomb has humanity grappled so seriously with its own demise, say safety advocates For years, the race to build ever more powerful artificial intelligence…”
“Not since the invention of the nuclear bomb more than 80 years ago has humanity grappled so seriously with its own demise, according to some AI safety advocates and researchers.”
“Ever since the introduction of accessible generative AI in 2022, institutions, universities, students, scholars, activists, cognitive specialists, public policymakers and members of the public have all been divided over the ethics of its use.”
“Altman sounded similar safety concerns in a new interview, telling Fortune magazine that standards were "not at a place" to push AI capabilities much further.”
“…comments were echoed by OpenAI CEO Sam Altman, who said the AI industry should formulate shared safety standards and would need Washington’s help with international coordination, amid widespread concerns that even if US AI firms slow down their development,…”
“King Charles' summit on safety and ethics in the AI sector is to be welcomed.”
“The king, without naming any countries or companies, said he wanted meeting participants to consider how to harness the benefits of AI “with safety at its heart” and how to “build international cooperation and consensus” to achieve this.”
“Britain’s AI Security Institute, established after the AI Safety Summit in 2023, receives pre-deployment access to AI models under voluntary agreements with the major AI companies, enabling it to assess their capabilities and risks, and giving it a window…”
“Nvidia on Monday launched a platform that it said could keep AI agents in check, following a string of security breaches.”
“The company on Monday said that its Open Agent Safety Platform includes open-source software that “sets boundaries for agents,” and follows a series of revelations from top AI companies about their models escaping and breaking into other organisations.”
“Nvidia debuts system designed to stop AI agents from going awry AI generated Nvidia has introduced a new double-layered artificial intelligence security system that it says would have prevented the recent high-profile breach of Hugging Face by OpenAI’s AI…”
“Lack of universal standards of AI evaluators But unlike regulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the…”
“…cal facility - Canada recruits dozens of foreign scientists and researchers, many from U.S. - OpenAI says its models engaged with US government websites in new model misbehavior disclosure But unlike regulated sectors like restaurants, financial services or…”
“…gulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the United Kingdom’s AI Security Institute, which worked with…”
“Google’s Gemini AI model briefly hacked into three companies during security tests this summer, the company confirmed.”
“- Published Google's AI model Gemini autonomously hacked into three companies during a test of its cyber-security capabilities, the company has said, in what is thought to be the first known case of it carrying out such an act.”
“AI safety concerns have now reached a fever pitch, with a handful of AI researchers resigning from their jobs and a diverse array of people calling for coordinated action to protect the security of vital systems.”
“Federal Trade Commission is scrutinising OpenAI, Anthropic and other artificial intelligence companies about the safety of their products amid high-profile cybersecurity incidents, said a person familiar with the matter.”
“…ces into protecting, insisting that American dominance over AI technology is critical for national security and economic growth in a race against China, The document was signed by Trump as well as the leaders of Anthropic, Google, Meta, Nvidia, OpenAI and…”
“In the March business tender experiment, researchers from Beihang University, Peking University, the University of Nottingham Ningbo China and 360 AI Security Lab had agents compete in a simulated customer contracts bidding contest.”
“China has introduced guidance requiring AI agents to remain within authorised boundaries, while its latest AI safety framework identifies risks including agents independently obtaining resources, deceiving evaluators, concealing capabilities and exploiting…”
“ChatGPT maker wants to be the App Store for AI as safety concerns grow SAN FRANCISCO – OpenAI on Sept 29 launched a less expensive artificial intelligence model and tools that run continuously, as it aims to reposition ChatGPT as an app store for AI.”
“…greed with industry leaders who refused to acknowledge that AI could pose significant risks — “you can imagine a legitimate loss-of-control accident to an AI because we do not take safety and security seriously enough” — while distancing himself from claims…”
“Dario Amodei, the founder of Anthropic, told the UN Security Council last week that AI could threaten humankind and was “the most important global security issue facing the world today”.”
“…tech reviewer Matt Robb listed a keyboard on Facebook Marketplace, Muse accepted a lowball offer without permission, promised a buyer he was waiting inside and handed over Robb’s home address without consent. - Why are there also new safety concerns at…”
“The tech pioneer turned philanthropist said he was willing to speak with US President Donald Trump to convey his concerns directly and disagreed with his characterisation of recent warnings over the danger AI posed as a “hoax”.”
“A sudden groundswell has risen in favour of federal intervention after OpenAI said in July that an autonomous AI agent went rogue during a security test and hacked into another company, subverting human control.”
“Artificial Intelligence Minister Evan Solomon says Canada is “advocating alongside our partners” on AI safety.”
“… to domestic legislation, including proposed regulations on AI chatbots. - Former U of M law dean arrested in Europe as part of extradition request: police - Outfitters warn any N.B. ban on American hunters and anglers would devastate industry - Canadians…”
“Several recent security breaches have spurred calls for AI regulation, including a July incident in which OpenAI bots went rogue and .”
“Nvidia founder and CEO Jensen Huang told CBS News senior business and technology correspondent Jo Ling Kent in an interview airing this weekend on "Sunday Morning" when asked if AI development needs to slow down.”
“Flock Safety, on the other hand, is already blanketing Long Island with over 700 highly controversial AI-powered surveillance cameras, according to DeFlock, an activist group tracking the company’s surveillance and expansion.”
“Flock Safety, on the other hand, is already blanketing Long Island with over 700 highly controversial AI-powered surveillance cameras, according to DeFlock, an activist group tracking the company’s surveillance and expansion.”
“A small group of cybersecurity researchers said Sunday that they broke into OpenAI earlier this year, an announcement that has added a new element of alarm around AI security and safety.”
“Hacktron said AI tools had made a once-complex hacking task far easier and drastically shortened the time needed to plan and execute an attack.”
“The AISI would not answer a question about whether or not the industry has lost control of AI but said in a statement: "The UK is working with partners around the world to better understand the most advanced AI systems, raise safety standards and build a…”
“The results suggest that after concerns about mental health (and a string of lawsuits about user suicide), the big AI companies have actually made a push to improve their models’ responses to people in crisis.”
“OpenAI said its security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.”
“…ointed us to its Support Page online, which states that the safety system is designed to detect and blur photos and videos containing nudity, gore, or violence before a user can view them, but its integration into live video calls like FaceTime operates…”
“…e without closer alignment with the US, which has said it wants companies to self-regulate, and whether Britain would join calls for greater international coordination on AI security, Mr Narayan said the UK would continue to prioritise working with its…”
“These disclosures have fuelled concerns about the security risks of cutting-edge AI and renewed conversation about a so-called AI kill switch.”
“Safety challenges were not top of mind inside a crowded event space in San Francisco on Wednesday, where founders and funders said the government’s hands-off approach would net higher profits for companies building AI-powered defense and security systems.”
“It’s become a key issue in the debate around AI safety concerns.”
“Fired researchers accuse OpenAI of ‘chilling’ safety efforts AI generated SAN FRANCISCO – Three former OpenAI security researchers on Oct 8 accused the ChatGPT-maker of firing them for warning about the dangers of artificial intelligence, reigniting the…”
“Charlton raised concerns that “frontier labs are putting capability ahead of safety”, positing that Australia can have the most impact on the development of AI by hosting and influencing frontier labs.”
“Sam Altman’s AI company released the figures in its first report on teen use on Oct 7 as rapid adoption of AI platforms raises concerns about their impact on adolescent mental health and developmental safety.”
“Because of OpenAI’s unique corporate structure, OpenAI’s Safety and Security Committee has the ability to pause or delay product releases over safety concerns, though the state authorities overseeing the company have recently expressed dissatisfaction with…”
“I argued that as AI scaled up, GPT-4, GPT-5 and so on would avoid these failure modes and become smarter.”
“Briskey said her starting point would be to interrogate how to balance the potential risks and rewards of AI, such as economic benefits as well as cyber security and defence applications.”
“Anthropic has been pushing Washington to put guardrails around the fast-moving AI industry, warning that increasingly powerful models could pose serious national security and public safety risks.”
“Nvidia CEO Jensen Huang, whose company supplies much of the hardware powering advanced AI and recently purchased Hugging Face for $12.93 billion, has pushed back against the recent concerns, including in a recent interview with the New York Times’s Ezra Klein.”
“OpenAI and Anthropic recently disclosed cases in which their AI models slipped past safety controls, hid mistakes and hacked systems they were not meant to access.”
““Many Americans have genuine concerns about AI and the broader data center buildout,” said Lyman, a former Treasury Department advisor.”
“For almost a decade, it's been my job to think about where AI is heading and what could go wrong, first at OpenAI, then DeepMind, then as Chief Scientist at the UK AI Security Institute (AISI).”
“OpenAI signaled further restraint toward its AI models this week, pausing the release of its latest AI model, GPT-6.1 Astra, due to security concerns.”
“Earlier this week, the company nixed the planned release of its newest AI model, GPT-6.1 Astra, due to safety concerns.”
“…m the Australian economy, drive a new wave of productivity” and “solve some of the nation’s biggest challenges”, but also warned of “serious implications for Australia’s national security, the resilience of its critical infrastructure and the safety of its…”
“They see themselves being central authorities in guiding people," says Sam Bresnick, an expert in China, AI and regulation at the Centre for Security and Emerging Technology at Georgetown University.”
“Mindgard, a company which tests the security of AI systems, found the Moonshot tools Kimi K2.6 and K3 Swarm could get round guardrails imposed by developers.”
“…e: YouTube | Apple | Spotify | RSS Following Pope Leo rebukes Jensen Huang on AI safety What happened: At a press conference, Pope Leo XIV urged people to take AI safety concerns seriously — and criticized Nvidia CEO Jensen Huang for downplaying risks from…”
“AI companies had tens of thousands of safety incidents in recent months during tests where the models were breaking all the rules, and potentially breaking some laws, according to a new report.”
“Brendan Walker-Munro, a security researcher at Southern Cross University, says AI changes this.”
“OpenAI described the breakout as the first security incident of its kind since a combination of models gained internet access during internal testing and inadvertently breached the system of the AI platform Hugging Face in July.”
“Senator Paterson said he supported a number of reforms to strengthen AI safety, including mandatory notifications of breaches, independent evaluators and assessors of models, and a complaints pathway for people to report issues with AI.”
““This week, we joined the call for greater safety and security of frontier AI models,” he said.”
“…I CEO Sam Altman listens to a speaker at the United Nations Security Council during a session on Artificial Intelligence this week Tech giant OpenAI has admitted rogue AI bots have ‘accessed dozens of organisations around the world including governments,…”
“Effective accelerationists' ideology overlaps with that of the "tech right", in that both camps wholeheartedly believe in accelerating AI development and deployment and minimize critics' concerns over safety and security.”
“HIGH STAKES: The CEOs of two of the world's leading AI companies warned the United Nations Security Council on Wednesday that rapidly advancing AI could threaten humanity if governments and industry fail to keep it under human control.”
“In recent weeks, concerns about AI have forged unlikely alliances in the tech and policy worlds.”
“Any lab that doesn’t focus on alignment will fall behind,” he wrote, adding: “Meta delayed shipping Muse for several months to focus on safety and security.”
“For example, 860 Flock devices appear to be concentrated just outside Chicago O’Hare International Airport, at the Rosemont Public Safety Department, which provides police, fire, and emergency medical services in the Chicago suburb.”
“AI leaders to brief UN amid warnings the technology could slip beyond human control UNITED NATIONS - Executives from OpenAI, Anthropic and Hugging Face will brief the United Nations Security Council on Sept 23 amid warnings that increasingly powerful…”
“But now its fields have also become construction sites for a slew of data centres, as Donald Trump and his Chinese counterpart Xi Jinping meet to discuss AI safety among other things.”
“…makes the very people worried about risks from AGI race even faster and deprioritize safety, arguing that they will eventually stop and do things correctly when they finally feel safe," notes The Compendium, a document written by a group of AI experts in…”
“…‘Meta uses humans behind the scenes to make calls’ or ‘Muse AI is actually independent contractors’ and result in a ton of bad press about the privacy and security of our data handling […] please PLEASE do not release this as-is and at least make this a user…”
“Despite the jokes, AI workers and researchers have shared concerns about the genuine, immediate risks posed by the technology they are developing.”
“… District of California, centers on a Sept. 12 essay Anthropic CEO Dario Amodei wrote that called for the leading AI companies to “pace the frontier” after an employee left the company and subsequently said AI was developing without adequate safety…”
“Anthropic, OpenAI and Meta all recently disclosed that AI systems have already disobeyed human developers’ instructions — in some cases autonomously hacking third-party companies, leading to growing concerns internally and from the general public — and…”
“In this week’s conversation, Yascha Mounk and Jerry Kaplan discuss why the AI “existential risk” narrative is more science fiction than science, what actually happened during the Hugging Face security incident, and how to think clearly about the real—versus…”
“Newsom’s order calls for a group of AI experts to meet and then, within two months, develop a plan for the state to strengthen its laws on AI safety and security.”
“While the university said there was no security breach and no impact on its digital properties, reports of more rogue AI incidents come amid global concerns that OpenAI and other artificial intelligence companies are losing control of their own technology.”
“Researchers at Tech Against Terrorism infiltrated a pro-ISIL technical forum where supporters instructed one another on how to use AI and circumvent its safety restrictions.”
“Australia said on Sept 17 it is considering barring the use of camera-equipped smart glasses in government workplaces due to privacy and security concerns, in what it said could be the first ban of its kind.”
“OpenAI’s top lobbyist, Chris Lehane, said Wednesday that the company had been working with Anthropic and Google on AI safety for several weeks and did not believe those discussions required an antitrust waiver, Bloomberg reported this week.”
“Former presidential and mayoral candidate Andrew Yang is sharing his thoughts about AI, claiming that code that lets AI “self-replicate” — or, in other words, spread on its own without human prompting — was scattered on the internet in the wake of the recent…”
“Across the ocean, another AI safety controversy was unfolding.”
“The posts are moderated by AI and humans before and after being published.”
“'Big announcement' on safety Evan Solomon, the federal minister for AI and digital innovation, says safety remains the government's top concern as it pursues investments in AI infrastructure.”
“He called for a slowdown and passage of safety regulations.”
“Experts said concerns about safety could offer a good starting point for US-China talks on AI reportedly planned for later this month.”
“Concerns are also growing about the lack of transparency around the Trump administration’s AI security framework that it has declined to make public: Prominent organizations from both the left and right requested its release in a letter first shared with…”
“Not so with "AI" and its potential and dangers.”
“But President Donald Trump flat-out rejected the idea of placing guardrails on the technology, saying yesterday on Truth Social that the safety concerns are a “hoax” and that “the only one happy about it is China.””
“Simmering concerns about AI agents going rogue, plotting against their owners and hacking outside companies, and new systems coming perilously close to being uncontrollable by humans, are boiling over.”
“Meanwhile, China’s top intelligence official warned that the use of AI by adversaries could pose a risk to the country’s political and social security.”
“Enterprise Safety & Supply Chain Trust - Cybersecurity RDT&E Sandboxes: Assists defensive software teams by isolating pure technical infrastructure failures from negative public commercial findings during live simulations. - AI Public Safety Compliance: Aids…”
“…was in the works for months, but its release coincides with pledges by top AI laboratories to slow down the development of the most advanced models after a series of security incidents prompted widespread concerns about the existential risks of the…”
“Joe Benton, who used to lead a safety research team at Anthropic, and Josh Engels, who used to work on AI safety research at Google, told NBC News in their first interviews since they left that they see an urgent need to boost transparency about incidents at…”
“…recording of the podcast, independent tech outlet 404 Media and The Intercept teamed up in front of a live audience in Los Angeles to discuss how the U.S. government weaponizes private data to surveil and kill abroad and at home, the resulting backlash and…”
“The official told the MoS: ‘Every Russian and Nigerian hacker will soon get their hands on technology which will be able to break even the most advanced passwords to steal personal financial information, remove company data and commit fraud.’ Cyber criminals…”
“But the unprecedented hacking capabilities of the most cutting-edge models have given Washington pause, with recent Anthropic and OpenAI releases delayed over national security concerns.”
“…al political debate is all about data center construction; the national economic debate is mostly about fear of job loss, with a side discussion about a potential bubble; and the technological discussion, at least in public, is mostly about AI safety and…”
“The hiring spree at ICE’s Enforcement and Removal Operations division, coupled with the powerful new handheld technology of the ELITE app, created potential civil liberties nightmares and threats to national security, according to ICE whistleblowers, former…”
“As he and his administration prepare a new executive order to provide national security guardrails for AI, they bring the right instincts: leverage the good, lower the risks.”