The Aporia
Jacob Coxon, a 27-year-old former researcher at Anthropic and OpenAI, testified before the New York City Council on Monday alongside safety representatives from tech giants like Google, Meta, and OpenAI. Coxon, who quit his job over safety concerns last September, warned about the risks of AI companies racing to develop technology without proper safeguards in place. He stated that these firms do not fully control their AI models and are moving too quickly towards creating systems capable of self-improvement, which could pose a significant threat to humanity. The hearing, requested by Council Speaker Julie Menin, aimed to address potential legislation for establishing AI safety measures as city officials consider bills to regulate the industry. Coxon's testimony highlighted concerns over potential catastrophic scenarios, emphasizing that companies must better quantify and manage risks associated with advanced AI technologies.