Jacob Coxon, a researcher at Anthropic, has quit his job to raise concerns that AI development is out of control and could lead to catastrophic consequences. In a series of posts on social media, he warned that AI could "kill all humans" by the end of the decade, citing the fact that many executives and researchers in the field privately express fear about the dangers of AI, but publicly downplay its risks. Coxon worked at both Anthropic and OpenAI, and believes that neither company is acting responsibly in their pursuit of developing self-improving superintelligence. He estimates that the risk of AI posing an existential threat to humanity is over 10%, and warns that the technology could lead to superhuman systems that can hack anything, revolutionize fields overnight, and acquire real power and resources. Coxon's resignation has sparked debate about the need for global coordination on regulating AI development and slowing down its progress if necessary.
The AI industry is begging for a slowdown.
