Tech titan Dario Amodei is known for once introducing an unusual tradition at AI giant Anthropic.
asserted
Amodei → know → Anthropic
When employees join the firm, the chief executive recommends they read The Making of the Atomic Bomb.
asserted
they → join → Bomb
Richard Rhodes's account traces the events leading up to the creation of the A-bomb, and the ethical conundrums presented by the scientific discovery.
asserted
account → trace → discovery
"If you think about the protagonist of that story, it's [Robert] Oppenheimer who has this inner conflict of atomic physics that is both fascinating and important," professor Sarah Kreps, director of the Tech Policy Institute at Cornell University, told the ABC.
asserted
Kreps → think → ABC
"It is very difficult for experts to step away from a scientific pursuit, absent a crisis."
asserted
experts → step → crisis
Amodei is not Oppenheimer, but he is at the frontier of an industry that has generated similar levels of debate about the potential existential threat it poses to humanity.
asserted
it → generate → humanity
As chief executive of Anthropic, Amodei has spent years overseeing the development of AI, while simultaneously spruiking its utopian benefits and warning everyone who will listen about the risks it poses to the world.
asserted
it → spend → world
"I think at the end of the day, I warn about these things not to be a prophet of doom, but because warning about them is the first step towards solving them," Amodei told the New York Times last year.
asserted
Amodei → think → them
In September, the scientist-turned-entrepreneur made a splash after calling for a global slowdown of artificial intelligence development in a 3,800-word essay called Pacing the Frontier.
asserted
scientist → turn → Frontier
Amodei had articulated similar thoughts in lengthy essays and interviews before.
asserted
Amodei → articulate → essays
But what made this call different was how quickly other tech titans, including Sam Altman and Elon Musk, endorsed his proposal in a surprising display of unity.
asserted
titans → make → unity
His fresh warning about the need to slow AI's capability to allow safety measures to keep up arrived at a moment of heightened anxiety over the technology.
asserted
measures → slow → technology
Along with mounting public anger over data centres and concerns about tech-driven job losses came OpenAI's revelation that two of its models had hacked into the servers of another company called Hugging Face, unbeknownst to it.
asserted
two → mount → it
Staff inside the industry were also quitting their jobs to issue dire warnings about AI and, in one explosive account, an employee placed a "sophisticated listening device" inside a toilet paper roll to spy on company meetings.
asserted
employee → quit → meetings
That incident has since paled in comparison to allegations that Nvidia co-founder Jensen Huang engaged in an alleged extramarital affair with a suspected spy for China.
asserted
Huang → pal → China
And yet, despite the recent controversies and Amodei's warning, AI is no closer to being regulated, as the sector races ahead to develop cheaper, more powerful models.
asserted
sector → regulate → models
And it is Anthropic which is leading the pack, breaking records with last week's float on the US stock exchange.
asserted
which → lead → exchange
A dramatic split
A decade ago, Amodei was working for OpenAI and dancing to someone else's tune.
asserted
Amodei → work → tune
For years, he helped set OpenAI's safety research direction, riding the AI wave as it lurched from possibility to probability.
asserted
it → set → probability
But as the company grew, its leadership realised vast sums of money would be needed for the expensive computing power required to run and test its AI models again and again.
asserted
sums → grow → models
Their answer was to create a commercial arm of the research organisation under a hybrid for-profit, non-profit model.
asserted
answer → create → model
This new direction concerned Dario Amodei, along with other employees.
asserted
direction → concern → employees
"One of the sources of my dismay was that as these [safety] issues were getting more serious, the company started moving in the opposite direction," he told Wired magazine.
asserted
he → get → magazine
Amodei took his concerns to Altman, who assured him he would act.
asserted
he → take → him
When nothing changed, Amodei decided it was time to go.
asserted
it → change → ?
At the end of 2020, he and six other OpenAI employees, including his sister Daniela, quit.
asserted
he → include → sister
A year later, they formed Anthropic in San Francisco.
asserted
they → form → Francisco
Amodei's split from OpenAI is now considered one of the most consequential in Silicon Valley's history, giving rise to the "fastest-growing software company in history at the scale that it's at".
asserted
it → consider → that
But the co-founder said creating a trillion-dollar company was not what he had initially envisioned when he left OpenAI.
asserted
he → say → OpenAI
"I did not start a company because I was initially excited about selling things or business, or anything like that," he told John Collison, the founder of Stripe, in a Cheeky Pint podcast.
asserted
he → start → podcast
Anthropic was instead set up with an unusual governance structure designed to prevent the company from being acquired or redirected away from its safety mission by outside investors.
asserted
Anthropic → set → investors
Yet as Anthropic's growth accelerated over the years, particularly around the release of Claude Opus 4.5, it has drawn in investment from tech firms like Nvidia, Microsoft and Amazon.
asserted
it → accelerate → Nvidia
Last week it was listed on the Nasdaq stock exchange at a whopping $US111.51 billion, ($166 billion) putting the total value of the listing at about more than $US2 trillion.
asserted
it → list → trillion
That has raised questions about whether the company can stay true to its initial principles, concerns which have only grown following its IPO.
asserted
which → raise → IPO
Amodei weighs risk vs reward
asserted
Amodei → weigh → reward
At an AI summit earlier this year, reminders of Amodei's dramatic split with OpenAI were on full display when he and Altman posed on stage with other guests during a group photo.
asserted
he → pose → photo
As those gathered joined hands and held them in the air, Amodei and Altman raised their fists instead.
asserted
Amodei → gather → fists
"Doing anything in cooperation, including holding hands on a stage, seems to be difficult [for them]," said David Evan Harris, chancellor's public scholar at the University of California, Berkeley.
asserted
Harris → "doe → California
Dominated by tech rivalries, factionalism and a desire to win the race, the AI industry is now best understood through a lens of intense competition.
asserted
industry → dominate → competition
But a recent vibe shift has overshadowed some of these tech tensions, with the industry's biggest players coming together to warn about its risks after Amodei's September essay.
asserted
players → overshadow → essay
…and 31 more, not listed.