Existential AI fears broke containment this week after an Anthropic researcher quit, warning that frontier labs are “gambling with our lives.”
asserted
labs → break → lives
One of his colleagues chimed in, putting the odds of human extinction from AI at more than 10%.
asserted
One → chime → %
Sheryl Crow entered the conversation.
asserted
Crow → enter → conversation
We at Semafor Business aren’t tech experts, but we do know IPOs, and “we might cause the end of civilization” is a doozy of a risk factor.
uncertain
cause → know → factor
I’m edge-of-my-seat curious how the lawyers at Wilson Sonsini, working on the Anthropic listing, and Cooley and Wachtell, for OpenAI’s, will handle this section of the offering documents.
asserted
lawyers → ’m → documents
We took a crack.
asserted
We → take → crack
Risk Factors
- There is no guarantee that the company’s products will not precipitate the collapse of civilization.
asserted
products → be → civilization
Such an outcome, which may not require any intentional misuse or manipulation of our products, is, in the view of the Company’s management, an acceptable cost of pursuing its noble mission.
uncertain
which → require → mission
- It is not possible, based on the information available to the Company at the time of this issuance, to determine whether this is a Good or Bad Idea.
asserted
this → base → issuance
The Company, under the oversight of the Calamity Calibration Committee of its Board of Directors, continues to assess the likelihood of the end of the world.
asserted
Company → continue → world
- We do not know how our products work.
asserted
products → know → ?
- We may be unable to compete with larger, better-capitalized competitors.
uncertain
We → compete → competitors
Just kidding, we have all the capital.
asserted
we → kid → capital
- Our valuation is entirely made up.
asserted
valuation → make → ?
We encourage investors to make their own assessments about the value of our shares, for example through discounted analysis of the terminal value of our assets.
asserted
We → encourage → assets
Wait, “terminal” is not a word we want in anyone’s head.
asserted
we → wait → head
We’ll come back to you.
asserted
We → come → you
- The company believes it has a total addressable market (TAM) of between $23 trillion and $126 trillion.
asserted
it → believe → trillion
Should that revenue fail to materialize, we will be forced to reassess or go on an ill-advised acquisition spree to backfill it.
asserted
we → fail → it
Including this key man, none of our employees understand how we create our products or how they work (See Risk Factor 3).
asserted
they → include → Factor
Many of those closest to any semblance of comprehension may quit to go live in underground bunkers.
uncertain
Many → quit → bunkers
- The Company has, as part of our standard employment contracts, allowed employees to freely post on social media platforms.
asserted
employees → allow → platforms
These communications could precipitate additional political scrutiny and a general destabilizing effect on the thinking, reading public.
uncertain
communications → precipitate → public
Should the company cease to allow these employees to scare the hell out of everyone on a random Tuesday, there is no guarantee they will remain with the Company.
asserted
they → cease → Company
- From time to time, we treat our regulators with an attitude that swings wildly between contempt and obsequiousness.
asserted
that → treat → contempt
Should we keep doing this, there can be no guarantees that we will be able to operate as a going concern beyond 2027.
asserted
we → keep → 2027
Our ability to win over local constituencies deeply mistrustful of both our products and our leaders is uncertain.
asserted
ability → win → products
- At the time of this issuance, we do not carry an investment-grade credit rating, which may increase our borrowing costs or force us to borrow someone else’s and hope nobody notices.
uncertain
nobody → carry → someone
We did try to strong-arm the ratings agencies into granting an exception in the name of generational progress, but they are bizarrely holding out.
asserted
they → try → progress
- A significant portion of our revenue is derived from a limited number of customers.
asserted
portion → derive → customers
We know a lot of companies say this but, no, literally all our money comes from Nvidia.
asserted
money → know → Nvidia
If you’d like to become a customer, we’d love to add a second file to our CRM, just to test it out.
asserted
we → like → it
Come to think of it, customer-relationship management seems like a good business.
asserted
management → come → business
- The company has, from time to time, been the subject of concerted and organized cyberattacks, which could materially damage our business.
uncertain
which → organize → business
Just kidding, we’re the ones doing the hacking.
asserted
we → kid → hacking
Companies we inadvertently hack could bring litigation seeking damages, but recent history has shown they are more likely to sell themselves to Nvidia, which in the Board’s studied opinion, is unlikely to sue us for obvious reasons.
uncertain
which → hack → reasons
The Aporia
