AI fears—as Bill discusses below—are scrambling our politics and making for some extremely strange bedfellows.
asserted
Bill → discuss → bedfellows
Well, how many issues could put Steve Bannon, Bernie Sanders, and an industry whistleblower all on the same D.C. stage?
uncertain
issues → put → stage
Andrew will be attending and reporting on tomorrow’s “Pro-Human Assembly”—so watch this space.
asserted
Andrew → attend → space
The Greatest Danger of All Would Be to Do Nothing
by William Kristol
asserted
Danger → do → Nothing
In recent months, we’ve learned about artificial intelligence agents escaping captivity.
asserted
agents → learn → captivity
Now we’re seeing the political debate over artificial intelligence escaping captivity.
asserted
intelligence → see → captivity
The quality of this debate will no doubt be mixed.
asserted
quality → mix → debate
Most politicians and commentators who’ll be weighing in don’t really understand the technology (you can certainly put me in that category).
asserted
you → weigh → category
There will be wild over-reactions and timid under-reactions to the challenge we face.
asserted
we → face → challenge
There will be those who grasp for simple solutions, and others who talk on and on while ducking the hard choices.
asserted
who → grasp → choices
But we shouldn’t disdain this forthcoming debate, whatever limitations and flaws it’s likely to feature.
asserted
it → disdain → debate
The national discussion we’re about to have over AI is necessary.
asserted
we → ’re → AI
Those of us privileged to live in a self-governing democracy shouldn’t simply sit back and watch a truly transformative technology move ahead undebated, unchecked, and unguided.
asserted
technology → live → democracy
We shouldn’t be satisfied to be merely passive observers to momentous developments that pose fundamental choices for us as citizens and human beings.
asserted
that → pose → citizens
The dam broke last Tuesday, when researcher Jacob Coxon resigned from Anthropic with a statement that the major AI companies were unprepared to safely manage the systems they’re building.
asserted
they → break → systems
The companies, Coxon wrote, are not “acting responsibly,” but are “racing straight to self-improving superintelligence and gambling with our lives.”
asserted
Coxon → write → lives
“Do not underestimate the power of this technology,” Coxon continued.
asserted
Coxon → underestimate → technology
“These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.”
asserted
that → hack → power
As Andrew Egger remarked here Wednesday, this warning didn’t come out of the blue.
asserted
warning → remark → blue
The summer had featured incidents “in which ‘swarms’ of autonomous AI agents were caught collaborating in backwater crannies of the public internet to subvert the safety restrictions placed on them and pursue various tasks of their own devising.”
asserted
swarms → feature → devising
The tasks included disobeying and even scheming against the humans who thought they were directing these agents in their tasks.
asserted
they → include → tasks
Andrew emphasized last week that “as powerful as the anti-AI backlash has been, the politics of this issue are still very much in their infancy.”
Well, in a few days we’ve moved at warp speed from infancy to at least childhood.
asserted
we → emphasize → childhood
On Saturday, Anthropic’s chief executive, Dario Amodei, published a 3,800-word essay calling for the AI companies to slow the pace of their development.
asserted
companies → publish → development
Amodei confirmed that artificial intelligence was on the verge of “recursive self-improvement” that could outrun humans’ ability to understand or control what they were creating.
uncertain
they → confirm → what
He noted that during the OpenAI–Hugging Face incident in July, programs designed to hack into systems as a test found weaknesses that permitted them to escape the “sandbox” in which designers were testing them before anyone noticed they’d gone rogue.
asserted
they → note → rogue
He warned that “a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage.”
uncertain
that → warn → damage
Amodei called in a general way for self-regulation by the companies as well as cooperation among them and with the government.
asserted
Amodei → call → government
Other tech executives said they agreed.
asserted
they → say → ?
Civic and political leaders joined in widespread expressions of concern.
asserted
leaders → join → concern
Yesterday, when asked about the calls to slow down the development of AI models, Trump dismissed them.
asserted
Trump → ask → them
“I think you have a lot of negative forces that are bringing it up that shouldn’t be bringing it up,” he said.
asserted
he → think → it
“And they’re bringing up things that won’t happen.”
asserted
that → bring → things
One of Trump’s professed concerns is the need to stay ahead of China, which is a legitimate one.
asserted
which → profess → China
But one has no sense that he or any of his top lieutenants or advisors are serious about figuring out how to balance national security concerns with the responsibility to prevent the technology from spinning dangerously out of control.
asserted
he → have → control
Indeed, the Trump administration seems hostile to public debate and deliberation—people “shouldn’t be bringing up” these questions.
asserted
people → seem → questions
Fortunately, the public seems to want these questions to be brought up.
asserted
questions → seem → ?
Dealing with AI is going to be hard.
asserted
Dealing → deal → AI
And we don’t currently have the best circumstances.
asserted
we → have → circumstances
We came to grips with that challenge on the whole pretty impressively and successfully.
asserted
We → come → whole
But is our government up to leading such an effort today?
asserted
government → lead → effort
…and 59 more, not listed.
The Aporia
