I don’t know when I first heard the story of Joseph Weizenbaum, but it was a long time before our screens and news and thoughts and dreams and nightmares were so full of artificial intelligence.
asserted
screens → know → intelligence
He was on a temporary contract at the Massachusetts Institute of Technology in the mid-1960s, working for Project MAC, which had the aim of making computers more widely accessible.
asserted
computers → work → aim
Seemingly to help achieve this aim, Weizenbaum developed the world’s first chatbot, on a computer the size of a room, that heated an entire building, and had just 150 kilobytes of memory.
asserted
that → help → memory
Named after Eliza Doolittle from George Bernard Shaw’s Pygmalion, Weizenbaum’s creation was a play on Rogerian psychotherapy, a non-directive type of talk therapy created by Carl Rogers in the 1940s.
asserted
creation → name → 1940s
Eliza could recognise words such as “mother” or “father”, change “I’s” to “you’s” and very, very basically, ask input sentences back as questions.
uncertain
you → recognise → questions
If it couldn’t compute how to do this, it would use the disguise of Rogerian therapy to say things like, “please go on” or “I’m not sure I understand you fully.”
asserted
I → compute → you
Weizenbaum actually had ulterior motives.
asserted
Weizenbaum → have → motives
He was already sceptical of the concept of AI, and saw Eliza as the chance to remind the world how farcical the concept of intelligent machines was.
asserted
concept → see → machines
He wrote a paper about the program, publishing sections of its basic code, to say, “Look! This is so simple and yet it can appear intelligent!”
asserted
it → write → code
Because, for him, appearance was as close as a computer could ever get to human intelligence.
uncertain
computer → get → intelligence
He was sure his paper and this apparent joke would show the world how right he was.
asserted
he → show → world
But the world didn’t take it the way he intended.
asserted
he → take → it
Eliza was celebrated.
asserted
Eliza → celebrate → ?
Prominent voices in the American therapeutic world thought it could be rolled out across the country to help with the therapy shortage.
uncertain
it → think → shortage
Then he discovered his own staff, the people who had helped create it, were sneaking in and using it without his knowledge and refusing to hand over their transcripts, calling them “private” conversations between “me and her”.
asserted
who → discover → me
Most famously of all, his secretary asked him to leave the room when she was “talking to Eliza”.
asserted
she → ask → Eliza
It has even come out that, in the very same building, under a disguise, was a government agency that also claimed the word “intelligence”; Weizenbaum, who had fled a growing Nazi Germany in 1936, was eventually forced to confront the fact the Pentagon was a major funder of his work.
asserted
Pentagon → come → work
His invention (or joke) had been received in exactly the opposite way he had intended.
asserted
he → receive → way
He received tenure at MIT on the back of this misunderstanding and nothing he could do seemed to sway people’s views of his creation.
uncertain
he → receive → creation
I guess that’s the risk you take when you create and put something out into the world.
asserted
you → guess → world
So, as the world was heating up over AI, and I wondered how I could creatively respond to all this, the first thought I had was to look back in order to understand something that seems to be so much about the future.
uncertain
that → heat → future
I went to Weizenbaum, his secretary and their invention, and it was all there: all the contemporary worries about people falling in love with chatbots, about privacy, about environmental damage and, perhaps worst of all, all the legitimate fear about who is behind it and what their intentions are.
asserted
intentions → go → it
My play is set in 1966, as Weizenbaum releases his creation and finds himself in a maelstrom of delusion.
asserted
Weizenbaum → set → delusion
To write it, I did something very un-AI: I talked to people.
asserted
I → write → people
I talked to Jewish consultants about the early post-World War II Jewish experience, to computer engineers at MIT during the ’60s, to the people who rediscovered Weizenbaum’s files he had hidden in the MIT archives.
asserted
he → talk → archives
I talked to friends and family and anyone and everyone to hear about their dreams and fears for this technology.
asserted
I → talk → technology
I also talked to a friend and collaborator of Weizenbaum about the mythical secretary who was never named, and then I got to share this name with an academic researching the lost women of computing history.
asserted
I → talk → history
Wonderfully, the academic and the secretary shared a name: Becky!
asserted
academic → share → name
I also talked to Eliza; the program is freely available online thanks to members of the team who rediscovered the story.
asserted
who → talk → story
I even talked to ChatGPT and Claude and any other sentence-generating software to see how they would respond to prompts about Eliza and Weizenbaum.
asserted
they → talk → Eliza
One of them tried to set the whole play in a jazz bar, with Weizenbaum wearing a beret.
asserted
Weizenbaum → try → beret
What are we, as creatives, meant to think about this software?
asserted
we → mean → software
Is it just the latest in the long line of technology that has disrupted and brought fear to the arts, only to be used to create new, incredible work?
asserted
that → disrupt → work
Is it Baudelaire against the camera, or Bob Dylan coming out with an electric guitar?
asserted
Dylan → come → guitar
They steal our IP, churn through our water, tear apart our privacy, line their pockets in ways the Rockefellers could never have dreamed of, and threaten the structures of democracy.
uncertain
Rockefellers → steal → democracy
As a citizen, all this enrages me.
asserted
this → enrage → me
I dream of setting fire to military contracts, pumping polluted water into data centres and toppling space rockets as if they were statues of dictators.
asserted
they → dream → dictators
How dare these tech feudalist elites think they can steal everything we have ever created and earn a country’s GDP from the theft!
asserted
we → think → theft
But there are rumblings of a different way: voices as diverse as Bernie Sanders and Steve Bannon have called for at least partial nationalisation.
asserted
voices → be → nationalisation
Cory Doctorow, coiner of the glorious term “enshittification” – an idea no AI could ever come up with – believes that when the financial bubble finally bursts, the hardware behind these models could be bought for pennies in the dollar and whatever is created from it can become open-sourced, as I believe it should have been in the first place.
uncertain
it → come → place
…and 9 more, not listed.
The Aporia
