No one sells the future more masterfully than the tech industry. According to its proponents, we will all live in the “metaverse,” build our financial infrastructure on “web3” and power our lives with “artificial intelligence.” All three of these terms are mirages that have raked in billions of dollars, despite bite back by reality.
Artificial intelligence in particular conjures the notion of thinking machines. But no machine can think, and no software is truly intelligent. The phrase alone may be one of the most successful marketing terms of all time.
Last week OpenAI announced GPT-4, a major upgrade to the technology underpinning ChatGPT. The system sounds even more humanlike than its predecessor, naturally reinforcing notions of its intelligence. But GPT-4 and other large language models like it are simply mirroring databases of text — close to a trillion words for the previous model — whose scale is difficult to contemplate. Helped along by an army of humans reprograming it with corrections, the models glom words together based on probability. That is not intelligence.
These systems are trained to generate text that sounds plausible, yet they are marketed as new oracles of knowledge that can be plugged into search engines. That is foolhardy when GPT-4 continues to make errors, and it was only a few weeks ago that Microsoft Corp. and Alphabet Inc.’s Google both suffered embarrassing demos in which their new search engines glitched on facts.
Not helping matters: Terms like “neural networks” and “deep learning” only bolster the idea that these programs are humanlike. Neural networks aren’t copies of the human brain in any way; they are only loosely inspired by its workings. Long-running efforts to try and replicate the human brain with its roughly 85 billion neurons have all failed. The closest scientists have come is to emulating the brain of a worm, with 302 neurons.
We need a different lexicon that doesn’t propagate magical thinking about computer systems, and doesn’t absolve the people designing those systems from their responsibilities. What is a better alternative? Reasonable technologists have tried for years to replace “AI” with “machine learning systems,” but that doesn’t trip off the tongue in quite the same way.
See also: ChatGPT’s US$8 tril birthday gift to Big Tech
Stefano Quintarelli, a former Italian politician and technologist came up with another alternative, “Systemic Approaches to Learning Algorithms and Machine Inferences” or SALAMI, to underscore the ridiculousness of the questions people have been posing about AI: Is SALAMI sentient? Will SALAMI ever have supremacy over humans?
The most hopeless attempt at a semantic alternative is probably the most accurate: “software.”
“But,” I hear you ask, “What is wrong with using a little metaphorical shorthand to describe technology that seems so magical?”
See also: DBS, EnterpriseSG and IMDA launch gen AI programme to help up to 50,000 SMEs adopt tech
The answer is that ascribing intelligence to machines gives them undeserved independence from humans, and it abdicates their creators of responsibility for their impact. If we see ChatGPT as “intelligent,” then we are less inclined to try and hold San Francisco startup OpenAI LP, its creator, to account for its inaccuracies and biases. It also creates a fatalistic compliance among humans who suffer technology’s damaging effects; though “AI” will not take your job or plagiarize your artistic creations — other humans will.
The issue is ever more pressing now that companies from Meta Platforms Inc. to Snap Inc. to Morgan Stanley are rushing to plug chatbots and text and image generators into their systems. Spurred by its new arms race with Google, Microsoft is putting OpenAI’s language model technology, still largely untested, into its most popular business apps, including Word, Outlook and Excel. “Copilot will fundamentally change how people work with AI and how AI works with people,” Microsoft said of its new feature.
But for customers, the promise of working with intelligent machines is almost misleading. “[AI is] one of those labels that expresses a kind of utopian hope rather than present reality, somewhat as the rise of the phrase ‘smart weapons’ during the first Gulf War implied a bloodless vision of totally precise targeting that still isn't possible,” says Steven Poole, author of the book Unspeak, about the dangerous power of words and labels.
Margaret Mitchell, a computer scientist who was fired by Google after publishing a paper that criticized the biases in large language models, has reluctantly described her work as being based in “AI” over recent years. “Before… people like me said we worked on ‘machine learning.’ That’s a great way to get people’s eyes to glaze over,” she admitted to a conference panel on Friday.
Her former Google colleague and founder of the Distributed Artificial Intelligence Research Institute, Timnit Gebru, said she also only started saying “AI” around 2013: “It became the thing to say.”
“It’s terrible but I’m doing this too,” Mitchell added. “I’m calling everything that I touch ‘AI’ because then people will listen to what I’m saying.”
Unfortunately, “AI” is so embedded in our vocabulary that it will be almost impossible to shake, the obligatory air quotes difficult to remember. At the very least, we should remind ourselves of how reliant such systems are on human managers who should be held accountable for their side effects.
Author Poole says he prefers to call chatbots like ChatGPT and image generators like Midjourney “giant plagiarism machines” since they mainly recombine prose and pictures that were originally created by humans. “I’m not confident it will catch on,” he says.
In more ways than one, we really are stuck with “AI.”