What jumps to mind when you think about the impending AI apocalypse? If you’re partial to sci-fi movie cliches, you may envisage killer robots (with or without thick Austrian accents) rising up to terminate their hubristic creators. Or perhaps, a la The Matrix, you’ll go for scary machines sucking energy out of our bodies as they distract us with a simulated reality.
For Yuval Noah Harari, who has spent a lot of time worrying about AI over the past decade, the threat is less fantastical and more insidious.
“In order to manipulate humans, there is no need to physically hook brains to computers,” he writes in his engrossing new book Nexus. “For thousands of years prophets, poets and politicians have used language to manipulate and reshape society. Now computers are learning how to do it. And they won’t need to send killer robots to shoot us. They could manipulate human beings to pull the trigger.”
Language — and the human ability to spin it into vast, globe-encircling yarns — is fundamental to how the Israeli historian, now on his fourth popular science book, understands our species and its vulnerabilities. In his 2014 mega-hit Sapiens (originally published in Hebrew in 2011), he argued that humans became dominant because they learned to cooperate in large numbers, thanks to a newfound aptitude for telling stories. That aptitude, which enabled our ancestors to believe in completely imaginary things, lies at the root of our religions, economies and nations, all of which would dissolve if our narrative-spinning faculties were somehow switched off.
Sapiens has sold 25 million copies to date — a testament to Harari’s own storytelling prowess — though it’s had its share of detractors. Academics questioned its accuracy and the idea of cramming 70,000 years of human history into 450 pages. Sitcoms poked fun at Harari superfans who wave the book around like a modern-day bible. The appeal of Sapiens lies in its dizzying scope but, as a 2020 New Yorker profile pointed out, Harari’s zoomed-out approach can have the effect of minimizing the importance of current affairs.
Nexus could be seen as a rebuke to that criticism. Though it executes its own breakneck dash through the millennia, hopping back and forth in time and between continents, it is very much concerned about what’s happening today.
If stories were fundamental to the schema of Sapiens, here it’s all about information networks, which Harari views as the basic structures undergirding our societies.
“Power always stems from cooperation between large numbers of humans,” he writes, and the “glue” that holds these networks of cooperation together is information, which “many philosophers and biologists” see as “the most basic building block of reality.”
But information doesn’t reliably tell the truth about the world. More often, Harari emphasizes, it gives rise to fictions, fantasies and mass delusions, which lead to such catastrophic developments as nazism and Stalinism. Why is Homo sapiens, for all its evolutionary successes, so perennially self-destructive? “The fault,” according to Harari, “isn’t with our nature but with our information networks.”
Casting his eye over how information has led us astray in the past, Harari has no shortage of examples to draw on. One of the more gorily memorable is Malleus Maleficarum, written by the Dominican friar Heinrich Kramer in 1480s Austria. A guide to exposing and murdering witches in deliriously horrible ways, the book wouldn’t have traveled far had the printing press not been invented a few decades earlier, allowing Kramer’s deranged ideas to spread across Europe, stoking a witch-hunting frenzy.
Harari’s basic point is that information revolutions can give rise to periods of human flourishing but always come at a cost. When we invent shiny new technologies that carry words and ideas farther and faster than ever before, much of the information that spews out is dross or actively dangerous. It’s not helped by the fact that, when it comes to maintaining social order, fictions tend to be more reliable binding agents than truths.
What’s scary about the AI revolution isn’t just that we’ll be overwhelmed with misinformation from chatbots, or that the powers that be will use it to crunch data on our private lives. Unlike previous technologies such as books and radios, writes Harari: “AI is the first tool that is capable of making decisions and generating ideas by itself.” We saw an early warning of this in Myanmar in 2016-17, when Facebook algorithms, tasked with maximizing user engagement, responded by promoting hateful anti-Rohingya propaganda that fueled mass murder and ethnic cleansing.
Harari makes a strong case for why we should regard such algorithms as autonomous agents and how, if we’re not careful, humans could become tools for AI to manipulate with ever more terrible force. Unless we take immediate action, this burgeoning “alien intelligence,” as he prefers to call it, could trigger catastrophes we can’t even imagine, up to and including the destruction of human civilization.
This pessimistic take on AI is nothing new: “doomers” such as Eliezer Yudkowsky have been warning of its apocalyptic potential for years and even the AI industry has started voicing concerns. What Harari seeks to add to the debate is the long view. By applying his lens to previous information revolutions and showing how different forms of government have reacted to them, he believes we can prepare ourselves for the earthquakes to come.
Nexus has some curious blind spots; it’s odd, in a critique of a technology driven largely by profit-seeking corporations, that capitalism is hardly mentioned at all. But whether or not you agree with Harari’s historical framing of AI, it’s hard not to be impressed by the meticulous way he builds it up, speckling what could be a rather dry analysis with vivid examples, such as the story of Cher Ami, a first world war messenger pigeon, used here to tease out information’s fundamental slipperiness. As in previous books, he relies heavily on lists (“the two main challenges,” “the five basic principles”) and binaries (truth versus order, democracy versus dictatorship), but this serves to organize his thinking rather than dull the writing.
The solutions he proposes to restrict AI’s power range from the sensible (ban bots from impersonating humans) to the laughable (encourage artists and bureaucrats to “cooperate” to help the rest of us understand the computer network), but Nexus operates primarily as a diagnosis and a call to action, and on those terms it’s broadly successful. If it sells anywhere near as well as Sapiens did, we’ll be that bit better equipped as a species to deal with the rise of the machines.
Sept.16 to Sept. 22 The “anti-communist train” with then-president Chiang Kai-shek’s (蔣介石) face plastered on the engine puffed along the “sugar railway” (糖業鐵路) in May 1955, drawing enthusiastic crowds at 103 stops covering nearly 1,200km. An estimated 1.58 million spectators were treated to propaganda films, plays and received free sugar products. By this time, the state-run Taiwan Sugar Corporation (台糖, Taisugar) had managed to connect the previously separate east-west lines established by Japanese-era sugar factories, allowing the anti-communist train to travel easily from Taichung to Pingtung’s Donggang Township (東港). Last Sunday’s feature (Taiwan in Time: The sugar express) covered the inauguration of the
The corruption cases surrounding former Taipei Mayor and Taiwan People’s Party (TPP) head Ko Wen-je (柯文哲) are just one item in the endless cycle of noise and fuss obscuring Taiwan’s deep and urgent structural and social problems. Even the case itself, as James Baron observed in an excellent piece at the Diplomat last week, is only one manifestation of the greater problem of deep-rooted corruption in land development. Last week the government announced a program to permit 25,000 foreign university students, primarily from the Philippines, Indonesia and Malaysia, to work in Taiwan after graduation for 2-4 years. That number is a
In a stark demonstration of how award-winning breakthroughs can come from the most unlikely directions, researchers have won an Ig Nobel prize for discovering that mammals can breathe through their anuses. After a series of tests on mice, rats and pigs, Japanese scientists found the animals absorb oxygen delivered through the rectum, work that underpins a clinical trial to see whether the procedure can treat respiratory failure. The team is among 10 recognized in this year’s Ig Nobel awards (see below for more), the irreverent accolades given for achievements that “first make people laugh, and then make them think.” They are not
This Qing Dynasty trail takes hikers from renowned hot springs in the East Rift Valley, up to the top of the Coastal Mountain Range, and down to the Pacific Short vacations to eastern Taiwan often require choosing between the Rift Valley with its pineapple fields, rice paddies and broader range of amenities, or the less populated coastal route for its ocean scenery. For those who can’t decide, why not try both? The Antong Traversing Trail (安通越嶺道) provides just such an opportunity. Built 149 years ago, the trail linked up these two formerly isolated parts of the island by crossing over the Coastal Mountain Range. After decades of serving as a convenient path for local Amis, Han settlers, missionaries and smugglers, the trail fell into disuse once modern roadways were built