Opinion: When will machine-like thinking prompt moral panic?


In Frank Herbert’s “Dune” series (my favorite-science fiction books), he made a bold writerly decision. In a genre famous for robots and computers (particularly in the 1960s), Herbert imagined a futuristic universe with neither. In his telling, some 10,000 years prior to the story of the book, there was galactic revolt called the Butlerian Jihad. This is where I first learned the word “Jihad” — the Arabic term for Islamic holy war.

It can all get fairly nerdy, but the gist is that artificially intelligent computers and androids were banned. In one explanation, the Butlerian Jihad was named after a woman, Jehanne Butler, whose baby had been aborted without her permission because an artificially intelligent computer deemed the child unworthy of life. The resulting outrage led to a mass revolt, the banning of thinking machines and a new religious commandment: “Thou shalt not make a machine in the likeness of a human mind.”

This idea has always stuck with me because of the fresh venues it opened in the genre and also for political and sociological reasons.

The phrase “moral panic” is almost always used derisively, to suggest an irrational overreaction by people giving over to the mentality of the mob. When the media agrees with a moral panic — say, on guns — the last thing they do is call it one.

But whether you call it a moral panic, a righteous people-powered movement or some other term of art, such visceral mass reactions are inevitable and perhaps necessary.

I got to thinking about this as two stories from Britain and one from China made waves here in the U.S.

A driver in North Yorkshire, England, fitted his car with a laser jammer that blocked speed cameras from giving him a ticket. He also showed the traffic camera his middle finger. The North Yorkshire police tracked him down, and he was charged with “perverting the course of justice.” The jammer was illegal, and he probably deserved a fine. But because he flipped Big Brother the bird, he got eight months in jail.

As outrageous as that story is, it pales in comparison to the story of Alfie Evans, a 23-month-old British boy with a rare neurodegenerative disorder. His doctors and the National Health Service concluded they couldn’t do anything more for him and, against his parents’ wishes, took him off life support. A Vatican hospital was eager to take him, and his parents were even more eager to transfer him there. The state refused, essentially kidnapping the child. The British courts support the NHS, offering not legal or moral rationales but sickening pabulum about the desirability of euthanasia or in this case infanticide. There’s also much talk about how the NHS works with finite resources and is compelled by economic math to make hard decisions. The story is actually much more cruel in the specifics, but you get the point.

And that leads me to the third story. China made it official: By 2020, the government will fully implement a “social credit score” system that will use artificial intelligence and facial recognition technology to monitor, reward and punish virtually every kind of activity based upon ideological criteria — chiefly, loyalty to the state.

It doesn’t take a science-fiction writer to imagine where these trends can go. AI systems can send people to jail and make decisions about withholding care quite easily. Just ask the Chinese.

In the fourth installment of the “Dune” series, one of the characters explains why the Butlerian Jihad was necessary. “The target of the Jihad was a machine-attitude as much as the machines,” Leto Atreides explains. “Humans had set those machines to usurp our sense of beauty, our necessary selfdom out of which we make living judgments.”

That process seems well underway already, and I wonder what it will take before we get the moral panic we need.

Writes for Tribune Content Agency.



Reader Comments


Next Up in Opinion

Opinion: Trump in 2019: Untamed or contained?

In this dark time of the year, usually a pretty slow period for politics, I like to write a column cataloging my errors of analysis and prognostication from the previous 365 days. This year, though, the pace of news makes that exercise feel a little self-indulgent, so I thought I’d just consider what has changed in the Trump presidency since...
Opinion: Staying Catholic at Christmas

At Mass this Christmas Eve, many Catholics who have spent a year reading headlines about abusive priests, indifferent bishops, predatory cardinals and Vatican corruption will sit and hear the long roll of Jesus’ ancestors with which the Gospel of Matthew begins. “Unless you like stats / just skip the begats,” wrote Jeanne and William...
Opinion: The return of paganism

Here are some generally agreed-upon facts about religious trends in the United States. Institutional Christianity has weakened drastically since the 1960s. Lots of people who once would have been lukewarm Christmas-and-Easter churchgoers now identify as having “no religion” or being “spiritual but not religious.” Religious belief...
Who gets to be an American anyway? 
Who gets to be an American anyway? 

What is an American anyway? I’ve always known that the late President George H.W. Bush was a good American and it is not because I necessarily agreed with his policies or politics. Politics and policies are beyond the point when it comes to the question. Apple pie is mighty good, but there is more than one kind of pie in this world. Maybe it...
Opinion: Katy Tur, France’s riots and panic mode

NBC’s Katy Tur, responding to an article in the New Yorker about climate, looked into the camera and asked, “How pointless is my life? And how pointless are the decisions that I make on a day-to-day basis when we are not focused on climate change every day, when it’s not leading every one of our newscasts?” It’s a safe...
More Stories