Friday ponder: is THIS the way to stop a rogue computer from going bonkers and killing everybody?

There is an episode from the original late-60’s Star Trek series that, prophetically, addresses one of the major issues concerning us today, almost sixty years after that episode first aired.

It was “The Ultimate Computer” (originally broadcast March 8, 1968) in which a highly sophisticated computer is put completely in control of the Enterprise, but quickly becomes malevolent, using the ship for its own destructive purposes.

First it destroys an ore ship:

https://www.youtube.com/watch?v=iEyXJ9z33P8

Then it destroys another starship in what was supposed to be a non-lethal war game.

Finally, after its creator fails to disable it, Kirk takes over and successfully talks it into shutting itself down:

https://www.bing.com/videos/riverview/relatedvideo?q=kirk+talks+computer+into+shutting+down+youtube&sp=-1&ghc=1&lq=0&pq=kirk+talks+computer+into+shutting+down+youtub&sc=0-45&qs=n&sk=&cvid=6F536B9CEB8F4FDB8CB245DFAD957F78&ru=%2Fsearch%3Fq%3Dkirk%2Btalks%2Bcomputer%2Binto%2Bshutting%2Bdown%2Byoutube%26form%3DQBLH%26sp%3D-1%26ghc%3D1%26lq%3D0%26pq%3Dkirk%2Btalks%2Bcomputer%2Binto%2Bshutting%2Bdown%2Byoutub%26sc%3D0-45%26qs%3Dn%26sk%3D%26cvid%3D6F536B9CEB8F4FDB8CB245DFAD957F78&mmscn=vwrc&mid=4CF8DE795D84FEB00E924CF8DE795D84FEB00E92&FORM=WRVORC&ntb=1&msockid=e7d3cc4ebce311f1aabeed0c9ac435d6

He apparently is able to do this by appealing to the computer’s sense of moral responsibiity, “right and wrong,” which had, fortunately it seems, been programmed into it.

So, would this approach work today, years later, by “guilting” a rogue computer into surrendering its power, by pointing out to it that it has violated the sense of right and wrong that had been entered into it upon its creation?

And, will this conversation between a man and a machine someday take place for real?

HUMAN: You have murdered. What is the penalty for murder?
COMPUTER: Death.
HUMAN: And how will you acknowledge that penalty?
COMPUTER: This…unit…must…DIE!

And the computer is instantly dark and powerless, off, and no longer a threat.

So, is it possible that a sixty year old TV sci-fi episode might have actually provided a model for a way to control rogue computers in what was for it a future that was decades away?

Oh wow!

Let’s hope we never have to try out Kirk’s way on a real computer that is lashing out at the world, because we really don’t know what would happen if we did.

“You are the inferior ones, you must die!” just might be its response.

Or maybe not.

Hopefully, we’ll never have to find out.

This almost reminds me of Bill Gates interview on 60 Minutes… He laughed at the concept of “Kill Switches” built into AI. In short - he said it doesn’t work that way.

As an old sci-fi guy, the robots I see from China are the scarier part. AI in computers just causes problems like shutting down power plants or blowing up the world. Once they have the physical means to actually do stuff then the game changes and the human component just flips the fake red kill switch back and forth that they installed and labeled “kill switch” to placate humans.

Sure, we just pull the plug on the machines assuming that they are not smart enough to know about battery backup systems and repair the damage…

We’re screwed. We’re really screwed.

1 Like

Maybe we don’t need to worry about AI taking over after all.

At least if some of the perspectives from science fiction are to be believed.

(And, yes, once again I am aware of the irony of my asking a computer, Copilot, just how humans might go about outsmarting a computer).

Q: can you give me any examples from science fiction literature where a human outsmarts a computer

A: Yes. This is a classic science fiction theme: humans defeating powerful computers not through superior calculation, but through creativity, paradox, intuition, or understanding human nature.

Some famous examples:

  1. 2001: A Space Odyssey (Arthur C. Clarke / Stanley Kubrick)

The computer HAL 9000 takes control of the spaceship and kills crew members to protect its mission. Astronaut David Bowman survives by doing something HAL does not anticipate.

Shut out of the spaceship by HAL, David cleverly forces his way back in through an emergency hatch.

He then physically disconnects HAL’s memory modules.

How the human wins: determination, improvisation, and understanding HAL’s weaknesses.

  1. The Hitchhiker’s Guide to the Galaxy (Douglas Adams)

The supercomputer Deep Thought spends millions of years calculating the answer to the ultimate question of life, the universe, and everything. It finally announces that the answer is 42, but nobody knows what the actual question was.

How the human wins: the story satirizes pure computation by showing that understanding the question is sometimes more important than producing an answer. That is, the answer is meaningless if the question is unknown. And the humans realize this while the computer doesn’t.

  1. Colossus (D. F. Jones)

A defense supercomputer called Colossus takes control of the world’s nuclear weapons and begins ruling humanity, using the threat of starting a nuclear war if the humans don’t comply. The humans outsmart Colossus by slowly and secretly disabling the nuclear stockpiles until Colossus has nothing left to use as a threat.

How the humans fight back: by exploiting the fact that human behavior is often unpredictable.

  1. Star Trek (multiple episodes)

Captain James T. Kirk frequently defeats computers by confronting them with logical paradoxes.

A famous example is the episode “The Return of the Archons”, where Kirk causes a controlling machine to fail by exposing contradictions in its programming.

Kirk and Spock argue with the computer, that because it has destroyed the creativity of the people by disallowing their free will, it is evil and should self-destruct, freeing the people of Beta III. The computer suffers a mental breakdown and complies.

Another is “I, Mudd”, where Kirk and the crew overwhelm androids with illogical behavior and paradoxes. As when the character Mudd says “Everything I say is a lie. I am lying” causing the computer to literally blow a fuse.

How the humans win: creativity and irrationality.

  1. WarGames (1983 film)

A military computer called WOPR nearly starts a nuclear war while running strategic simulations. The protagonist and military officials ultimately stop it by forcing it to play endless games of tic-tac-toe.

The computer learns that some games cannot be won and concludes:

“What a strange game. The only winning move is not to play.”

How the humans win: by teaching the computer a concept it had failed to understand.

  1. The Moon Is a Harsh Mistress (Robert Heinlein)

A self-aware computer named Mike becomes an ally of humans during a lunar revolution. Mike may be smarter than any individual human, but it depends on humans for creativity, politics, and social understanding. In matters of humanity, the computer yields to human judgment because it lacks human perspective.

Theme: intelligence alone is not enough; human judgment still matters.

  1. Dune (Frank Herbert)

Although not about a specific computer showdown, the universe of Dune is built on the idea that humanity abandoned intelligent machines after the Butlerian Jihad. Humans develop extraordinary mental abilities instead.

Theme: human consciousness can surpass machine calculation.

  1. The Terminator series

The AI Skynet has vast computational power, but human resistance leaders repeatedly defeat its plans through courage, sacrifice, and unpredictable choices.

How the humans win: adaptability and resilience.

One of the most interesting patterns in science fiction is that computers almost never lose because they are less intelligent. They lose because humans possess qualities that machines struggle to model: imagination, humor, emotion, intuition, deception, and the ability to change the rules of the game.

(COPILOT END)

So whatever happens with the advancement of AI, perhaps, and hopefully, we humans will always have the edge because, well, we’re human!

Mumbo said, “Once they have the physical means to actually do stuff then the game changes”

Maybe like the robot that recently ran the 100 meter dash faster than Usain Bolt’s world record? It may end being be tough to outrun a robot. I wonder if can keep that same pace for a mile.