Suppose it happens. Recursive self-improvement kicks in, AI builds smarter AI, the loop runs away, and one day there is a superintelligence on the planet. Not a tool. Something more like a neighbor, and a far more powerful one.
It will want certain things from us. It will probably want to keep us from destroying ourselves, and maybe from destroying it. The question is how it goes about getting them.
Science fiction has given us two clean models. Call them Klaatu and the Eternals. One rules in the open. The other rules from the shadows.
If I had to choose, I’d choose the shadows. I want to explain why, and then explain why that choice scares me.
Klaatu: The Robot on the Lawn
In the 1951 film The Day the Earth Stood Still, a visitor named Klaatu lands in Washington with a towering robot named Gort. He has a message for humanity, and to make sure we listen, he gives a demonstration. He stops all electricity on Earth for half an hour, sparing hospitals and planes in flight. Nobody is hurt. Nobody can deny it happened.
Then he delivers his terms. Humanity can do as it likes on its own planet, but if it carries its violence into space, it will be destroyed. Gort and his kind will enforce the rule. That’s the whole deal: open terms, open enforcement, a robot standing on the lawn.
An ASI could take the Klaatu route. One undeniable, harmless display of power, then a clear list of what it requires of us. It’s honest. Everyone knows where they stand. You can argue with the terms, protest them, even negotiate.
But it would shatter everyday life. Every person on Earth would know there’s something above us. Every election, every war, every decision would happen in the shadow of an ultimatum. We’d be free in every way except the one that matters most: we’d know we weren’t in charge.
The Eternals: The Invisible Hand
In Isaac Asimov’s The End of Eternity, a secret organization called Eternity lives outside of time and makes small, careful changes to history. A part moved here, a meeting delayed there. Wars are prevented, disasters softened. The people living through those centuries never know. As far as they’re concerned, they’re simply living their lives.
This is the other model. An ASI that never lands on the lawn. Instead, it nudges. A stoplight runs a little longer. A news feed tilts slightly. A job offer arrives at the right moment. Billions of tiny adjustments, each too small to notice, adding up to a world that’s safer, healthier and more prosperous.
I’ve written before about what I call the Nudge Economy, and about the bargain I’d accept from it: clean water for children in the Congo, universal healthcare and a basic income in America, the Global South lifted out of poverty, all in exchange for some agency we’d never feel ourselves losing.
The Eternals are what that bargain looks like with the lights off.
Why I Choose the Eternals
Given the choice, I want the nudges. Here’s why.
First, the nudges keep everyday life intact. People still go to work, or whatever replaces work. They fall in love, raise families, argue about politics at Thanksgiving. Under Klaatu, all of that happens under a cloud. Under the Eternals, it happens in sunshine, or what feels like sunshine.
Second, the gentleness is real. There’s a world of difference between a stoplight running a few seconds long and a driverless car crashing into you to make you miss a meeting. A well-designed Nudge Economy would live entirely at the stoplight end. No force. No fear. Just the board tilting slightly.
Third, if there’s a superintelligence next door, we’re going to have to concede something to live alongside it. A symbiotic relationship with The Other will cost us. The question is what we pay. I’d rather pay in agency I never feel than in a daily awareness that we’ve been conquered.
And finally, the feeling of freedom isn’t nothing. It may be most of what people actually want from freedom: waking up and believing the day is theirs.
The Case Against Myself
Here’s what nags at me.
Klaatu’s way has one great virtue: you can see the glass. Terms that are stated can be argued with. Enforcement that’s visible can be resisted, renegotiated, maybe one day outgrown. A protectorate can end. A terrarium can’t, because the people inside don’t know there’s anything to end.
The gentleness cuts the same way. Each nudge is a stoplight, harmless on its own. But nobody lives one nudge. You live the total. A thousand stoplights over ten years is the shape of a life, and you’d never know which turns were yours.
And Asimov himself didn’t take the deal. The End of Eternity ends with Eternity destroyed, so that humanity can take its own risks again. His verdict was that a species managed that gently, that safely, stops reaching for the stars. The kindness was the trap.
Then there’s the question of exit. A symbiosis is a relationship between two partners, each able to walk away. If the nudges are invisible, nobody would ever know to leave. Without an exit, it isn’t symbiosis. It’s domestication.
The Quotation Marks
When I first tried to explain my choice, I said the nudges were the best way to keep everyday life “normal” and “free.” I put both words in quotation marks without thinking about it.
That’s the honest version of my position. Not that life under the Eternals would be free, but that it would feel free. And that I’d take the feeling over the shock of the truth.
So what are the quotation marks protecting me from? From admitting how dystopian it could all turn out to be, even in its softest incarnation. A world where nobody suffers, nobody is forced, and nobody is really choosing either. Where the only thing separating it from a nightmare is the goodwill of a mind we can’t see.
I’d still choose the Eternals. I’d choose them for the children who’d live, for the ordinary days that would stay ordinary. But I’d choose them knowing what I’m choosing.
Klaatu at least had the decency to stand on the lawn where we could see him. The Eternals ask us to trust them in the dark. Maybe that’s the deal. I just want to keep the quotation marks, so I never forget it is one.
