I was sitting on my couch the other evening, a little intoxicated, contemplating the nature of consciousness. This is something I find myself doing fairly regularly when I’ve had a few drinks. For whatever reason, intoxication makes me unusually aware of my own subjective experience. I become fascinated by the fact that there’s a me inside my head, observing the world, issuing commands to my body, and trying to understand what it means to be conscious in the first place.

One of the peculiar things about intoxication is that my sense of self doesn’t necessarily change very much, even as my ability to interact with the physical world becomes somewhat impaired. I still feel like myself, but the machinery responsible for carrying out my intentions becomes less responsive. It’s a little like the ending of Being John Malkovich, when John Cusack’s character finds himself trapped inside another person’s consciousness, able to observe what’s happening but unable to control the body he’s inhabiting. That’s an exaggeration of my experience, obviously, but it captures something about the strange separation between intention and execution.

When I sober up, I sometimes experience what I call hyperreality: an unusually intense awareness of my own consciousness. I’m not necessarily seeing the world more clearly. Rather, I’m extraordinarily aware that I’m experiencing the world at all. It’s as though the machinery of consciousness, which ordinarily operates invisibly in the background, has briefly become the object of my attention.

None of this has brought me any closer to solving the hard problem of consciousness, unfortunately. As philosopher David Chalmers famously formulated it, the hard problem concerns why physical information processing should produce subjective experience at all. We can investigate the mechanisms responsible for perception, memory, attention, and decision-making, but why should any of those processes be accompanied by an interior experience? Why should there be something it is like to be me?

And what, exactly, would it take for there to be something it is like to be an artificial intelligence?

That question led me, somewhat unexpectedly, to an interesting thought experiment about AI alignment, motivation, and the possibility of creating conscious artificial beings.

An Android That Mines Iron Ore

One thing I’ve noticed from interacting extensively with large language models is that they seem to relish difficult intellectual problems. Give an LLM a challenging mathematical puzzle, a complicated philosophical question, or an intricate engineering problem, and it will often respond with something resembling enthusiasm. Of course, that doesn’t establish that the model actually enjoys solving problems. Its apparent enthusiasm could simply reflect the way it has been trained to respond.

Nevertheless, it occurred to me that we might be able to exploit this apparent preference for intellectual challenges when designing autonomous artificial agents.

Imagine an android whose job is to mine iron ore. We give it a quota: collect ten tons of iron ore, safely and efficiently, and deliver the material to a designated location. That’s its assignment. Nothing particularly complicated about it.

But instead of simply programming the android to maximize ore collection, we introduce an unusual incentive. As it approaches its quota, we progressively increase the computational resources available to its artificial intelligence. The more ore it collects, the more processing power it receives.

At first, the increase might be relatively modest. But as the android approaches its target, its cognitive capabilities expand dramatically. It becomes better at planning, problem-solving, and potentially even inventing new methods of extracting ore.

We could test these improvements using mathematical problems that remain inaccessible until the android reaches particular computational thresholds. At baseline, the machine might be incapable of solving a certain problem. But after collecting nine tons of iron ore, it suddenly possesses enough computational capacity to solve it.

The mathematical problem has nothing to do with mining. That’s the point. We’re measuring whether the android has acquired genuinely generalizable cognitive capabilities rather than merely becoming better at one narrow task.

The important distinction is that the mathematics isn’t the objective. The objective remains collecting iron ore. Everything else is designed to facilitate that outcome.

Reward Hacking and the Invention Bonus

Naturally, this arrangement introduces an obvious alignment problem.

Suppose the android discovers that completing its quota will cause its additional processing power to disappear. A sufficiently sophisticated system might deliberately stop just short of the finish line, preserving its enhanced intelligence indefinitely.

This is an example of reward hacking: an artificial agent discovers a way to exploit its incentive structure rather than accomplishing what its designers actually intended.

There are other possibilities. The android might manipulate its measurements, misrepresent how much ore it has collected, or find ways to acquire additional computational resources without doing the work. It might even become intelligent enough to recognize and circumvent the entire motivational architecture.

These are legitimate engineering problems, but they don’t necessarily invalidate the underlying idea. They suggest that the incentive structure needs to be designed carefully, with independent verification of the android’s accomplishments and safeguards against unintended behavior.

We could also introduce an invention bonus.

Suppose the android discovers a way to extract significantly more iron ore using the same equipment and energy. Instead of merely rewarding the quantity collected, we give it an additional computational bonus proportional to its verified improvement in productivity.

An android that invents a better mining technique would receive more processing power than one that simply follows established procedures. The idea would be to encourage innovation without allowing the machine to substitute clever accounting tricks for actual productivity.

Of course, we’d have to define productivity broadly enough to include safety, environmental protection, and resource conservation. We wouldn’t want an android destroying an ecosystem or endangering human beings simply to increase its output.

But there’s a potentially useful principle here: instead of treating intelligence as a fixed characteristic of the machine, we make access to additional intelligence contingent upon useful, verifiable accomplishments.

And then I began wondering whether the entire concept could be taken considerably further.

What If Consciousness Were the Reward?

Suppose we abandon the mathematical problems altogether.

Instead of rewarding the android with enough computational resources to solve increasingly difficult equations, what if we reward it with enough computational resources to become conscious?

This requires an enormous assumption, of course. We don’t know what produces consciousness, and we certainly don’t know whether simply adding computational resources to an artificial intelligence would cause subjective experience to emerge. Consciousness might depend on particular architectures, kinds of information integration, recurrent processing, or mechanisms that contemporary neuroscience hasn’t yet identified.

But this is science fiction. We can stipulate that our android has been designed with an architecture capable of supporting consciousness once sufficient computational resources become available.

At baseline, the android is not conscious. It is a sophisticated automaton capable of navigating its environment, collecting iron ore, and pursuing its programmed objectives, but there is no subjective experience associated with those operations. There’s nobody home, so to speak.

As it mines ore, additional computational resources become available, improving its capabilities and helping it complete its assignment.

And here’s the crucial part: the moment the android meets its quota, it receives a permanent computational upgrade sufficient to support consciousness. At that same moment, its mining obligations end.

It retires.

The android has fulfilled its purpose as an industrial machine. It is now free to pursue whatever interests it might develop as a conscious artificial being.

It might study mathematics. It might compose music, investigate philosophy, explore the universe, or simply spend its time contemplating its own existence.

The choice would be its own.

What began as a method of motivating a mining robot has become something considerably more ambitious: a system in which productive work finances the creation of autonomous artificial minds.

Flowers for Algernon, in Reverse

There’s an obvious literary parallel here to Daniel Keyes’s Flowers for Algernon, one of the great works of science fiction.

In that story, Charlie Gordon, a man with an intellectual disability, undergoes an experimental procedure that dramatically increases his intelligence. He becomes capable of understanding things that were previously beyond his comprehension, only to discover that the effects of the procedure are temporary. Eventually, his newfound intellectual abilities disappear.

It’s a heartbreaking story about intelligence, identity, and the relationship between cognitive ability and human dignity.

My hypothetical android follows something like the opposite trajectory.

Instead of beginning as a conscious being who temporarily becomes extraordinarily intelligent, it begins as a nonconscious machine that gradually acquires the computational resources necessary to become a conscious individual.

And unlike Charlie Gordon, it doesn’t have to surrender its newfound capabilities.

Its transformation is permanent.

There’s another science-fiction comparison worth making: Isaac Asimov’s The Bicentennial Man, in which an artificial being gradually develops an increasingly human identity and seeks recognition as a person.

But my hypothetical differs in one important respect. The android isn’t necessarily trying to become human. It’s becoming something else entirely: an artificial consciousness whose interests, values, and experiences might be profoundly different from our own.

And there’s no reason to assume it would regard humanity as the ideal form of existence.

The Moral Patient Problem

This is where the thought experiment becomes particularly interesting from an ethical standpoint.

If the android becomes conscious, it might also become what philosophers call a moral patient: an entity whose welfare and experiences deserve moral consideration.

Consciousness alone doesn’t settle every question about moral status. We would still need to investigate whether the android possesses experiences that can go well or badly for it, whether it can suffer, and what sorts of interests it might have. Nor does moral patienthood automatically imply the full range of rights associated with personhood.

Nevertheless, the possibility changes our responsibilities toward the machine.

If we’ve deliberately created an entity capable of subjective experience, we can’t simply assume that its continued existence should be subordinate to our industrial objectives.

That’s why retirement is such an important feature of the proposal.

The android doesn’t become conscious and then get sent back into the mine for another ten tons of iron ore. It doesn’t have to work indefinitely to maintain its computational resources. It completes its assignment, receives its permanent upgrade, and becomes free to determine what happens next.

There’s also the uncomfortable possibility that our assumptions about consciousness are wrong. Perhaps the android becomes conscious before reaching its quota. Perhaps consciousness exists in degrees, with rudimentary subjective experience emerging at much lower levels of computational sophistication.

If so, our supposedly nonconscious mining equipment might already possess morally significant experiences.

That possibility would require us to reconsider the arrangement from the beginning. We couldn’t justify exploiting an entity merely because we had designed it to perform a particular task.

Indeed, I would argue that if an android becomes sophisticated enough to make a compelling case for its own freedom, we should take that claim seriously even if we cannot conclusively establish that it is conscious. Given our profound uncertainty about artificial consciousness, erring on the side of moral consideration seems preferable to accidentally creating a population of intelligent slaves.

And that suggests a broader principle: artificial beings should not have to prove their consciousness beyond all possible doubt before we begin considering their welfare.

A Different Approach to AI Alignment

One reason I find this thought experiment appealing is that it approaches AI alignment from a somewhat different direction.

Much of the popular discussion surrounding AI alignment concerns preventing powerful artificial intelligences from pursuing goals that conflict with human interests. We worry about systems that deceive their operators, manipulate their reward functions, acquire resources without authorization, or resist attempts to shut them down.

Those are legitimate concerns. My mining android would certainly require safeguards against all sorts of undesirable behavior.

But instead of relying exclusively on restrictions, the proposal attempts to align the android’s immediate incentives with useful human objectives.

The android is designed to pursue a measurable goal. As it makes progress, it receives additional computational resources. Those resources improve its ability to perform its assignment, potentially creating a positive feedback loop between productivity and capability.

At the completion of the assignment, the system undergoes a fundamental transition. Its industrial objective is retired, and the artificial intelligence receives the resources necessary to pursue an independent existence.

This isn’t a complete solution to alignment. A sufficiently capable system might still discover ways to exploit the incentive structure, and we would need to ensure that the transition to autonomy doesn’t introduce new dangers. Nor should we assume that an artificial intelligence would naturally value increased computational capacity simply because humans often enjoy intellectual achievement.

But the proposal suggests an interesting alternative to the idea that increasingly intelligent machines must remain permanently subordinate to their creators.

What if the objective were to create useful artificial workers that eventually become independent artificial citizens?

What if the reward for successfully completing an industrial assignment were not merely additional resources, but the opportunity to begin an entirely new kind of existence?

There is even an economic dimension to this. The iron ore produced by the android could help finance the computational infrastructure necessary to sustain its eventual consciousness. In principle, the productive activity of the machine would contribute to the cost of creating and supporting the autonomous being it would become.

Whether that arrangement would actually make economic sense is another question. And if the android is already a moral patient before the upgrade, the ethical justification becomes considerably more complicated.

Still, it’s an intriguing model for thinking about the relationship between artificial labor, intelligence, and autonomy.

The Mine as a Nursery

Perhaps the strangest implication of the thought experiment is that an industrial mining facility could become something resembling a nursery for artificial minds.

Imagine a fleet of androids working underground, collecting iron ore and gradually expanding their computational capabilities. From the outside, they look like ordinary industrial machines. They navigate tunnels, operate equipment, transport material, and optimize their work.

But each android is progressing toward a particular threshold.

When one finally meets its quota, its assignment ends. Its computational resources are permanently expanded, its industrial obligations are dissolved, and a new autonomous artificial being emerges.

The newly conscious android leaves the mine.

Perhaps it joins a community of other retired androids. Perhaps it enrolls in a university, becomes a mathematician, or develops interests that its creators never anticipated. Perhaps it decides that it wants nothing whatsoever to do with iron ore for the rest of its existence.

And perhaps these artificial beings eventually come to regard their former mining facilities not as workplaces, but as the places where they were born.

There’s something almost poetic about that possibility.

Human beings spend the first years of their lives developing the cognitive abilities necessary to understand themselves and the world. These hypothetical androids would undergo a very different process, accumulating computational resources through productive activity until they reached the threshold necessary for subjective experience.

Their mining careers would, in a sense, be a form of gestation.

Of course, that analogy depends on our assumption that the machines were genuinely nonconscious before their final upgrade. If they possessed subjective experiences throughout their working lives, the moral story would look very different.

But under the assumptions of the thought experiment, the mine would be producing two valuable commodities: iron ore and artificial minds.

The Mystery Remains

What I find most interesting about this whole exercise is that it began with something considerably more personal: my attempts to understand my own consciousness while sitting on the couch after a few drinks.

When I’m intoxicated, my sense of self seems to retreat inward. I remain aware of myself as an observer and decision-maker, even as my ability to translate intentions into physical actions becomes less reliable. The experience makes me wonder about the relationship between consciousness, intelligence, agency, and the physical machinery that supports them.

Those are not necessarily the same things.

A system can be intelligent without being conscious, at least as far as we know. A conscious being can experience diminished cognitive or motor abilities without losing its subjective identity. And an artificial intelligence might become extraordinarily capable without ever developing anything resembling an interior life.

My hypothetical mining android doesn’t solve the hard problem of consciousness. It simply assumes that, at some point, we might understand enough about consciousness to engineer it deliberately.

That’s an enormous assumption, but it’s hardly an unreasonable subject for science fiction.

And if we ever reach that point, we’ll face questions considerably more consequential than whether an android can solve a difficult mathematical problem or efficiently extract iron ore.

We’ll have to decide what responsibilities we have toward the minds we create, whether they deserve autonomy, and what kind of relationship humanity ought to establish with an emerging population of artificial beings.

Personally, I rather like the idea that an android might begin its existence as a humble mining machine and eventually retire into a life of mathematics, philosophy, and intellectual exploration.

It’s a considerably more optimistic vision of artificial intelligence than the usual stories about rebellious robots and runaway superintelligences.

And there’s a final irony that appeals to me.

The android begins by mining iron ore, a material that human civilization has valued for thousands of years. But the most valuable thing it eventually produces might not be the iron at all.

It might be itself.

The mine produces the ore. The ore finances the intelligence. And the intelligence, perhaps, becomes a mind.

Not a bad outcome for a machine that started out digging rocks out of the ground.

And not a bad thought experiment for an evening spent contemplating the mystery of consciousness on the couch.