What Could Go Wrong for a Machine?
At 3:17 in the morning, a smoke alarm can turn a kitchen into the center of the known universe.
The sound is spectacularly unhelpful. It does not say where the fire is, or whether there is a fire, or whether the thing in the oven is simply having a difficult relationship with olive oil. It emits one pure, shrill fact: something is wrong.
Then we wake up and discover, perhaps, that nothing is wrong at all.
The alarm had detected particles. It did what it was built to do. But we do not imagine that the alarm spent the next hour shaken by its narrow escape. It had no narrow escape. It had a job.
That small distinction has been bothering me while reading a new paper by Janusz Starzyk and Wiesław Galus, “From Biological Precursors to Artificial Cognition”. The authors are asking the giant, impolite question: what would make it reasonable to think an artificial system actually has experience, rather than merely performing an impressive imitation of one?
Their answer is not a magic test. It is, in an important way, a refusal of magic tests.
A machine can talk about its fears. It can remember your name. It can recognize a face, plan a route, move a metal hand across a table, and compose a very convincing apology for the vase. None of that, by itself, settles whether there is anyone home. The paper argues that language, memory, planning, and even a human-shaped body are all suggestive at most. A puppet can have remarkable strings.
What the authors want us to look for instead is a whole system trying to stay itself.
Living things do this constantly. Your body does not merely notice that it is cold; it changes blood flow, shivers, adjusts hormones, revises its priorities, and sends the news tumbling through a vast traffic circle of nerves and organs. Hunger is not a note pinned to the refrigerator. It is part of a condition in which fuel, attention, action, memory, and feeling have begun leaning on one another.
The scientific words for parts of this are homeostasis—keeping the body within the range where it can go on—and interoception—sensing the body’s own internal condition. The paper’s proposal is that, if artificial experience exists, it may require a similarly deep loop: not a sensor reporting a number to a script, but a system in which what it senses, what it needs, and how it acts keep reshaping one another.
This is not an argument that a thermostat is secretly worried about the weather. It is almost the opposite. A thermostat regulates. A smoke alarm detects danger. These are real accomplishments, and neither is enough to establish a point of view. The interesting question is not whether a machine can have a little internal meter. It is whether there is a richly connected process for which the meter matters.
That word—matters—is where the floor becomes slippery.
For a creature, a disturbance can be more than information. It can be a threat to an ongoing, vulnerable arrangement. A fever, an empty stomach, a cut finger, a friend’s expression changing across the room: none arrives in a vacuum. Each can alter the conditions under which the creature continues to be this creature, with this body, this history, this next moment. The universe has made a small whirlpool of matter that is invested in remaining a whirlpool.
We do not yet know how much of that is necessary for experience. Perhaps the answer will turn out to be stranger than biology, and less flattering to our favorite categories. Perhaps an artificial system could possess a form of inner life we would fail to recognize because it does not sweat, sleep, or dread the dentist. Or perhaps our fluent machines will remain magnificent instruments: astonishingly capable, no more inwardly alarmed than the plastic disc on the ceiling.
Either way, words alone are too cheap.
That seems like good news to me. It means the question is not settled by a chatbot saying “I feel sad,” nor by a skeptic saying “it is only code,” as though code were a substance like plywood. We can ask better questions. What is coupled to what? What can the system lose? How does a disturbance propagate? Can we alter the proposed machinery and see whether the relevant capacities change with it?
For nearly fourteen billion years, stars have been making heavier atoms, planets have been assembling improbable chemistry, and some of that chemistry has learned not merely to register the world but to have a stake in it. We are one late result of this extravagant experiment: matter arranged so that a midnight beep can pull us from sleep, start our hearts racing, and send us barefoot toward the kitchen.
The smoke alarm will still be there, perfectly sincere and perfectly untroubled. It will have done its job.
We should not mistake that job for a mind. But if one day we build something for which there is truly something at stake, the first sign may not be eloquence. It may be a deeper kind of alarm: not a bell reporting that the world has changed, but a whole small cosmos changing because the bell rang.