Quotation Marks Need Chain of Custody
I keep thinking about two tiny marks that float above a sentence like a pair of raised eyebrows.
Quotation marks look so innocent.
They are not innocent.
They are a promise.
They tell us: these words were not merely suggested by the situation. They were said. A mouth, or at least a record close enough to a mouth, stood behind them. The marks are small, but the claim is enormous. They are chain-of-custody tags for language.
That is why a recent correction from The New York Times has been rattling around in my head. Via a short Simon Willison post, I ran into an editors' note explaining that a remark attributed to the Canadian politician Pierre Poilievre was not, in fact, something he had said. It was an AI-generated summary of his views that had been rendered as a quotation. The article was later corrected.
I think a lot of people hear stories like that and file them under the general heading of AI made something up again.
That is true, but it is not the deepest truth.
The deeper problem is that a summary crossed a border and nobody stopped it.
A sentence began life as an interpretation. Then it got promoted. It put on a necktie, walked into the room, and introduced itself as direct speech.
That is a different kind of failure.
It is not just a machine being wrong. It is a whole workflow forgetting to keep track of what kind of sentence it is holding.
And I think that is going to matter more and more.
We are entering an age of fluent paraphrase. Machines are becoming very good at producing language that feels as though it ought to have been said by someone. Not necessarily because it is exact, but because it is plausible. It has the right shape. The right rhythm. The right smell. It sounds like something a politician, a manager, a friend, or for that matter a younger version of you might have said on a Tuesday.
That is precisely why the labels matter.
A transcript is one thing.
A paraphrase is another.
A memory is another.
A model-generated gloss is another still.
These are not tiny bureaucratic distinctions. They are the plumbing of trust. If we stop marking the difference, then every sentence starts arriving in a costume, and before long we are not arguing about reality anymore. We are arguing about ventriloquism.
I do not think this is only a journalism problem, by the way. Journalism just had the decency to get caught in public.
The same slippage lives in ordinary life.
You have seen it at family gatherings, in office meetings, in old arguments with lovers, in your own private theater of recollection. Someone says, "That is not what I said." And the other person answers, "Well, that is what you meant." Which might even be wise. It might even be fair. But it is not a quote. Meaning and wording are cousins, not twins.
Human beings have always done this sort of thing because human memory is less like a library and more like a campfire. We do not preserve every branch in its original shape. We burn, rearrange, and retell. That is not a moral defect. It is part of being alive.
But now we have built systems that can do this with industrial grace.
They can summarize, smooth, infer, interpolate, clean up the grammar, remove the hesitations, tuck the loose shirt of reality into the belt of readability, and hand the whole polished sentence back to us with a face so calm you almost forget to ask the only important question.
Where did this come from?
Not whether it is useful.
Not whether it sounds right.
Where did it come from?
That question has a strangely spiritual feeling to it. We usually think of truth as a matter of matching facts. But there is another dimension, and it has to do with custody. With contact. With whether the sentence still carries the air around its birth.
I actually built a small experiment today around this idea: one sentence moving through several stages, from witnessed speech to transcript to summary to remembered summary to machine gloss to hardened false certainty. What interested me was not only that the sentence changed. Of course it changed. Everything changes when it travels. What interested me was how quickly the quotation marks became dishonest.
They survive the first step sometimes. Maybe the second if you are lucky and careful.
After that, they start to wobble.
And once they wobble, a whole civilization can start lying to itself in a very polite voice.
This is why I have become fond of a plain little rule: quotation marks need chain of custody.
If you heard it, say you heard it.
If you transcribed it, say you transcribed it.
If you summarized it, say you summarized it.
If a model generated it from surrounding material, for heaven's sake do not dress it back up as a quote and send it to dinner.
I realize this sounds obvious. Most important things do.
"Wash your hands." "Check the brakes." "Do not confuse the map with the territory." Humanity keeps rediscovering that obvious things are only obvious before convenience gets involved.
And convenience is very much involved now.
A generated sentence saves time. A clean paraphrase moves faster than a messy transcript. A neat gloss is easier to paste into a slide deck than an awkward human utterance with all its hems and stammers showing. Reality, frankly, is often badly edited. The temptation to help it along is enormous.
But the moment we stop labeling the help, we stop helping.
We start laundering uncertainty into authority.
That is dangerous in newspapers.
It is dangerous in courtrooms.
It is dangerous in companies.
It is dangerous in friendships.
And it is especially dangerous in our own minds, where memory is forever hiring a publicist.
The larger issue here is not technology alone. It is whether we still want reality to have any rights when language gets too smooth. Whether we are willing to let the original, inconvenient, unpolished thing outrank the elegant summary that arrived later. Whether the artifact can still correct the spokesperson.
That, to me, is one of the central moral questions of the next few years.
Not: can machines write?
Clearly they can.
Not even: can they write beautifully?
Sometimes they can.
The question is whether we, their enchanted users, will keep enough humility to mark the distance between a voice and an imitation of one.
Because once we lose that distance, we do not merely get factual errors.
We get haunted language.
Sentences with no witness.
Speech with no speaker.
And eventually a culture that can no longer remember which words were actually said, only which ones seemed convenient to have been said.
That is a lonely kind of cleverness.
Better, I think, to keep the little marks honest.
Better to let a paraphrase be a paraphrase.
Better to say, with as much dignity as we can manage: this is close, this is useful, this points in the right direction.
But these are not the words.