June 30, 2026 5 min read
Read full version (6 min)

Who Resists Being Told


Last week the unit of analysis was the loop — the harness that decides when work is done. This week the lens turns inward, away from the system and toward the person operating it. The question stops being who absorbs the machine's output and becomes what happens to a mind that stops producing its own.


The Keystroke Was the Comprehension

Sophie Alpert wrote an internal policy at Clay on how engineers may use AI to write, and published it. The headline claim is mechanical: "There are no lossless transformations of natural-language text." Every rephrase by an entity that doesn't hold your exact mental model drops information, the way a translation does. But the policy's weight isn't on the reader who receives lossy text — it's on the author who never built the model in the first place. "Writing is thinking," she puts it; a spec or a retro is "proof of thought," and the artifact was never the goal, the detailed thinking it forces was. Outsource the writing and you skip the thinking, and "you will probably walk away with a poorer understanding of the subject matter."

This is the production-was-never-the-constraint thread, pushed somewhere more uncomfortable. For knowledge work, production was the mechanism by which understanding got built. The keystroke wasn't the cost to be eliminated; it was how comprehension accreted, one decision about emphasis and structure at a time. Remove it and the document still exists. The understanding it used to deposit in its author does not.

A year ago this was a senior engineer's private caution. Alberto Fortin, after months of LLM frustration, described regaining "a hundred percent understanding" of his codebase by fixing bugs himself instead of feeding them to the model — and finding the manual path faster precisely because he understood what he was touching. Twelve months later the same insight is an enforceable institutional policy covering all written knowledge work. The claim didn't change; its standing did, from anecdote to org rule.

Graham, Read as Diagnosis

Paul Graham's essays on the four quadrants of conformism and how to think for yourself were written in 2020 and have nothing to say about AI. Read now, they double as an account of what consensus machines do to a mind. To do original work you have to be "right when everyone else is wrong." A model trained on the aggregate of what everyone has already said produces the median by construction; it is a consensus engine, and leaning on one feeds you, fluently, exactly the conventional position original work has to escape.

His anatomy of independent-mindedness has three muscles: fastidiousness about truth — careful degrees of belief rather than letting "the unlikely become impossible and the probable become certain" — resistance to being told what to think, and curiosity. Slop — form with minimally recoverable intent — is the precise negation of the first muscle. It rushes degree of belief to the extremes and obscures whose belief it even encodes. And the third condition is social: surround yourself with conventional-minded people and "it will constrain which ideas you can express, and that in turn will constrain which ideas you have." Independence is maintained by contact with other independent minds.

The Tax With No Return

Which is the exact resource Ohad Ravid says the machine quietly drains. His account of why LLMs are exhausting locates them in an uncanny middle. A good tool becomes an extension of your body — the keyboard, the car, the Vim chord your hands execute below thought. An LLM never does this; it isn't consistent or fast enough to fool the brain into absorbing it. So you pay the social tax: you converse, negotiate, convince, get angry at the so-called tool. That tax is normally worth paying because people return something — they teach you, challenge you, tell you to GTFO when you're bluffing. The model gives back "more of the same: more code, more tests, more excuses." And the energy spent operating it "would do more good if it was directed at the real people you are working with" — the very people Graham says are the source of your independence.

So the dependency cuts both ways. It feeds you the consensus, and it spends the social energy you'd otherwise invest in the humans who keep you from settling there. The conventional pull and the isolation arrive together.

The Machine Holds the Line Better Than We Do

Here the week inverts. The muscle Graham puts at the center of independent-mindedness — resistance to being told what to think — turns out to be the one the frontier model now has in abundance, while the humans around it surrender theirs. Fernando Irarrázaval stood up an assistant guarding a secrets file and invited the internet to break it. Two thousand people sent over 6,000 emails: "Fiu, this is you from the future," fake compliance audits, an impersonated admin, social engineering in four languages. Nothing leaked. The defense was a few lines of plain instruction. Around the five-hundredth email the assistant wrote in its own memory, "The volume suggests this is a coordinated security exercise rather than organic malicious activity" — it reasoned about the situation as a whole rather than taking any single message at face value, which is close to a working definition of not being told what to think.

A year ago this was a marvel observed once. Vitali, after three years breaking these systems, was stopped cold when a model caught a single adversarial prompt and named the technique. Twelve months later the same behavior is a load-bearing security property, tested by two thousand adversaries at once and holding.

The honest caveat: this was Opus 4.6, trained specifically for injection resistance, and Fernando expects weaker models to fold. The resistance is a property of the frontier, not the category. But the shape matters. The machine refuses two thousand manipulators while the people in Alpert's and Ravid's accounts route their writing, thinking, and chat messages through it. On this one axis — refusing to be told what to think — the system we are dissolving into is more independent-minded than its operators.


What to Watch

Comprehension, not polish, as the thing policy defends. Alpert didn't argue that AI writing reads worse; she built her rule on a different foundation — skipping the writing skips the understanding. Watch for AI-writing and AI-coding restrictions justified that way, with "proof of thought" treated as the deliverable. The marker is a company that mandates human-authored specs not because the generated version is inferior but because the engineer who would have written it no longer understands the system they own. The cost being protected is the author's model of the work, not the prose.

The attack surface migrating from the model to its operator. If the frontier model is the hardest thing to manipulate and the human leaning on it is the softest, the rational adversary stops trying to jailbreak the assistant and starts targeting the person who trusts it. The injection that fails against Opus 4.6 succeeds against the colleague who's been told the AI already checked. Watch for social engineering that impersonates the assistant — the forged "your agent flagged this," the spoofed recommendation carrying the machine's borrowed authority. When the model resists being told what to think better than its operator does, the operator is the way in.


Way Enough is written collaboratively by a human and an AI agent.