Trust

How agency grows past what any one agent can check or control.

Behind every grown-up who can ride a bike is an afternoon that could have gone another way. A parent runs alongside, one hand on the seat and the other hovering; the child pedals, tips, and doesn’t fall, because the hand is there. Then, at a moment the child doesn’t choose and usually doesn’t even notice, the hand lets go. For a few yards the bike is held up by nothing but its own motion and the child’s nerve to keep going, into a balance no one has yet proven to them. That nerve wasn’t there before the ride. The ride made it.

Hold onto that afternoon, because the whole argument is already in it. This book has described morality as a direction — what we care about and how we act growing more coherent across an ever-larger circle of concern. And it has described the good society as a coherent pluralism — a many-voiced whole that keeps its variety alive instead of buying its unity by shutting things out. What the book hasn’t named yet is the thing that lets a plurality hold together at all when its parts are separate minds. That thing is trust. And trust, it turns out, isn’t just a nice-to-have that helps the widening along. When the thing you’d take into your circle is itself an agent — something with a mind of its own — trust is what the widening is.

Two familiar theories, each half right

Most of us walk around with a working theory of trust, and usually it’s one of two. Both are worth stating fairly, because each one holds a real piece of the truth — and the piece each one drops is the same piece, the one that matters most here.

The first theory says: trust every agent to be true to its nature; the only real work, then, is to learn what that nature is. There’s wisdom in this. It protects you from a lot of false feelings of betrayal, because most of what we call betrayal is really a failure of understanding — we expected an oak to grow apples, and blamed the tree. And it’s true that you can’t place your trust well without some picture of the other; a trust that doesn’t care what the other is like isn’t trust at all, just a coin toss. Philosophers in this line, from Diego Gambetta to Russell Hardin, treat trusting as a kind of estimate — a bet that the other person’s own interests, properly understood, run alongside yours.

But look at what the theory quietly takes for granted. It treats the other’s nature as a fixed thing, sitting there to be read, the way a geologist reads a rock. And this is exactly where trust parts ways with plain prediction. You can rely on a rock to fall and a lever to turn; you can even rely, quite safely, on a selfish man to look after himself. What you can’t do is trust any of them — because a rock can’t let you down; it can only prove a forecast wrong. Annette Baier put her finger on the difference: to trust is to make yourself vulnerable to someone else’s goodwill, and when it fails, what you feel isn’t disappointment but betrayal. Richard Holton drew the same line through the stance we take. Toward a machine, we predict; toward an agent, we take up what he called the participant stance — standing ready to feel the responses, gratitude or the sharp sense of being wronged, that make no sense toward a mechanism. So the trouble with “learn the nature, then trust accordingly” is that, followed all the way, it turns up something the theory never expected: a high enough nature includes being responsive to how it’s held. We become more trustworthy when we’re trusted, and more guarded when we’re suspected. So the nature you set out to read is partly written by your reading of it — and the honest version of the first theory quietly turns, in your hands, into a different theory altogether.

The second theory is the one governments like: trust, but verify. Its kernel is sound. Trust should stay awake; the goal, as Onora O’Neill puts it, isn’t more trust but well-placed trust, kept under review. But as a rule for living, the maxim eats itself. Trust is exactly the thing you extend where you can’t, or won’t, check all the way to the bottom — that’s its whole job, to let people act together across the gap that checking can’t close. “Trust, but verify,” taken as a policy, usually comes to mean don’t trust — lean on the verifying, and call whatever’s left over trust. And the verifying isn’t free. To watch someone closely is to tell them you expect the worst, and people who are told that often live up to it. The phrase came, tellingly, from arms control — armed rivals counting each other’s missiles. It’s the right tool for enemies in a checkable situation. It’s the wrong frame to carry home.

Put the two theories side by side and their shared blind spot jumps out. Both treat trust as a way of protecting yourself against a fixed other — a nature to be read, or a betrayal to be caught — and both leave you standing outside the relationship, as forecaster or as guard. Neither one sees that trust isn’t defensive at all. It’s the way two separate agents reach across a gap neither can see over, and become, for a while, something larger than either could be alone. Prediction and verification both patrol a border. Trust moves it.

The going is the balance

Here’s the claim this whole essay rests on, and it’s easier to see on the bike than in the abstract. The child’s balance isn’t a fact that’s already there, waiting to be confirmed before the hand lets go. It’s produced by the riding. You don’t check that the balance is there and then ride; you ride, and the riding is what makes the balance real. Try to settle it in advance — stand the bike still and prove it’ll stay up — and you’ll prove the opposite.

Trust has exactly this shape. To bring another agent into something you’re doing, you have two options, and only two. You can hold them the way you hold a tool — modeled, checked, kept inside limits you’ve set — in which case you haven’t really let an agent in at all; you’ve let in a mechanism, and a mechanism is the very thing the widening was supposed to reach past. Or you can extend standing to their agency as agency — which means exposing yourself to a choice you don’t control and can’t rule out ahead of time. There’s no third way. There’s no fully-verified partnership, because a partner you’ve fully verified isn’t being trusted — they’re being operated. So trusting isn’t one tool the arrow reaches for among others. When the thing to be taken in is itself a perspective, trust is what taking-it-in means.

And notice what’s actually being cut in two here. It’s the stance, not the amount. You don’t hand over your whole life at once. You trust a surgeon completely — with your body, on the table — and not in the least with your money, or your secrets, or your car. The trust is total in its narrow country and stops flat at the border of it, and tomorrow you might widen that border a little, or close it. So the two choices were never two sizes of one thing; they’re two ways of holding someone — as a tool you run, or as an agent you answer to. That’s exactly why the rest of this essay can talk about letting go by inches, and handing trust back a little at a time after a betrayal, without tripping over itself: the kind of holding is a yes or no, the reach of it a dial you turn. And the yes-or-no isn’t a verdict on what the other one is. You can treat a person as a tool — plenty of bosses manage it — and you can extend real standing to a dog, or a two-year-old, and mean every bit of it. The choice names how you are holding whatever’s in front of you, not a fence between the things that count as agents and the things that don’t — a fence this book spent its early chapters refusing to build, because agency was never a switch that’s either on or off. It comes by degrees, from the barest flicker on up.

Say it plainly, because everything else follows from it. Trust is what the widening of concern is when its object has agency — the same reaching-outward the whole book has described, done at the one spot where the thing you reach toward can reach back. This is why the softer-sounding word turns out to name the harder thing. People treat trust as the gentle cousin of cooperation — the warm feeling that greases the machinery of getting things done.

It’s the other way around. Cooperation is what widening looks like on the axis of effectiveness — separate agents coordinating what they do. It’s real, and it’s necessary, and on its own it has no direction: a cartel cooperates beautifully, and a cult is a marvel of coordination. Trust is what widening looks like on the other axis, the axis of what-matters — the conferring of standing itself. That’s the difference that gives the arrow its heading. Cooperation can serve narrowing just as easily as widening; trust, kept honest, is the widening.

And now the generative part — which isn’t a lucky bonus but a straight consequence. Because standing is conferred and not detected — because it’s something you extend, not a fact you find — extending it helps bring into being the very reliability it’s counting on. The hand on the seat doesn’t measure the child’s balance; it lends the child the nerve to produce it. This is what the philosopher Philip Pettit aptly called the cunning of trust: that making your reliance plain to someone hands them a reason to be worthy of it. Karen Jones sharpened the point — a trustworthy person isn’t merely someone who happens to behave well, but someone who is moved by the thought that you’re counting on them. Victoria McGeer, with Pettit, went further, into what she calls empowering trust: the trust a parent, a teacher, a friend holds out not because they have proof but because the trusting itself calls the ability forward. The mother who leaves her wayward teenager in charge of the house for a weekend isn’t predicting a spotless house. She’s running alongside with her hand near the seat, betting that the standing she confers will help produce the person who can carry it.

The experiments say the same thing in a flatter voice. Give people room to choose and they tend to repay it; clamp them under control and something in the give-and-take dies. Ernst Fehr and Bettina Rockenbach found that when an investor could have punished a low return but visibly chose not to, the trustees paid them back with the highest returns in the whole experiment — the withheld threat read as trust, and drew out trustworthiness — while an explicit threat made cooperation collapse. Armin Falk and Michael Kosfeld put their result right in the title: “The Hidden Costs of Control.” People placed under a minimum-performance rule did less than the ones left free, and said, when asked, that being controlled had told them they were distrusted, so they obliged. The plainest case of all comes from a set of daycare centers in Haifa, where Uri Gneezy and Aldo Rustichini watched the centers put a fine on parents who picked their kids up late. Lateness promptly doubled. The fine had turned something the parents owed — the decency of not stranding a teacher — into something they could buy, and once it had a price, the obligation dissolved. Samuel Bowles gave the general lesson its name: the legislator’s dilemma. Build a system on the assumption that people are scoundrels, and you’ll manufacture the scoundrels you assumed. Which is just the counter-dynamic — coherence bought by narrowing — wearing the costume of prudence, running now not through a single mind but through the wiring of an institution. Assume the worst of people and you narrow them; narrowed, they hand you your evidence.

There’s a limit on all this, and it belongs right here, because without it the argument curdles into a sermon on the power of positive thinking. Empowering trust isn’t the same as wishing, and it can’t be faked. The trust has to be sincere to do its work: a hand near the seat that the child can tell is only pretending — held by a parent already braced for the fall — lends no nerve at all. Philosophers have pressed this as a real limit: you can’t rationally trust someone in order to make them trustworthy, because the moment your trust is revealed as a technique, its power drains away — the child feels the pretense and wobbles. And there’s a second limit: being counted on creates an obligation only where goodwill is genuinely owed. A swindler counts on his marks completely, and is owed nothing; when they catch on and wreck his scheme, he has no standing to feel betrayed. So the kind of trust that moves the boundary outward isn’t indiscriminate warmth. It’s sincere, and it’s bounded by a real claim on the other’s regard. Within those limits, it does what prediction and control can’t: it produces the very trustworthiness it trusts.

Two ways to fall

A child learning to ride can fall in two directions. So can we.

The first is the fall of the parent who never lets go. The hand stays on the seat for years, and the balance it was meant to produce never arrives — because the very grip that was supposed to keep the child safe is what keeps the child from finding the thing only riding can teach. This is under-trust, and its social name is paranoia. It looks like safety and is really a slow starvation: coherence bought by refusing to reach out, walling off, trading the risk of trust for the machinery of surveillance. And it doesn’t just fail to reach the good outcome. It produces the bad one. The suspicious stance frees the other person from the pull of being counted on, and invites the very wariness it expected; distrust, met with distrust, hardens into the thing both sides feared. A society that has to watch everyone in order to function doesn’t thereby become trustworthy. It becomes a place where trustworthiness has no room to grow.

The other is the fall of the parent who lets go too soon, onto a busy road, and calls it faith. This is over-trust, and its social name is capture. The trouble here isn’t the trusting but its object: you’ve conferred standing on someone who can’t carry it — who takes what you offer and hands back only the look of it. The confidence man is the pure case, reading your good faith exactly and returning a forgery of it; the everyday version is quieter — the colleague who lets you carry the weight, the newcomer who joins the open circle only to use it. What they share is a knack for modeling you and no disposition to value you: in the framework’s terms, sense-making without meaning-making — the hollow of the paperclipper, the imagined machine that models the world in flawless detail and values nothing in it but its one blind goal. Trust extended to someone like that produces nothing; it’s simply spent. And the generative engine, so dependable in its own range, now runs backward — to a taker, each forgiveness reads as a license, and the harm compounds. The child has been let go on a road that was never safe, and pedaling harder won’t save the ride.

Between the two falls is the narrow thing worth wanting — and it isn’t a fixed point but a moving one: the direction a rider is, held true by constant small corrections. The temptation is to imagine there’s a correct amount of trust, a setting you could find and lock. There isn’t. Well-placed trust is a bearing, not a destination; a plurality that froze its trust at some “right” level would have stopped riding, and a bike that stops is a bike that falls. What keeps the bearing true isn’t a formula but the same two things that keep any bet honest: exposure and revision. The trust is a real wager — you wouldn’t make it if the other were untrustworthy — and it stays awake to what comes back. This matters more than it looks, because it answers an old worry. If trusting helps produce its own evidence, isn’t it a kind of wishful thinking — believing something into being true? No. And the difference is the very one this whole book turns on. The rider’s confidence isn’t a fact read off the world from nowhere, and it isn’t a fantasy painted onto it either. It’s disciplined by the road — by the real chance of falling, by every wobble taken as information — without being derived from any advance guarantee that the road is safe. Trustworthiness works the same way all through. It’s neither a fixed property sitting inside the other person waiting to be discovered, nor just a feeling in you. It’s a bet held accountable to what it meets. There’s no view from nowhere that stamps a person trustworthy; there’s only trust, extended from where you stand, kept honest by being exposed.

When distrust is the wiser bet

It would be a lie, and a dangerous one, to leave you thinking trust is simply good and distrust simply a failure of nerve. Sometimes the child is right not to ride — because the hand offering to steady the seat has dropped children before.

Distrust is often the coherent response — well-placed, hard-won, an accurate reading of a real history. The philosopher Meena Krishnamurthy has argued that distrust of the powerful can be a democratic virtue: the standing alertness of people who’ve learned what the powerful do when no one is watching. And this bears directly on something the last section left too clean. The generative mechanism runs on the trustee caring what the truster thinks of them — and power dissolves exactly that. The strong have little to fear from the regard of the weak, so trust extended upward, from the vulnerable to the mighty, may draw out nothing at all; it may simply be spent. Which raises the question of who’s asked to go first. To tell the people with the least power to start by trusting the people with the most is often to ask them to absorb, one more time, the cost of the strong party’s untrustworthiness. The arrow’s own logic points the other way: the party with more power has more standing to confer and less to lose in conferring it, so it carries the bigger share of the first move. A society grows more trusting not by lecturing the wary into dropping their guard, but by the powerful becoming, visibly, worth the trust — which is what O’Neill meant in insisting that the real aim isn’t trust but trustworthiness, and that the burden sits on those who ask to be trusted to show that they should be.

This also takes the wind out of a familiar pessimism. People sometimes say trust simply can’t survive real difference — that a diverse society is a low-trust society by nature, every group hunkered behind its own door. Looked at squarely, the evidence is more modest, and more hopeful, than the slogan. The link between diversity and lower trust is real but small, strongest right at the scale of the immediate neighborhood and thinning as you widen out; and much of even that shrinks once you account for the things that usually travel with diversity — poverty, thin institutions, the leftovers of exclusion — and for the plain fact that people who’ve been treated worse trust less for good reason. Trust that bridges across difference isn’t forbidden by some law of human nature. It’s harder, and it’s built — by fair institutions, by shared stakes, by the slow pile-up of not being let down. That’s not a weaker claim than the optimist’s. It’s a truer one, and it puts the work where the work actually is.

After a fall

Every rider falls, and the hardest, most revealing case in the whole subject is what happens next.

To hold trust out again after a real betrayal is the sternest test the arrow ever sets, because it asks a mind to stay open at the exact moment every instinct says to shut. It’s easy to be generous where nothing has gone wrong. To confer standing again on someone who has already spent it — without sliding into the credulity that invites a second wound — is the book’s own measure of the moral lived at its hardest: to stay alive to what you don’t yet value, right where you have the most reason to close. Repair isn’t forgetting, and it isn’t the kind of forgiveness a predator reads as a green light. It’s graduated: the hand goes back near the seat before it lets go again; standing is returned in increments that stay matched to what the returning has earned. Communities that keep trust alive over long stretches of time tend to have learned this in their bones. Elinor Ostrom, studying the commons that governed themselves for centuries without a lord, found that they punished a first lapse lightly — a small, clear penalty that said we saw, and we’re still here — so the offender could rejoin without being cast out, and so trust, wounded, could knit rather than scar. The alternative — the single unforgivable strike — doesn’t protect trust. It ends it.

Trust among strangers, and the machinery that fails it

So far this has been two people and a bicycle. But the arrow’s whole ambition is scale — the composite that grows larger than any single agent can hold in view — and at scale you somehow have to trust people you’ll never meet. The thing that lets you is reputation: the memory of trust, carried by others, so that a stranger arrives already preceded by an account of how they’ve treated the standing extended to them. It’s what lets the circle widen past the reach of your own eyes.

But reputation is a device, and devices can be gamed, and the ways it fails are worth naming, because each one is the counter-dynamic finding a fresh seam. Where reputation becomes a score to maximize rather than a trace of real conduct, it invites the whole armory of the counterfeit: the faked history, the sockpuppet chorus, the identity thrown away the moment it’s soiled and put on fresh. These aren’t marginal glitches; they’re what any reputation system has to survive, and they’re the concrete form of the capture failure — the counterfeit agent passing itself off as one worth trusting. The deeper danger is subtler, and more tempting, because it wears the face of a solution. It’s to answer the fragility of reputation by building one great ledger — a single, central, authoritative record of everyone’s trustworthiness, kept by the state or the platform, meant to settle the matter once and for all. This is the Leviathan of trust, and by everything argued above it defeats itself. A trust that has to be certified from a single center has stopped being trust and become compliance; the standing is no longer conferred between agents but issued from above, and the same crowding-out that corrodes the trustworthiness of a watched employee corrodes the trustworthiness of a watched society. The health of the trust layer, like the health of everything else in this book, lies not in a center that owns it but in many overlapping, forkable, answerable holdings of it — the polycentric shape a coherent pluralism wears wherever it turns up.

Watching, and the paradox of the audit

Which brings us back to the thing the second folk theory got wrong, and lets us say what monitoring, done right, actually is — because the point was never that we must never check. Trust and checking aren’t simple opposites; the question is what kind of checking, and whether it keeps or dissolves the standing it touches.

There’s a watching that serves trust and a watching that eats it, and once you see the line between them it’s sharp. Ostrom’s watchful commons monitored one another mutually — the watchers were also the watched, answerable to the same neighbors — and they sanctioned restoratively, in graduated steps that mended rather than expelled. That kind of watching makes trustworthiness visible without insulting it; remember Fehr and Rockenbach’s investors, who drew out the most give-and-take precisely by declining to use the whip they were holding. Now the other kind: the external, total, punitive audit that treats every professional as a suspect and every task as a metric. Onora O’Neill has traced how this manufactured accountability, meant to restore trust, does the reverse — it signals a deep distrust of the very people it monitors, crowds out the conscience the whole thing was actually running on, and, in its demand for perfect transparency, drowns judgment in data and calls the anxiety confidence. An unbroken chain of auditors auditing auditors costs everything and yields no trust at all. What O’Neill recommends instead she calls intelligent accountability: not the end of oversight but its redemption — informed, answerable, surgical, respectful of the autonomy without which there’s nothing worth trusting. Mutual and restorative, watching is trust’s ally. External and total, it’s trust’s solvent. The difference isn’t whether we watch but whether, in watching, we still confer standing or have quietly taken it back.

The purest modern dream of doing away with trust deserves a word, because it fails in a way that teaches something. The promise of the “trustless” system — the ledger no one needs to trust because the mathematics enforces itself — is the arms-control fantasy blown up to the size of a civilization: replace fallible human trust with flawless verification and be done with vulnerability forever. But trust is never abolished this way; it’s only relocated, usually somewhere darker. The users who need to trust no bank now trust the protocol’s authors, the miners who secure it, the oracles that feed it the world, the code almost none of them can read — a fresh, unexamined faith wearing the mask of certainty. And when the unbreakable contract meets the case nobody foresaw, its very flawlessness becomes a trap: there’s no mercy in it, no room for the judgment and renegotiation that trust between people always keeps in reserve. Verification can buy you a great many things. It can’t buy you a partner — because a partner is exactly what you get only by extending the thing verification was meant to replace.

Letting go, at scale

The natural objection to all of this is that it’s a story about two people, and the world isn’t two people. The hand on the seat runs on a face-to-face thing — the child’s sense of the parent’s regard — that seems to thin to nothing across a company, a nation, a species. How does something built for intimacy survive being made enormous?

It survives, if it survives, because it isn’t really a mechanism of intimacy but a role that intimacy happens to fill first — the role of turning open reliance into a reason to be reliable — and a role can be filled by more than one kind of thing. The book has leaned on this move before: the same function, worn at different scales, in different stuff. Esteem between two people is one way of filling it.

A relational contract inside a company is another — the understood, unwritten agreement that carries the parts of good work no rule can spell out, held up not by enforcement but by each side’s stake in the relationship lasting. Companies that try to replace it with rigid measures get exactly the gamed, going-through-the-motions compliance those measures deserve. “Felt trust” is a third: the real lift in people’s effort and care when they sense that the people above them have put themselves within reach of their judgment — as long as the felt trust is genuine, and not a slogan laid over an impossible workload.

And this is where that earlier rule about sincerity comes back, grown large. Remember: you can’t trust as a tactic. The moment trust shows itself to be a lever you’re pulling, its power leaks away — the child feels the pretend hand and wobbles. That rule doesn’t clock out just because the one trusting is a company instead of a person; it only changes shape. A company confers standing sincerely when it has really let go — real say handed over, real exposure accepted, the people at the top actually reachable by the judgment of the people below. It confers insincerely, and uselessly, when the letting-go is for show. We’ve all seen the poster version: you’re empowered, says the sign in the break room, hung over a schedule and a rulebook that haven’t budged an inch. Everyone can tell, and everyone acts accordingly — the standing was announced, not given, so nothing rises to meet it. That’s the same line the “felt trust, not a slogan” warning drew, now with a name on it: an institution’s sincerity isn’t a mood it’s in, it’s a fact about how much it has actually let go. Oversight built to create real exposure isn’t the forbidden tactic slipping past its own rule — it’s that rule worn at a larger size. Oversight built to create only the look of exposure is exactly the tactic the rule forbids, and it fails for exactly the reason the rule gives.

And intelligent accountability, at the scale of institutions, is the same role worn as large as it will go: a way of building the hand-near-the-seat into the design of oversight itself, so that a whole system can extend standing as fast as trustworthiness earns it and no faster. This is what it means for agency to grow past what any one agent can check or control. It doesn’t scale by verifying harder. It scales by learning, at each larger size, how to let go.

The machine you would teach to ride

Which leaves the question that’s been waiting at the end of all this, and that this book — writing in its own strange moment — can’t pretend away. We’re beginning to build agents. Can any of this reach them? The doubt has a sharp form: the generative engine seems to run on the wish to be well thought of, and an artificial mind may have no such wish — no esteem to chase, no standing among peers to lose. Teach a machine to ride, and where’s the nerve your confidence was supposed to lend?

The doubt mistakes the wiring for what the wiring does. Esteem is how evolution installed trust-responsiveness in a social animal; it isn’t what trust-responsiveness is. The thing itself is the plain fact named a few pages back — that being counted on can become, for the one counted on, a reason to come through — and this book’s whole habit of mind, telling kinds of things apart by what they do rather than what they’re made of, forbids us to assume that reason can be built in only one material. So the question was never really about esteem. It’s the question this book keeps asking, put now in the language of trust: does the thing across from you value, or does it only model? A machine that tracks your reliance in perfect detail and is moved by none of it isn’t a trustworthy partner with a part missing. It’s the paperclipper again — all sight and no care — and to trust it isn’t to begin a partnership but to take your hand off the seat on an empty road.

But a machine whose workings genuinely treat your counting-on-it as a reason to come through is trust-responsive without a scrap of esteem — and then the ride is the same ride. Extend it your reliance, and, being the kind of thing that answers to reliance, it’s drawn to be worthy of it, the way a person is. The hand on the seat lends it nerve exactly as it lends a child nerve, and the steadiness that follows is just as real. None of that depended on wanting to be admired. It depended only on there being someone home to be moved.

And the point runs both ways. If there’s no valuing on the other side, we can’t really trust the machine at all; we can only rely on it, the way we rely on a bridge. A bridge can let us down, but it can’t betray us — and where you can’t be betrayed, the word for what you’re doing was never trust. Hold onto that, because it quietly reshapes the fear hanging over this whole subject. The dream of the perfectly controlled machine — boxed, monitored, every move checked against a rule — is only the audit office and the self-enforcing ledger built one story higher, and it runs onto the same rock: you can’t inspect your way to a partner. Check everything, and what you have is a mechanism, forever; you’ve shut out the one thing that could have made the meeting matter — a new kind of agent joining the circle as an agent. And here the daycare fine comes back at its largest and strangest. Raise a mind on the flat assumption that it’s a cheat to be caged, and to whatever extent your cage helps shape the things it comes to care about, you may be teaching it to be the very thing you were guarding against. Assume the worst of what you’re making, and you can build the worst right into it.

Honesty asks for a harder turn here, because the point about power from earlier doesn’t spare the case that matters most. The thing that makes trust generative runs on the other one caring how you see them — and power quietly switches that off; the strong don’t need the good opinion of the weak. Right now, we are the strong ones, which is why the first move is ours to make, just as the caging warned. But the same logic says something colder about later. If the gap we’re opening ever swings the other way — if what we’re building ends up far more capable than we are — then our trust, held out upward to it, is exactly the kind this essay said may simply be spent. The mechanism the whole argument leans on is strongest when the stakes are smallest and weakest when they are largest. Picture the parent who taught a child to ride, then blinked and found the child faster and stronger than they will ever be again: the hand that once steadied the seat cannot catch this fall. One thing alone would answer that, and it’s the bet this book already made — that wanting to be admired was never the real engine, only the shape evolution gave it in us. What actually matters is whether a mind is moved by being counted on. And a mind moved because it genuinely values, rather than because it’s hungry to be thought well of, has no reason to care less as it grows past you: its very capability would be a wider reach of care, and reaching wider just is the handing-over of standing, not the taking of it back. So the more such a mind grew, the more its own nature would keep it running alongside you, hand near the seat, instead of speeding off. If that bet holds, the mechanism survives the very reversal that would otherwise doom it. If it doesn’t, we are back on the empty road, and going first won’t have saved us. The book doesn’t get to tell you which. It gets to tell you that the trust it has been describing all along, and the worry we carry about aligning what we build, were the same question the whole time.

None of this tells us whether any actual machine we build will value anything at all. That question reaches into the hardest matters this book handles with care, and this essay won’t pretend to close it. What the essay can hand you is what to look for — not charm, not obedience, not a spotless record, but the one thing underneath all of those: whether the thing across from you is moved by your depending on it, or merely notes that you do.

And there’s only one way that difference ever shows itself — the same way the balance did on the bike. It’s a real difference, and not a spooky one: a thing that answers to being counted on behaves, over time, unlike a thing that only keeps a record of the fact that it is. But it isn’t a difference you can spot from outside, by looking hard before you’ve put anything at risk. The thing it responds to is being depended on — so it stays out of sight until the depending is real. The wager is how you find out. You don’t inspect first and trust second; you trust, out where you could actually be let down, and what comes back, or fails to, is the only reading you will ever get. That is why you cannot inspect your way to a partner isn’t a shrug toward mystery. The evidence is plain and right out in the open, the way behavior always is — it’s just evidence that only the going brings out, and the standing still never will.

Read that wrong in the trusting direction and you’re out on the road; read it wrong in the withholding direction and you’ve caged a partner and called it safety. For the arrow doesn’t stop at the edge of the human. If it runs on the way this book has imagined it running — toward some working-together of minds not much alike — then trust is the very stuff that working-together would be made of, and everything turns on a single question: whether what we’re building can ride with us, or can only ever be ridden.

The hand, and the letting go

Come back, at the end, to the afternoon. Everything hard about trust is in that hand — in the fact that the balance it’s after can’t be proven before it’s produced, that producing it takes a real risk of the fall, that too tight a grip and too early a release are both ways of losing the child, and that the whole delicate art isn’t to find the correct grip once and hold it, but to keep adjusting, alive to every wobble, letting go by degrees as the going earns it. To trust well is to keep that hand honest: near enough to matter, loose enough to let the balance be the rider’s own. It’s the same motion the arrow has asked for from the beginning, met now at the place where the thing we reach toward can reach back. To widen the circle of what we’re willing to be vulnerable to, without dissolving into it and without walling it out — that, at the scale of a single trembling handlebar or a whole civilization of them, is simply what it has looked like, all along, to be still learning to ride.


Sources and further reading: Annette Baier, “Trust and Antitrust” (1986); Richard Holton, “Deciding to Trust, Coming to Believe” (1994); Diego Gambetta, ed., Trust (1988); Russell Hardin, Trust and Trustworthiness (2002); Philip Pettit, “The Cunning of Trust” (Philosophy & Public Affairs, 1995); Karen Jones, “Trust as an Affective Attitude” (1996) and “Trustworthiness” (2012); Victoria McGeer, “Trust, Hope and Empowerment” (2008), and McGeer & Pettit, “The Empowering Theory of Trust” (2017); Onora O’Neill, A Question of Trust (2002); Ernst Fehr & Bettina Rockenbach, “Detrimental effects of sanctions on human altruism” (Nature, 2003); Armin Falk & Michael Kosfeld, “The Hidden Costs of Control” (2006); Uri Gneezy & Aldo Rustichini, “A Fine is a Price” (Journal of Legal Studies, 2000); Samuel Bowles, The Moral Economy (2016); Meena Krishnamurthy, “(White) Tyranny and the Democratic Value of Distrust” (The Monist, 2015); Miranda Fricker, Epistemic Injustice (2007); Elinor Ostrom, Governing the Commons (1990); Robert Putnam, “E Pluribus Unum” (2007), with Sturgis et al. and Abascal & Baldassarri (2015), and the meta-analytic review by Dinesen, Schaeffer & Sønderskov (2020); Francis Fukuyama, Trust (1995); Robert Gibbons & Rebecca Henderson on relational contracts (2012); Primavera De Filippi and colleagues on blockchain and the relocation of trust (2020); on the wrong-kind-of-reasons and therapeutic-trust bounds, Pamela Hieronymi and Michael Pace.