The Missing Holes

The winners are always happy to tell you how they did it.

the shelf

The advice aisle is the longest in the bookstore. Ten habits. Four hours. One rule. Every title promises a method, and every author shares a credential: it worked for them.

There is no shelf for the methods that were followed faithfully and failed. No memoir of the founder who woke at five, took the cold showers, read the same books, and went broke anyway. No documentary about the band that broke up after the first EP. The dead do not tour.

Consider what that does to the sample. Every data point in the genre survived. The book exists because the author made it; the author made it, so the book exists. The circle closes and calls itself a method.

the planes

In 1943 the American military had the same problem, only theirs arrived in crates of aluminum with holes you could put a hand through. Bombers were coming home from combat riddled, the holes clustered thick across the wings and fuselage, sparse on the engines and the cockpit. The analysts mapped every returning plane and drew the obvious conclusion. Armor the wings. Armor the fuselage. Armor where the holes are.

They took the maps to the Statistical Research Group at Columbia, where a statistician named Abraham Wald looked at the same data and gave the opposite order. Armor the engines. Armor the cockpit. The places where the returning planes had no holes at all.¹

The analysts had studied the planes that came back. The planes shot through the engines did not come back. They had gone down over two oceans and the territory between them, taking their bullet maps with them. The holes on the survivors marked survivable damage, not dangerous damage. The damage that mattered was on the planes that could not be examined, because they were destroyed.

The armor went where the holes were not.

the numbers

The same maps get drawn in every field that keeps score. Burton Malkiel counted 604 hedge funds in existence in 1996 and found that only 141 of them still existed when he looked. The dead funds’ returns were never in the published indexes. Put them back in and the industry’s reported performance drops by about eight and a half percentage points a year.²

The mutual funds: raw return data overstated the average by roughly one and a half percent a year, because the funds that died took their bad years with them.³ The small businesses: the Bureau of Labor Statistics finds about 78 percent of new establishments survive their first year and about 51 percent survive to year five.⁴ Read the magazine profiles of the survivors and you are reading the wings. The fuselage is the part that made it home.

The winners are a sample of one outcome.

the trick

But the deeper cut is not the missing dead. It is that the living misremember. Memory edits toward the narrative. The winner’s story, told years after the fact to a biographer with a recorder running, arranges accidents into decisions and luck into discipline. Every survivor’s memoir is reverse-engineered from the ending.

Did the habits cause the win, or did the win certify the habits? The book cannot answer, because the control group is buried. The habits might be necessary. The evidence shown cannot establish that they are sufficient.

This does not make the winners liars. Some of the advice is good advice. The claim is thinner, and worse: the evidence presented for the method cannot distinguish the method from the luck. The method was never tested. It was anointed.

the corpus

The same shape is now industrialized. A model trained on the text of the internet trains on what survived: what got written down, kept, upvoted, republished, scanned. The drafts abandoned, the posts deleted, the companies that left no archive. The corpus has no holes where they were hit, because they never came back. Every generation from such a model is another book from the advice aisle, fluent in the habits of the living.

the aisle

Walk back down the advice aisle. The books describe what the authors did. They cannot describe the authors who did the same and are not on the shelf.

Understand this. The armor goes where the holes are not.