The Streetlight Effect

Mental architecture from the other side.

There is a peculiar form of intellectual cowardice that is often encountered in markets. It is the habit of looking not where the answer lies, but where the data is most easily gathered. The investor who spends his days arranging metrics he can measure, building models from numbers he can extract, drawing conclusions from sources he can comfortably read - this man is busy. He may even be intelligent. But he is searching beneath the streetlight, and the keys are not there.

The image comes from an old parable, often told of the Sufi sage Nasreddin Hodja. A neighbour comes upon him crouched beneath a lamp at night, sweeping his hand across the cobbles. “What have you lost?” the neighbour asks. “My ring,” says Nasreddin. “And where did you drop it?” “Inside my house.” “Then why are you looking out here?” “Because,” he replies, “here is where the light is.”

We laugh because the answer is absurd, but the laughter is uneasy. We sense the indictment.

In 1854, in the cramped streets of Soho, an outbreak of cholera began that would kill more than six hundred people within a few weeks. The medical consensus of the day held, with great confidence, that cholera was carried by miasma - the foul air rising from the city’s open sewers, slaughterhouses, and tanneries. This was the explanation that lay beneath the streetlight. It was visible. It was malodorous. It was offered by every respectable authority in London. To investigate other explanations was to step into a darker street, where the visible evidence was absent and the prevailing wisdom was against you.

A physician named John Snow refused to look where the light was. He suspected the disease was carried by water rather than air. He had no laboratory capable of identifying the cholera bacterium, which would not be isolated for another three decades. What he had was a map of the streets, a willingness to walk them, and a refusal to accept that the answer must lie where the established authorities were already standing.

Snow walked from house to house, plotting each death on a chart of the neighbourhood. A pattern emerged that no slogan about miasma could explain. The deaths clustered, with eerie precision, around a single water pump on Broad Street. Households served by other pumps were largely spared, even those living directly above the supposed miasmic vapours. The data had been there the whole time. It simply lay in the dark, in a place the authorities had no interest in illuminating.

Snow persuaded the council to remove the pump’s handle. The outbreak subsided. He had done what the streetlight effect always demands one do, and what most men cannot bring themselves to do. He had walked away from the comfort of the available data and gone looking in the harder, darker places where the answer actually lived.

This is a discipline that successful analysts require, but is almost never rewarded in the short term.

The financial industry is a vast streetlight. It illuminates earnings per share, price-to-earnings ratios, recent price action, analyst ratings, news flow, call transcripts, and the manicured commentary of corporate executives. These things are easy to measure and easy to discuss. They produce numbers. They permit the construction of spreadsheets, which is the unit of seriousness in modern finance.

But the things which actually determine the long arc of a business often live in the dark.

The character of the chief executive when no one is looking. The morale of the third-tier engineers. The unspoken contempt with which middle management greets the latest strategy off-site. The reliability of a supplier whose accounts are private. The condition of customer relationships not captured in retention metrics because the customer has not yet left. The integrity of the audit. The political weather around a regulatory licence. The slow erosion of a moat which has not yet appeared in any operating metric, because the moat is still doing its job today.

These are the keys. They were not dropped beneath the streetlight.

The serious investor must therefore become a wanderer of dark streets. He must develop the habit of asking, of any analysis, what is missing from it. He must notice when the available evidence is suspiciously well-lit. He must mistrust the conclusion that everyone has already reached - not because the crowd is always wrong, but because the crowd is, by definition, standing where the light is, and the light is rarely cast over the things that matter most.

This is harder than it sounds. The streetlight is comforting precisely because it is shared. To search beneath it is to be in company. To search in the dark is to be alone, often for years, with no instrument to confirm one is even looking in the right place. There is no peer-reviewed metric for the things one suspects but cannot yet prove.

Hanlon’s Razor applies here, as it does in so much of life. The men beneath the streetlight are not stupid. They are doing the work that can be done with the tools that can be held. They are searching because searching is what they were hired to do, and the lamp tells them where searching is permitted. To wander away is to risk looking foolish.

But there is no other route to the answer. The keys remain where they were dropped.

The investor who learns this does not abandon the lit terrain. The earnings statement still matters. The valuation still matters. The visible evidence is not nothing. He merely refuses to mistake the lit terrain for the territory. He understands that his edge, such as it is, lies precisely in being willing to enter the unmeasured darkness while others congratulate themselves on the precision of their work beneath the lamp.

Snow saved a neighbourhood by walking into the dark. The investor preserves his capital by the same instinct - the discipline to notice when one is sweeping cobbles where the light is good, and refusing to enter the house where the keys were dropped.

Stay still.

Win slow.

Theodore