Skip to main content
Cognitive Biases

The Water Puddle Revisited

Even with fractal and power-law models, the problem of induction persists; complexity theory should make us more suspicious of precise models because history does not reveal its generator, and failing to distinguish forward from backward processes is a major epistemological sin.

THE IDEA

The Water Puddle Revisited

As you have seen, we have trouble knowing the parameters of whichever model we assume runs the world. So with Extremistan, the problem of induction pops up again, this time even more significantly than at any previous time in this book. Simply, if a mechanism is fractal it can deliver large values; therefore the incidence of large deviations is possible, but how possible, how often they should occur, will be hard to know with any precision. This is similar to the water puddle problem: plenty of ice cubes could have generated it. As someone who goes from reality to possible explanatory models, I face a completely different spate of problems from those who do the opposite.

I have just read three “popular science” books that summarize the research in complex systems: Mark Buchanan’s Ubiquity, Philip Ball’s Critical Mass, and Paul Ormerod’s Why Most Things Fail. These three authors present the world of social science as full of power laws, a view with which I most certainly agree. They also claim that there is universality of many of these phenomena, that there is a wonderful similarity between various processes in nature and the behavior of social groups, which I agree with. They back their studies with the various theories on networks and show the wonderful correspondence between the so-called critical phenomena in natural science and the self-organization of social groups. They bring together processes that generate avalanches, social contagions, and what they call informational cascades, which I agree with.

Universality is one of the reasons physicists find power laws associated with critical points particularly interesting. There are many situations, both in dynamical systems theory and statistical mechanics, where many of the properties of the dynamics around critical points are independent of the details of the underlying dynamical system. The exponent at the critical point may be the same for many systems in the same group, even though many other aspects of the system are different. I almost agree with this notion of universality. Finally, all three authors encourage us to apply techniques from statistical physics, avoiding econometrics and Gaussian-style nonscalable distributions like the plague, and I couldn’t agree more.

But all three authors, by producing, or promoting precision, fall into the trap of not differentiating between the forward and the backward processes (between the problem and the inverse problem)—to me, the greatest scientific and epistemological sin. They are not alone; nearly everyone who works with data but doesn’t make decisions on the basis of these data tends to be guilty of the same sin, a variation of the narrative fallacy. In the absence of a feedback process you look at models and think that they confirm reality. I believe in the ideas of these three books, but not in the way they are being used—and certainly not with the precision the authors ascribe to them. As a matter of fact, complexity theory should make us more suspicious of scientific claims of precise models of reality. It does not make all the swans white; that is predictable: it makes them gray, and only gray.*

As I have said earlier, the world, epistemologically, is literally a different place to a bottom-up empiricist. We don’t have the luxury of sitting down to read the equation that governs the universe; we just observe data and make an assumption about what the real process might be, and “calibrate” by adjusting our equation in accordance with additional information. As events present themselves to us, we compare what we see to what we expected to see. It is usually a humbling process, particularly for someone aware of the narrative fallacy, to discover that history runs forward, not backward. As much as one thinks that businessmen have big egos, these people are often humbled by reminders of the differences between decision and results, between precise models and reality.

What I am talking about is opacity, incompleteness of information, the invisibility of the generator of the world. History does not reveal its mind to us—we need to guess what’s inside of it.

When to use it

  • Predicting stock market crashes using power law models without accounting for model uncertainty.

  • Modeling epidemics with power laws, but failing to consider that many different underlying dynamics could produce the observed data.

  • Using complexity theory to justify precise policy interventions, while ignoring the limitations of backward-looking inference.

  • Interpreting social contagion phenomena as evidence of universality without addressing the multiple possible generators.

FROM THEORY TO EVERYDAY LIFE

In practice

01

The Water Puddle

A puddle of water could have been generated by many different configurations of melting ice cubes. Similarly, observed data can be explained by many possible models, making it difficult to infer the true underlying process.

02

Popular Science Books on Complexity

Authors like Buchanan, Ball, and Ormerod promote power laws and universality but fail to distinguish between forward modeling and backward inference, leading them to overstate the precision of their models.

✳

A MOMENT TO REFLECT

Put it to work.

  1. How does the inverse problem affect your confidence in models derived from historical data?

  2. In what ways might you be committing the narrative fallacy when interpreting complex systems?

  3. Can you think of a situation where a precise model of reality was later proven wrong due to the invisibility of the generator?

Connected ideas

Another lens can bring the same problem into focus.

Often confused with

References

  1. Ubiquity — Mark Buchanan
  2. Critical Mass — Philip Ball
  3. Why Most Things Fail — Paul Ormerod

CONTINUE THE CONVERSATION

Source texts

  • The Black Swan The Impact of the Highly Improbable With a new section On Robustness and Fragility (Nassim Nicholas Taleb)
← More cognitive biases