Skip to main content
Mental Models

Time Series Analysis and the Fallacy of Naive Empiricism

Taleb argues that a stable track record can conceal exposure to rare losses. A narrow time series may omit events that broader history and knowledge of the underlying system give reason to consider.

THE IDEA

Figure 6.1 A Primer on Time Series

The source figure is not included in this excerpt.

If we were dealing with a deterministic world—that is, a world stripped of randomness (the right-column world in Table P.1), and we knew with certainty that it was the case, things would be rather easy. The pattern of the series would reveal considerable and predictive information. You could tell with precision what would happen one day ahead, one year ahead, and perhaps even a decade ahead. We would not even need a statistician; a second-rate engineer would do. He does not even need to be armed with a modern degree; someone with nineteenth-century training under Laplace would be able to solve the equations, called differential equations, or, equivalently, equations of motion— since we are studying the dynamics of an entity whose position depends on time.

If we were dealing with a world where randomness is charted, things would be easy as well, given that there is an entire field created for that called Econometrics or Time Series Analysis. You would call a friendly econometrician (my experience of econometricians is that they are usually polite and friendly to practitioners). He would run the data in his software, and provide you with diagnostics that would tell you if it is worth investing in the trader generating such a track record, or if it is worth pursuing the given trading strategy. You can even buy the student version of his software for under $999 and run it yourself during the next rainy weekend.

But we are not sure that the world we live in is well charted. We will see that the judgment derived from the analysis of these past attributes may on occasion be relevant. But it may be meaningless; it could on occasion mislead you and take you in the opposite direction. Sometimes market data becomes a simple trap; it shows you the opposite of its nature, simply to get you to invest in the security or mismanage your risks. Currencies that exhibit the largest historical stability, for example, are the most prone to crashes. This was bitterly discovered in the summer of 1997 by investors who chose the safety of the pegged currencies of Malaysia, Indonesia, and Thailand (they were pegged to the U.S. dollar in a manner to exhibit no volatility, until their sharp, sudden, and brutal devaluations).

We could be either too lax or too stringent in accepting past information as a prediction of the future. As a skeptic, I reject a sole time series of the past as an indication of future performance; I need a lot more than data. My major reason is the rare event, but I have plenty of others.

On the surface, my statement here may seem to contradict earlier discussions, where I blame people for not learning enough from history. The problem is that we read too much into shallow recent history, with statements like “this has never happened before,” but not from history in general (things that never happened before in one area tend eventually to happen). In other words, history teaches us that things that never happened before do happen. It can teach us a lot outside of the narrowly defined time series; the broader the look, the better the lesson. In other words, history teaches us to avoid the brand of naive empiricism that consists of learning from casual historical facts.

When to use it

  • Evaluating investment strategies based on historical performance

  • Assessing risk in financial markets using past data

  • Making economic predictions from time series without accounting for structural breaks

  • Business decision-making that relies on historical trends without considering black swan events

FROM THEORY TO EVERYDAY LIFE

In practice

01

Pegged Currency Crash (1997)

Currencies of Malaysia, Indonesia, and Thailand were pegged to the U.S. dollar, showing no volatility in their time series. This stability misled investors into thinking they were safe, but the currencies suddenly and brutally devalued in the summer of 1997.

02

Trader Track Record

A trader presents a 5-year track record of steady profits with low volatility. A time series analysis might deem it low-risk, but the strategy could be exposed to rare tail events that haven't occurred yet, making the track record deceptive.

✳

A MOMENT TO REFLECT

Put it to work.

  1. Why might a track record of stable returns be deceptive rather than reassuring?

  2. How can we incorporate the possibility of rare events into our interpretation of time series data?

  3. What is the difference between learning from history broadly and learning from a narrow time series?

Connected ideas

Another lens can bring the same problem into focus.

CONTINUE THE CONVERSATION

Source texts

  • Fooled by Randomness The Hidden Role of Chance in the Markets and in Life (Nassim Nicholas Taleb)
← More mental models