Randomness and Trading Biases
This chunk outlines common cognitive biases that lead traders to misinterpret randomness, including overestimating predictive accuracy, becoming attached to positions, changing stories during losses, lacking a loss plan, denying reality, and being misled by survivorship bias that makes lucky traders appear skilled.
THE IDEA
OF RANDOMNESS CONSTANTS
Most of the traits partake of the same Table P.1 right column–left column confusion; how they are fooled by randomness. Below is a brief outline of them:
- Overestimation of accuracy: An overestimation of the accuracy of their beliefs in some measure, either economic (Carlos) or statistical (John). They never considered that the fact that trading on economic variables has worked in the past may have been merely coincidental, or, perhaps even worse, that economic analysis was fit to past events to mask the random element in it. Consider that of all the possible economic theories available, one can find a plausible one that explains the past, or a portion of it. Carlos entered the market at a time when it worked, but he never tested for periods when markets did the opposite of sound economic analysis. There were periods when economics failed traders, and others when it helped them.
- Historical example: The U.S. dollar was overpriced (i.e., the foreign currencies were undervalued) in the early 1980s. Traders who used their economic intuitions and bought foreign currencies were wiped out. But later those who did so got rich (members of the first crop were bust). It is random! Likewise, those who shorted Japanese stocks in the late 1980s suffered the same fate—few survived to recoup their losses during the collapse of the 1990s. Toward the end of the last century there was a group of operators called “macro” traders who dropped like flies, with, for instance, “legendary” (rather, lucky) investor Julian Robertson closing shop in 2000 after having been a star until then. Our discussion of survivorship bias will enlighten us further, but, clearly, there is nothing less rigorous than their seemingly rigorous use of economic analyses to trade.
- Getting married to positions: A tendency to get married to positions. There is a saying that bad traders divorce their spouse sooner than abandon their positions. Loyalty to ideas is not a good thing for traders, scientists—or anyone.
- Changing their story: The tendency to change their story. They become investors “for the long haul” when they are losing money, switching back and forth between traders and investors to fit recent reversals of fortune. The difference between a trader and an investor lies in the duration of the bet, and the corresponding size. There is absolutely nothing wrong with investing “for the long haul,” provided one does not mix it with short-term trading—it is just that many people become long-term investors after they lose money, postponing their decision to sell as part of their denial.
- No precise game plan: No precise game plan ahead of time as to what to do in the event of losses. They simply were not aware of such a possibility. Both bought more bonds after the market declined sharply, but not in response to a predetermined plan.
- Absence of critical thinking: Absence of critical thinking expressed in absence of revision of their stance with “stop losses.” Middlebrow traders do not like selling when it is “even better value.” They did not consider that perhaps their method of determining value is wrong, rather than the market failing to accommodate their measure of value. They may be right, but, perhaps, some allowance for the possibility of their methods being flawed was not made. For all his flaws, we will see that Soros seems rarely to examine an unfavorable outcome without testing his own framework of analysis.
- Denial: Denial. When the losses occurred there was no clear acceptance of what had happened. The price on the screen lost its reality in favor of some abstract “value.” In classic denial mode, the usual “this is only the result of liquidation, distress sales” was proffered. They continuously ignored the message from reality.
- Survivorship bias: How could traders who made every single mistake in the book become so successful? Because of a simple principle concerning randomness. This is one manifestation of the survivorship bias. We tend to think that traders were successful because they are good. Perhaps we have turned the causality on its head; we consider them good just because they make money. One can make money in the financial markets totally out of randomness.
Both Carlos and John belong to the class of people who benefited from a market cycle. It was not merely because they were involved in the right markets. It was because they had a bent in their style that closely fitted the properties of the rallies experienced in their market during the episode. They were dip buyers. That happened, in hindsight, to be the trait that was the most desirable between 1992 and the summer of 1998 in the specific markets in which the two men specialized. Most of those who happened to have that specific trait, over the course of that segment of history, dominated the market. Their score was higher and they replaced people who, perhaps, were better traders.
When to use it
When assessing a trader's performance, consider survivorship bias by looking at the full set of traders who started at the same time, not just the successful ones.
Use stop-loss orders to enforce a plan and avoid emotional attachment to positions, especially during unexpected market moves.
Analyze historical market cycles to identify whether your strategy works across different regimes or only during favorable ones.
When evaluating economic forecasts, compare them to a simple random model to avoid overestimating predictive accuracy.
FROM THEORY TO EVERYDAY LIFE
In practice
Carlos and John: Dip Buyers in a Favorable Cycle
Carlos and John both made money by buying into market dips during the 1992-1998 period. Their style closely matched the market conditions, but they did not test their methods against opposing scenarios. Their success was partly due to randomness and survivorship bias—many other dip buyers who failed were no longer in the sample.
The U.S. Dollar Overvaluation in the Early 1980s
Traders who used economic intuition to buy undervalued foreign currencies in the early 1980s were initially wiped out. Later, those who persisted became rich. Random timing and survivorship can determine outcomes and make economic analysis appear more reliable than it is.
A MOMENT TO REFLECT
Put it to work.
Have you ever been overly confident in a belief because a past success seemed to validate it, without testing for alternative explanations?
When you face a losing position, do you change your story or commit to a predetermined plan? How might this affect your long-term performance?
How can you distinguish between skill and luck when evaluating your own or others' track records?
CONTINUE THE CONVERSATION
Source texts
- Fooled by Randomness The Hidden Role of Chance in the Markets and in Life (Nassim Nicholas Taleb)