Overconfidence
Overconfidence is a cognitive bias where individuals overestimate their knowledge, abilities, or the accuracy of their predictions, often ignoring uncertainty and exhibiting unwarranted certainty in their judgments.
THE REFERENCE LIBRARY
A growing collection of ideas for understanding the world — and your own thinking.
Overconfidence is a cognitive bias where individuals overestimate their knowledge, abilities, or the accuracy of their predictions, often ignoring uncertainty and exhibiting unwarranted certainty in their judgments.
People tend to be overconfident that rational dialogue will resolve disagreements, but when persuasion fails, they attribute bias to others while remaining blind to their own biases, leading to less charitable interpretations of opposing views.
Overconfidence is not solely a function of difficulty; it also depends on the predictability of the domain and the level of expertise. Experts are better calibrated in high-predictability contexts but more overconfident than novices in low-predictability contexts.
Overconfidence bias is the tendency to overestimate one's own abilities, the accuracy of one's predictions, or the safety of a system. The sinking of the RMS Titanic, which was famously declared unsinkable, is a historical example of this bias leading to catastrophic consequences due to inadequate risk preparation.
Taleb argues that society can benefit from entrepreneurial experiments even when the entrepreneurs lose money. He distinguishes that shared learning from overconfidence that exposes other people to severe harm without comparable personal downside.
Confidence in a prediction can exceed the evidence supporting it. The Heaths illustrate this with rejected business opportunities and a study reporting a 40% error rate among diagnoses made with complete certainty. Their lesson is to examine uncertainty before committing to a forecast.
A climate-science study used structured interviews to elicit experts’ probability distributions and reasons for their judgments. The procedure aimed to limit overconfidence and revealed substantial overlap between distributions that discussions of best estimates had obscured.
Overconfidence is a gap between certainty and accuracy: people judge their knowledge, abilities, or predictions more reliable than the evidence warrants. Comparing stated confidence with later outcomes helps reveal and reduce that gap.
Being skilled at mathematical reasoning does not guarantee correctness in all domains; overconfidence in one's mathematical abilities can lead to serious errors in other areas, as exemplified by Francis Galton's advocacy of eugenics despite his mathematical prowess.
In the cited studies, Chinese and Indonesian samples were more overconfident than their American or British comparison groups on several forecasting tasks. Japanese participants in a simulated diagnosis task were slightly less overconfident than Americans, with no significant difference. Feedback reduced overconfidence in the Chinese samples, showing why these findings should not be treated as fixed traits of whole cultures.
Confirmatory-bias accounts explain overconfidence through the search for reasons supporting a favored answer. Ecological models emphasize whether judgment tasks represent the environments people know. Studies of experts help test how these accounts handle task difficulty, base rates, and evidence quality.
People often rely on mental heuristics when assessing probabilities, leading to overconfidence—confidence intervals are too narrow and surprise indices far exceed the ideal 2%.
The reported history of speed-of-light measurements from 1876 to 1973 illustrates uncertainty estimates that were too narrow: later values departed from earlier estimates more often than the stated uncertainties suggested.
Historical reviews of physical constants found that reported uncertainty ranges were often too narrow to accommodate later revisions. The passage uses Birge ratios and surprise indices to assess that pattern, including results retained after problematic measurements were excluded.
Overestimation is assigning an event too high a probability; overweighting is giving it too much influence on a choice. Kahneman explains how attention to a vivid, specific outcome can encourage both.
Overfitting is when a model becomes too complex and fits the noise in the data rather than the underlying pattern, leading to poor predictions. It illustrates the danger of considering too many factors or optimizing for proxy metrics, and it can be mitigated by techniques like regularization, cross-validation, and early stopping.
Overfitting treats patterns specific to observed data as if they will generalize. Linear extrapolation assumes a straight-line relationship continues beyond the observed range. Either can create unwarranted confidence in a forecast.
Overgeneralization draws a broad conclusion from limited or unrepresentative evidence. The example infers a change in all young men from the appearance of a subset.
Drawing overlapping circles can help you explore connections among concepts and create a visual cue for remembering them.
Overoptimism means underestimating the likelihood of adverse events. It can lead people to neglect precautions or commit resources on assumptions that are too favorable.
The tendency to be excessively optimistic, even in the absence of pain or threat, leading to foolish beliefs and decisions; it can be countered by probabilistic thinking.
Overprecision is excessive confidence in the accuracy of what you know or predict. An exact estimate or a narrow range can express it when the evidence leaves more uncertainty than the estimate acknowledges.
The research described finds that security analysts made forecasts that were too extreme, resembling the overreaction seen in less experienced forecasters. The authors argue that professional status alone does not ensure rational market predictions.
The overreaction bias is the tendency for forecasters and investors to make predictions that are too extreme, placing too much weight on recent salient information and not enough on long-term averages, leading to systematic forecast errors where large forecasted changes are not fully realized.
The fallacy of oversimplification occurs when we attempt to make something appear simpler by ignoring relevant complexities. It often involves assuming a single cause for complex events or reducing nuanced positions to binary choices.
The overview effect describes a shift toward concern for humanity as a whole reported by astronauts viewing Earth from space. Grant connects it with shared-identity experiments, while noting that a successful intervention in an emergency did not carry over to everyday rivalry in another study.
A generalization that is technically accurate but has so many qualifications that it eliminates most cases, making the argument weaker than implied. The exceptions are often presented in place of evidence rather than in addition to it.
p-adic numbers define a different metric based on divisibility by powers of a prime p, leading to alternative concepts of convergence. For instance, the series 1+2+4+8+... converges to -1 in the 2-adic sense, illustrating how the notion of 'closeness' can be reinterpreted.
The package-deal fallacy occurs when one assumes that things often grouped together must always be together, or that separating them will have disproportionately severe effects, without evidence. This ignores the possibility of successful separation and adaptation.
Protective reflexes and threat responses can help animals avoid harm. Evolution can also favor costly behavior that helps relatives reproduce. These mechanisms explain some patterns of self-preservation and cooperation without making every fear useful or every group benefit an evolutionary advantage.
Physical or mental pain, chemical influences (drugs, alcohol, stimulants), and illnesses can impair clear thinking and decision-making by causing fear, anger, stress, and sensory distortion.
A paradigm shift is a fundamental change in the basic concepts and experimental practices of a scientific discipline, often occurring when anomalies accumulate that the existing paradigm cannot explain, leading to a new framework that better accounts for the data and suggests new research directions.
An allocation is Pareto efficient when no feasible change can make someone better off without making someone else worse off. The criterion identifies remaining opportunities for mutually beneficial change; it does not determine whether the distribution is fair or everyone’s needs are met.
The Pareto Principle uses an 80%–20% split to illustrate how a minority of inputs can account for most outputs. It is a prompt to look for uneven contributions and measure them, rather than assume every input matters equally.
Vivid images of individual outcomes can be easier to grasp than a probability-weighted expectation. Taleb uses a vacation choice and a fair bet to show how an appealing or frightening outcome can dominate attention.
A mall expands parking to attract shoppers, but commuters occupy much of the added space. The exercise asks you to map how parking, commuter use, sales, and further construction can form a reinforcing feedback loop.
Parkinson’s Law observes that work expands to fill the time available. The source pairs it with observations about spending rising with income and growth bringing maintenance costs, using them as prompts to examine time and resource allocation.
People often make judgments and interpretations based on incomplete information, filling in gaps with assumptions that may be incorrect, leading to biased decisions and misunderstandings.
Partial pictures make it easier to practise alternative interpretations before tackling scenes with an obvious meaning. Written accounts offer a similar exercise: change the viewpoint or emphasis while keeping the facts.
The decision variable partition model describes confidence judgment as a process of partitioning an internal feeling of confidence into categories. It successfully fits calibration curves but requires many parameters and is agnostic about the underlying determinants of confidence.
Pascal's Wager applies expected value to the question of belief in God, arguing that even a tiny non-zero probability of infinite reward makes belief rational, despite serious philosophical flaws such as the 'Cat in the Hat' problem of ignoring alternative deities.
Taleb applies Pascal’s asymmetry to induction: use historical patterns to find opportunities, while separately deciding how much loss you can bear and when to exit. A stop-loss order is an intended exit point, not a guarantee against severe losses.
The mind instinctively assumes the first noun in a sentence is the subject (actor), but passive voice forces reanalysis of the noun as the object, causing a momentary processing difficulty.
A cognitive bias where individuals form generalized conclusions based on limited personal experiences, often ignoring contextual factors.
Path dependence means that an outcome depends on the sequence of events that led to it. Early adoption, switching costs and network effects can help a technology remain dominant even when alternatives are available.
Path dependence of beliefs is the tendency to maintain beliefs or commitments due to prior investment, even when rational evaluation would suggest a change. This behavioral pattern is linked to emotional attachment and may have evolutionary roots.
The tendency to let an obvious perceptual pattern dominate our view, leading us to dismiss logically equivalent alternative descriptions that reveal different perceptually useful patterns.
Pattern noise is variation in how judges respond to particular cases, beyond differences in how strict or lenient they are overall. It includes stable patterns, such as different weights placed on evidence, and occasion noise caused by temporary influences.
Pattern noise arises from multiple, conflicting cues in complex judgment problems, leading to variability in judgments. Ambiguous scales amplify this noise, and subjective confidence often does not guarantee accuracy.
A pattern-matching tripwire gives people permission to raise a concern or flag an opportunity before they can express it as a precise measurement. At the children’s hospital described here, a nurse’s worry was a reason to call for help alongside objective signs of deterioration.
This mental model encourages awareness of the often unnoticed structures, customs, and norms that shape our interactions and limit deeper understanding, using the example of constrained media formats.
Peace is most effectively achieved through organic collaboration and trade among people with skin in the game, rather than top-down treaties or interventions by outsiders who do not share the consequences. The concept warns against geopolitical narratives that overemphasize conflict while ignoring the quieter, more prevalent reality of human cooperation.
People judge an experience largely based on how they felt at its most intense point (peak) and at the end, rather than on the total pleasure or pain over the entire duration—a phenomenon called duration neglect.
Taleb uses Mandelbrot’s reception by economists to argue that established methods can crowd out useful alternatives. He favors fractal models for making large events conceivable, while acknowledging that they do not make those events precisely predictable.
Work in research, art, and other fields can produce long stretches without visible results. Taleb describes the demoralizing comparisons that arise when family, peers, or investors expect steady progress, and the difficulty of persisting without knowing whether a breakthrough will come.
In peer review, specialists assess a submitted paper’s methods, evidence and conclusions before publication. Reviewers may recommend rejection, acceptance or revision; the process offers scrutiny, but publication is not a guarantee that a study is correct.
Peer review asks other experts to assess research before publication. It can identify weaknesses and improve a paper, but reviewer bias, uneven effort, and limited editorial resources mean that publication does not guarantee validity.
After major incidents, security measures often swing to extreme overkill, creating burdens that lead to workarounds, reduced effectiveness, and a false sense of safety. The pendulum effect in design shows how excessive protections can ironically create vulnerabilities.
In the studies Galef describes, social cues such as participation, tone, and composure influenced perceived competence more than statements of certainty did. She uses these findings to argue that people can communicate confidently while remaining honest about uncertainty.
Our tendency to attribute others' successes to luck and their failures to their poor decisions, while doing the opposite for ourselves, hinders learning from observation and leads to unfair judgments.