Pooling Expert Judgment
Pooling expert judgments can reduce dependence on one person’s hunch. It works best when experts contribute independently and bring different information; agreement alone does not rule out a shared bias.
THE IDEA
Pooling Expert Judgment
Intuition can identify useful patterns, but a confident hunch can also be wrong. Malcolm Gladwell’s Blink describes cases in which snap judgments outperform deliberate analysis. In Gut Feelings: The Intelligence of the Unconscious, Gerd Gigerenzer explains intuition through heuristics shaped by experience and the environment. On this account, expertise includes knowing which information can be ignored.
The source describes intuitive design as ‘understanding without the use of instructions’,[3] and attributes this observation to Albert Einstein: ‘The intuitive mind is a sacred gift and the rational mind is a faithful servant. We have created a society that honors the servant and has forgotten the gift’. The quotation expresses a view about intuition; the speaker’s scientific reputation does not establish when a hunch is reliable. In the 3E framework, the problem is to distinguish useful insight from an unfounded impulse. The source compares this with John Wanamaker’s advertising dilemma: the late 19th- and early 20th-century retailer reportedly knew half his spending was wasted but did not know which half.
Pooling judgments offers a way to reduce reliance on any individual. Collect experts’ assessments independently, then compare their conclusions and reasons. Differences can expose assumptions or information that one person missed. Aggregation may reduce individual noise, but experts can share the same mistaken assumptions; concurrence is not a test of truth.
The source invokes Circuit City, Radio Shack, Polaroid, Borders Books, and Wang Laboratories as warnings about business assumptions. These examples motivate scrutiny of confident beliefs, but the passage does not show that pooling opinions would have prevented their difficulties.
When to use it
Forecasting market trends: combine predictions from multiple analysts to improve accuracy and reduce overconfidence.
Comparing independent specialist assessments when a diagnostic judgment remains uncertain.
Investment decisions: average the forecasts of financial experts to balance optimism and pessimism.
Product development: solicit intuitive feedback from diverse stakeholders to identify potential flaws or opportunities.
FROM THEORY TO EVERYDAY LIFE
In practice
Snap Decisions in Business
Malcolm Gladwell's Blink shows that snap decisions can sometimes outperform thorough analysis, illustrating the power of intuition. However, relying on a single hunch is risky; pooling multiple intuitive judgments can mitigate individual bias.
Avoiding Overreliance on Biased Beliefs
An organization can gather independent forecasts before a decision, compare the assumptions behind disagreements, and then combine the judgments. This may reveal warning signs that a single decision-maker overlooks, while leaving shared assumptions to be checked separately.
A MOMENT TO REFLECT
Put it to work.
When making a critical decision, how can you collect independent judgments from multiple experts to reduce bias?
What are the risks of trusting a single expert's intuition versus pooling opinions from several knowledgeable individuals?
How can you distinguish between a brilliant insight and biased noise when evaluating aggregated expert opinions?
Often confused with
References
- Blink: The Power of Thinking Without Thinking — Malcolm Gladwell (2005)
- Gut Feelings: The Intelligence of the Unconscious — Gerd Gigerenzer (2007)
CONTINUE THE CONVERSATION
Source texts
- Evidence-Based Decision-Making How to Leverage Available Data and Avoid Cognitive Biases (Andrew D. Banasiewicz)