Expert Evidence
Anecdotes and professional experience can suggest useful questions without showing how representative a case is. Structured consultation with several experts, such as the Delphi method, can expose differences in judgment, but the quality of the result still depends on the evidence and the panel.
THE IDEA
Anecdotal evidence is an informal account or testimonial, usually concerning one person, event or a small selection of cases. It can suggest a useful question or reveal an overlooked possibility. It can also mislead when a memorable case is selected to support a conclusion while contrary cases are ignored.[8] The availability heuristic discussed in the source’s Chapter 1 helps explain why a vivid example can feel more common than it is.
Before generalizing from an anecdote, ask how it was selected, what other cases exist and whether the proposed explanation has been tested. An unusual event may be worth investigating without being representative. Its memorability does not establish its frequency.
Professional experience, sometimes called individualized evidence or an epistemic account, can summarize observations accumulated over many years. That is more informative than an isolated story, but an expert’s experience still reflects the cases they encountered, the feedback they received and how they interpreted it.
Consulting several experts can make differences in experience and assumptions visible. The Delphi method structures this process through a panel and repeated rounds of elicitation and feedback. Pooling judgments may reduce some individual errors, but shared assumptions, correlated experience or weak evidence can remain. Examine the basis for the judgments as well as the degree of agreement.
When to use it
Evaluating business proposals: Supplement anecdotes with market data and multiple expert reviews.
Policy making: Use Delphi method to gather diverse expert forecasts on economic or environmental impacts.
Medical decision: Check published research rather than relying solely on a single doctor's anecdotal experience.
Personal investment: Avoid acting on a hot tip from one person; seek aggregated opinions from several analysts.
FROM THEORY TO EVERYDAY LIFE
In practice
Startup funding pitch
A founder cites a single successful case of a similar startup to convince investors, ignoring the many failures in the same space. This anecdotal evidence can mislead if not balanced with broader statistics.
Health advice from a celebrity
A celebrity endorses a diet based on their personal experience, leading many to adopt it without considering scientific studies showing mixed or negative results.
A MOMENT TO REFLECT
Put it to work.
When have you been swayed by a compelling anecdote rather than data?
How can you ensure that your reliance on expert opinion accounts for potential bias?
What steps would you take to pool multiple expert opinions in a decision-making process?
Often confused with
CONTINUE THE CONVERSATION
Source texts
- Evidence-Based Decision-Making How to Leverage Available Data and Avoid Cognitive Biases (Andrew D. Banasiewicz)