Base Rate Neglect (Disease Test Fallacy)
A cognitive bias where people ignore the base rate (prevalence) of a disease and focus only on the test's accuracy, leading to dramatically overestimating the probability of having the disease given a positive test.
THE IDEA
Examples of Biases in Understanding Probability
I found in the behavioral literature at least forty damning examples of such acute biases, systematic departures from rational behavior widespread across professions and fields. Below is the account of a well-known test, and an embarrassing one for the medical profession. The following famous quiz was given to medical doctors (which I borrowed from the excellent Deborah Bennett’s Randomness).
A test of a disease presents a rate of 5% false positives. The disease strikes 1/1,000 of the population. People are tested at random, regardless of whether they are suspected of having the disease. A patient’s test is positive. What is the probability of the patient being stricken with the disease?
Most doctors answered 95%, simply taking into account the fact that the test has a 95% accuracy rate. The answer is the conditional probability that the patient is sick and the test shows it—close to 2%. Less than one in five professionals got it right.
I will simplify the answer (using the frequency approach). Assume no false negatives. Consider that out of 1,000 patients who are administered the test, one will be expected to be afflicted with the disease. Out of a population of the remaining 999 healthy patients, the test will identify about 50 with the disease (it is 95% accurate). The correct answer should be that the probability of being afflicted with the disease for someone selected at random who presented a positive test is the following ratio:
Number of afflicted persons
Number of true and false positives
here 1 in 51.
Think of the number of times you will be given a medication that carries damaging side effects for a given disease you were told you had, when you may only have a 2% probability of being afflicted with it!
When to use it
Interpreting medical test results accurately, especially for rare diseases.
Evaluating the effectiveness of security screenings (e.g., airport scanners) where false positives are common.
Making judgments in legal contexts about the probability of guilt based on forensic evidence.
Understanding and communicating risks in public health announcements.
FROM THEORY TO EVERYDAY LIFE
In practice
Disease Test Probability Puzzle
A disease has a prevalence of 0.1% (1 in 1,000). A test detects the disease with 95% accuracy, meaning it gives 5% false positives. If a randomly selected person tests positive, the probability they actually have the disease is only about 2% (1 in 51), not 95% as most doctors assumed. Ignoring base rates leads to severe overestimation.
A MOMENT TO REFLECT
Put it to work.
Think of a time you received a positive medical test result. Did you consider the base rate of the condition when evaluating your risk?
How might base rate neglect influence other areas of decision-making, such as hiring or security screening?
If you were a doctor, what strategies could you use to avoid this bias when interpreting test results?
References
- Randomness — Deborah Bennett
CONTINUE THE CONVERSATION
Source texts
- Fooled by Randomness The Hidden Role of Chance in the Markets and in Life (Nassim Nicholas Taleb)