The Understanding/Acceptance Principle and Spearman’s Positive Manifold
The understanding/acceptance principle uses correlations with cognitive ability to examine disputed standards for reasoning tasks. Its proponents argue that positive correlations support the scoring model, while absent or negative correlations give reason to reconsider the model or the task’s interpretation. The correlation alone does not settle which answer is normatively correct.
THE IDEA
THE UNDERSTANDING/ACCEPTANCE PRINCIPLE AND SPEARMAN’S POSITIVE MANIFOLD
The understanding/acceptance principle simply formalizes the judgment of most theorists that we should resist the conclusion that individuals with more computational power are systematically computing the non normative response. Such an outcome would be an absolute first in a psychometric field that is 100 years and thousands of studies old (Brody, 1997; Carroll, 1993, 1997; Lubinski & Humphreys, 1997; Neisser et al., 1996; Sternberg & Kaufman, 1998). It would mean that Spearman’s (1904, 1927) positive manifold for cognitive tasks – virtually unchallenged for 100 years – had finally broken down.
In fact, it is probably helpful to articulate the understanding/acceptance principle somewhat more formally in terms of positive manifold – the fact that different measures of cognitive ability almost always correlate with each other (see Carroll, 1993, 1997). The individual differences version of the understanding/acceptance principle puts positive manifold to use in areas of cognitive psychology in which the nature of the appropriate normative model to apply is in dispute. The point is that scoring a vocabulary item on a cognitive ability test and scoring a probabilistic reasoning response on a task from the heuristics and biases literature are not the same. The correct response in the former task has a canonical interpretation agreed on by all investigators; whereas the normative appropriateness of responses on tasks from the latter domain has been the subject of extremely contentious dispute (Cohen, 1981, 1982, 1986; Cosmides & Tooby, 1996; Einhorn & Hogarth, 1981; Gigerenzer, 1991a, 1993, 1996; Kahneman & Tversky, 1996; Koehler, 1996; Stein, 1996). Positive manifold between the two classes of tasks would only be expected if the normative model being used for directional scoring of the tasks in the latter domain is correct. Positive correlations with developmental maturity (e.g., Byrnes & Overton, 1986; Klahr, Fay, & Dunbar, 1993; Markovits & Vachon, 1989; Moshman & Franks, 1986) would seem to have the same implication.
Likewise, given that positive manifold is the norm among cognitive tasks, a negative correlation (or, to a lesser extent, the lack of a correlation) between a probabilistic reasoning task and more standard cognitive ability measures might be taken as a signal that the wrong normative model is being applied to the former task or that there are alternative models that are equally appropriate. The latter point is relevant because the pattern of results in our studies has not always displayed positive manifold. Although, as previously mentioned, for a wide variety of tasks in the heuristics and biases literature we have found positive correlations (belief bias in syllogistic reasoning, covariation detection, causal base-rate use, selection task performance, assessing the likelihood ratio, sunk cost effects, outcome bias, if/only thinking, searching for unconfounded variables), in some cases we have found no correlations (overconfidence effect and false consensus effect). Some tasks have also produced negative correlations.
When to use it
Evaluating whether a new cognitive test measures general intelligence or a specific, unrelated ability.
In research on heuristics and biases, using positive manifold to validate or critique the normative model being applied.
Designing educational interventions: if a reasoning task correlates negatively with ability, rethink the task's framing or normative standard.
In a study of reasoning tasks, comparing correlations across measures and checking whether differences in task interpretation explain unexpected results.
FROM THEORY TO EVERYDAY LIFE
In practice
Vocabulary test vs. probabilistic reasoning task
Suppose scores on a vocabulary test correlate positively with responses scored as correct on a probabilistic reasoning task. Under the understanding/acceptance principle, this supports the scoring interpretation. A zero or negative correlation prompts further investigation of the model, the task, and how participants understood it. Neither result proves which normative standard is correct.
Overconfidence and false consensus effects
The authors report no correlation with standard ability measures for the overconfidence and false consensus effects in their studies. They treat this as a reason to examine the normative interpretation; it does not, by itself, show that the scoring model is wrong or that the biases are independent of every aspect of intelligence.
A MOMENT TO REFLECT
Put it to work.
How does the understanding/acceptance principle help resolve disputes about which normative model to apply in reasoning tasks?
Imagine a probabilistic reasoning task shows a negative correlation with IQ. What does that imply about the task's normative model?
Can you think of a reasoning domain where positive manifold might break down, and why would that challenge current theories?
References
- Brody (1997) — Brody (1997)
- Carroll (1993) — Carroll (1993)
- Carroll (1997) — Carroll (1997)
- Lubinski & Humphreys (1997) — Lubinski; Humphreys (1997)
- Neisser et al. (1996) — Neisser et al. (1996)
- Sternberg & Kaufman (1998) — Sternberg; Kaufman (1998)
- Spearman (1904) — Spearman (1904)
- Spearman (1927) — Spearman (1927)
- Cohen (1981) — Cohen (1981)
- Cohen (1982) — Cohen (1982)
- Cohen (1986) — Cohen (1986)
- Cosmides & Tooby (1996) — Cosmides; Tooby (1996)
- Einhorn & Hogarth (1981) — Einhorn; Hogarth (1981)
- Gigerenzer (1991a) — Gigerenzer (1991)
- Gigerenzer (1993) — Gigerenzer (1993)
- Gigerenzer (1996) — Gigerenzer (1996)
- Kahneman & Tversky (1996) — Kahneman; Tversky (1996)
- Koehler (1996) — Koehler (1996)
- Stein (1996) — Stein (1996)
- Byrnes & Overton (1986) — Byrnes; Overton (1986)
- Klahr, Fay, & Dunbar (1993) — Klahr; Fay; Dunbar (1993)
- Markovits & Vachon (1989) — Markovits; Vachon (1989)
- Moshman & Franks (1986) — Moshman; Franks (1986)
CONTINUE THE CONVERSATION
Source texts
- Heuristics and Biases The Psychology of Intuitive Judgment (Thomas Gilovich, Dale Griffin, Daniel Kahneman)