Skip to main content
Scientific Principles

Literature Review (Meta-Analysis)

A literature review surveys research on a topic; a meta-analysis quantitatively combines results from multiple studies. The cited chess review found that more rigorous studies reported smaller cognitive benefits.

THE IDEA

Literature Reviews: A Bird’s-Eye View of Multiple Studies

When you’re wading into a new topic, start by getting a view of the research as a whole. You do this by starting with a literature review, a bird’s-eye view of multiple studies that conveys the “state of the art” on a question of scholarly concern.

To answer whether chess makes you smarter, two psychologists at the University of Liverpool conducted a type of literature review known as meta-analysis, where the results of individual studies are aggregated across studies to estimate how successful (or negligible) a given intervention might be.

The researchers located sixty-four different studies but found that the vast majority, over 60 percent, contained so little information about the experimental procedures that they had to be eliminated from analysis. Combining the twenty-four remaining studies, the researchers found “small to moderate effects” of chess’s benefits on working memory, cognitive ability, and academic skill. However, the researchers’ conclusion came with this crucial caveat: the more rigorous the study, the smaller the effects. The researchers concluded that the chief benefit of playing chess is that it . . . makes you better at playing chess. There’s “little evidence,” they wrote, that the game “makes people smarter.”[8]

When to use it

  • Evaluating the effectiveness of a new educational program by reviewing multiple studies.

  • Assessing the evidence for a medical treatment by conducting a meta-analysis of clinical trials.

  • When writing a research paper, starting with a literature review to understand the current state of knowledge.

  • Making policy decisions based on aggregated research findings rather than isolated studies.

FROM THEORY TO EVERYDAY LIFE

In practice

01

Chess and Cognitive Benefits

Two psychologists at the University of Liverpool conducted a meta-analysis of studies on whether chess makes people smarter. They located 64 studies but had to eliminate over 60% due to insufficient procedural details. The remaining 24 studies showed small to moderate effects on working memory, cognitive ability, and academic skills, but the more rigorous the study, the smaller the effects. The researchers concluded that the main benefit of playing chess is improving at chess itself, with little evidence that it makes people smarter.

✳

A MOMENT TO REFLECT

Put it to work.

  1. When starting research on a new topic, why is it advisable to first read literature reviews rather than individual studies?

  2. How might the results of a meta-analysis be more reliable than a single study?

  3. What can the chess study teach us about the importance of study rigor in evaluating interventions?

CONTINUE THE CONVERSATION

Source texts

  • Verified How to Think Straight, Get Duped Less, and Make Better Decisions about What to Believe Online (Mike Caulfield, Sam Wineburg)
← More scientific principles