Research Evidence
Research evidence comes from systematic inquiry whose methods and results can be examined. Its usefulness depends on study design, data quality and relevance to the question. Different methods answer different questions; publication or peer review alone does not establish reliability.
THE IDEA
Research Evidence
Research studies make it possible to examine how evidence was collected and how conclusions were reached. Disclosure of methods, external review and replication can expose weaknesses that are harder to assess in an anecdote. A study still needs to be evaluated on its design and relevance.
Several distinctions help describe research:
- Theoretical and applied: Theoretical work develops or tests explanations; applied work addresses a practical problem. A study may do both.
- Quantitative and qualitative: Quantitative research analyzes numerical data. Qualitative research examines meanings, experiences or processes through methods such as interviews, observation and document analysis. A large numerical dataset is not necessarily representative, and qualitative work is not limited to ethnography.
- Exploratory and explanatory: Exploratory work seeks patterns or questions worth investigating. Explanatory work investigates why a phenomenon occurs. Predictive performance alone does not establish a causal explanation.
- Observational and experimental: Observational studies examine conditions without assigning the exposure or intervention being studied. Experiments manipulate or assign conditions to assess their effects. Either approach may involve collecting new data.
The volume of research creates a further problem: comparing findings.3 Studies of the same topic may use different populations, definitions, measures and methods. Before combining their conclusions, ask whether they address the same question and whether those differences could explain apparently conflicting results.
When to use it
When evaluating a new business strategy, rely on research studies rather than individual success stories.
In medical decision-making, consider clinical trial results over patient anecdotes.
When designing a marketing campaign, use quantitative exploratory research to identify trends and patterns.
In education, apply theoretical research to develop and test teaching methods.
FROM THEORY TO EVERYDAY LIFE
In practice
Marketing Campaign Effectiveness
A manager hears a story about a successful marketing campaign from a colleague (anecdote) versus a large-scale study analyzing campaign effectiveness across multiple markets using controlled experiments and statistical analysis (research evidence).
Medical Treatment Recovery
A patient shares a personal story of recovery from an illness (anecdote) compared to a randomized controlled trial that tests the treatment on a large sample with a placebo group (research evidence).
A MOMENT TO REFLECT
Put it to work.
How can you distinguish between anecdotal evidence and research evidence in everyday decision-making?
What are the strengths and limitations of different research approaches (e.g., theoretical vs. applied, qualitative vs. quantitative)?
How does peer review help assess research, and what questions about methods, data or applicability still need to be checked?
Often confused with
CONTINUE THE CONVERSATION
Source texts
- Evidence-Based Decision-Making How to Leverage Available Data and Avoid Cognitive Biases (Andrew D. Banasiewicz)