Evaluation Conduct
A framework for conducting evaluations, focusing on four critical areas: defining scope and objectives, ensuring timeliness and intentionality, employing rigorous methodology, and effectively communicating findings. It emphasizes clarity, stakeholder agreement, and actionable outcomes.
THE IDEA
An evaluation needs a clear scope, a suitable timetable, a defensible method and a plan for sharing its findings.
Scope and objectives. Start with the evaluation’s purpose and the questions it must answer. Agree with key stakeholders on what is included, what is excluded and what the available evidence can establish. Keep the objectives realistic; they should guide the choice of methods.
Timing and purpose. Explain why the evaluation is needed and when its findings can inform a decision. Plan the staff time, skills and other resources required to produce relevant information within that period.
Methods. Choose methods that can answer the evaluation questions. Examine the validity and reliability of the measures, possible sources of bias and limits on the conclusions. Combining data sources or analytical methods can help test whether a finding depends on a particular measure or assumption. Such triangulation supports scrutiny; it does not automatically remove bias.
Communication. Share findings with the people who need to act on them. Explain what the results suggest, how they affect different stakeholders and what actions they may support. Use formats suited to each audience, and make the limits of the evidence clear enough to inform the decision.
When to use it
A government agency evaluating the impact of a new public health policy
A business assessing the return on investment of a marketing campaign
An academic institution reviewing the effectiveness of an online learning platform
A non-profit measuring the success of a community outreach program
FROM THEORY TO EVERYDAY LIFE
In practice
Corporate Training Evaluation
A company implements a new training program and uses this framework to set clear goals, collect data via surveys and performance metrics at multiple time points, triangulate results, and present findings to management with actionable recommendations.
Educational Program Assessment
A school district evaluates a new reading initiative by defining scope (grades 1-3), using pre- and post-tests in a quasi-experimental design, and disseminating results to teachers with simple charts and suggested classroom strategies.
A MOMENT TO REFLECT
Put it to work.
How can you ensure the scope of your evaluation is realistic and achievable while still satisfying stakeholder expectations?
What methods could you use to triangulate data sources to increase validity in your evaluation?
How would you develop a communication strategy that ensures evaluation findings are used by decision-makers?
CONTINUE THE CONVERSATION
Source texts
- Evidence-Based Decision-Making How to Leverage Available Data and Avoid Cognitive Biases (Andrew D. Banasiewicz)