Evaluation Guidelines for Norms and Standards
Before evaluating norms and standards, define the purpose, scope, method, timetable and intended use of the findings. Plan how to consult stakeholders, protect impartiality and select evaluators with the skills needed for the work.
THE IDEA
Evaluation Guidelines
Before gathering evidence about norms and standards, define what the evaluation is meant to answer and who will use it. Set out the scope, objectives, timetable and method. This helps reviewers judge which information is relevant and reduces room for shifting the criteria to suit a preferred conclusion.
The evaluation should be credible and useful, with safeguards for independence and impartiality. Comparative benchmarks, peer review or external review can help make the basis of a judgment visible. Specify how these safeguards will work rather than merely promising objectivity.
Prepare a plan with the intended users and other relevant stakeholders. It should explain how findings will be used, how progress will be reported and how requests outside the original scope will be handled.
Match the review team’s competencies to its tasks. Evaluators need enough subject knowledge to interpret the evidence, technical skills to gather and assess it, and communication skills to explain findings and limits. They also need to understand how the evidence supports the conclusions they draw.
When to use it
Before conducting a policy review, an organization drafts an evaluation plan with clear objectives and timelines.
A standards body defines competency requirements for its assessment teams to ensure quality outcomes.
An educational institution consults with teachers and students to define the scope of a curriculum evaluation.
A corporate compliance unit uses a peer review mechanism to safeguard independence in evaluating adherence to ethical norms.
FROM THEORY TO EVERYDAY LIFE
In practice
Curriculum Standards Evaluation
A school district evaluating new curriculum standards uses the guidelines to define objectives, consult teachers, and ensure evaluators have the necessary skills and experience.
Compliance Assessment
A company assessing compliance with industry norms documents the purpose, scope, methodology, and includes peer review to maintain impartiality and credibility.
A MOMENT TO REFLECT
Put it to work.
How would you ensure the evaluation guidelines account for different stakeholder perspectives?
What competencies are most critical for conducting a credible evaluation in your field?
How can you maintain impartiality when evaluating norms that you have personal experience with?
CONTINUE THE CONVERSATION
Source texts
- Evidence-Based Decision-Making How to Leverage Available Data and Avoid Cognitive Biases (Andrew D. Banasiewicz)