Weighted Ranking for Personnel Decisions
Weighted ranking makes hiring or promotion criteria explicit and combines pairwise comparisons into a score. The ranking depends on the criteria, weights, and judgments; it does not make them objective.
THE IDEA
Weighted Ranking for Personnel Decisions
Weighted ranking provides a consistent procedure for comparing personnel options. Define job-relevant criteria and inspect the judgments behind the scores. The procedure has nine steps:
Step 1: List all major criteria for ranking.
Example: supervisory experience, product knowledge, salesmanship, communication skills, budget management, creativity, dedication, image, personal integrity, earnings.
Step 2: Pair-rank the criteria.
Compare each criterion against every other criterion to determine relative importance.
Step 3: Select the top several criteria and assign weights (sum = 1.0).
Example: Product knowledge (0.4), communication skills (0.3), image (0.2), budget management (0.1).
Step 4: Construct a Weighted Ranking Matrix.
Enter the items to be ranked (e.g., candidates), selected criteria, and criterion weights.
Step 5: Pair-rank all items by each criterion.
For each criterion, compare candidates pairwise and record how many votes each candidate receives.
Step 6: Multiply votes by the respective criterion’s weight.
Step 7: Add weighted values for each option to get total votes.
Step 8: Determine final rankings (highest total = best).
Example: Susan (7.3), Cynthia (7.1), then others.
Step 9: Perform a sanity check.
If top rankings are very close, compare the leading candidates again and test how changes in weights or judgments affect the result. A runoff does not by itself establish accuracy.
Hypothetical Example
In a manufacturing company, ten salespeople were ranked for promotion to regional sales manager using four criteria: product knowledge (.4), communication skills (.3), image (.2), and budget management (.1). After pair-ranking and weighting, Susan emerged as the top candidate with 7.3 total weighted votes, closely followed by Cynthia (7.1). Because the top four rankings were between 6.7 and 7.3, a second iteration with just those four candidates was recommended.
When to use it
Ranking job applicants during hiring to reduce interview bias.
Selecting employees for promotion to senior positions.
Choosing among internal candidates for a special project or assignment.
Evaluating vendors or contractors based on multiple weighted factors.
FROM THEORY TO EVERYDAY LIFE
In practice
Promotion of Salespeople to Regional Manager
In a hypothetical manufacturing company, ten salespeople were evaluated for promotion using four weighted criteria: product knowledge (.4), communication skills (.3), image (.2), and budget management (.1). After pair-ranking and weighting, Susan (7.3) topped the list, barely ahead of Cynthia (7.1). A runoff among the top four was suggested to examine the close result; it remains dependent on the judgments used.
A MOMENT TO REFLECT
Put it to work.
What criteria would you use for a hiring decision in your current role? How would you assign weights?
Consider a past personnel decision that felt unfair. How might weighted ranking have improved the process?
How can you ensure the criteria you choose are truly independent and comprehensive?
CONTINUE THE CONVERSATION
Source texts
- The Thinkers Toolkit by Morgan D Jones