Weighted Ranking

The Nine Steps of Weighted Ranking

We humans are constantly ranking things: the food we buy, the clothes we wear, the route we drive to work, the TV shows we watch. Most of this ranking is unconscious and instinctive—we scan our options and immediately prefer one over another. This built‑in mental software is a blessing; without it, even trivial decisions would become paralyzing. Yet, when the stakes rise—when millions of dollars or a critical outcome depend on the ranking—our instinctive approach can be inconsistent, biased, or hard to justify. Weighted ranking replaces arbitrary, gut‑feel ordering with a structured, transparent, and reliable method. By breaking the decision into criteria, comparing options one pair at a time, and assigning explicit weights, we arrive at rankings we can genuinely trust and defend.

Step 1: List all of the major criteria for ranking. Write down in a column the criteria you will use. For ranking movies, for example, you might list type of plot, strength of plot, degree of excitement, level of violence, cinematography, music, the cast, the director, whether a film has won an Oscar, and so on.

Step 2: Pair-rank the criteria. Determine which of these criteria is the most important. Pair-rank them: compare the first against the second, the first against the third, and so on. Give a “vote” to the more important criterion in each pair. Add up the votes for each criterion. The one with the most votes is the top criterion, the one with the second most votes is second, and so on.

Step 3: Select the top several criteria and weight them in percentiles (their sum must equal 1.0). For simplicity, you might use only your top three criteria. In real‑world applications, you can include as many criteria as needed. Assign a percentage weight to each selected criterion based on its relative importance.

Step 4: Construct a Weighted Ranking Matrix and enter the items to be ranked, the selected criteria, and the criteria weights. Create a table with rows for each item (e.g., each movie) and columns for each criterion. Enter the weights above each criterion column.

Step 5: Pair-rank all of the items by each criterion, recording in the appropriate spaces the number of “votes” each item receives. Now the technique becomes more involved, but this is the only way to rank all options equitably. Perform a separate pair‑ranking for each criterion: compare the first item to the second, first to third, and so on, awarding a vote to the one that better fulfills that criterion. Record the total votes each item receives for that criterion in the matrix.

Step 6: Multiply the number of votes by the respective criterion’s weight. For each item, multiply its votes under a criterion by that criterion’s weight. Enter the weighted values in the matrix.

Step 7: Add the weighted values for each item and enter the sums in the column labeled “Total Votes.” Sum all the weighted scores for each item across the three (or more) criteria.

Step 8: Determine the final rankings and enter them in the last column, labeled “Final Ranking.” The item with the highest total points is ranked first, the next‑highest second, and so on.

Step 9: Perform a sanity check. Do the results make intuitive sense? If not, go back and check the rankings, the weights, and the arithmetic. Don’t be surprised if the results are discomforting—our instinctive ranking often diverges from the structured, weighted outcome. That discomfort is exactly why weighted ranking matters: it reveals hidden patterns and forces us to confront inconsistencies in our gut feelings. For example, Gandhi might remain your top choice, but Gone With the Wind—instinctively second—could drop to tenth, while Ben Hur (instinctively eighth) moves up to second. The answer is confidence in the validity of the rankings. When the stakes are high, validity is critical, and weighted ranking delivers unmatched consistency and transparency.

At a minimum, always use pair ranking; it is easy and surprisingly reliable. But when the ranking truly matters, use weighted ranking—an unwavering method whose results you can rely on unconditionally.