Rank-ordering
Also known as: Ranking, Forced ranking
Asking people to put options in order rather than score each one separately.
What it means
Rank-ordering is a measurement and elicitation method in which respondents arrange a set of items into a sequence from most to least preferred, important, or applicable, producing ordinal rather than cardinal data. Its chief advantage over rating each item on a scale is that it forces explicit trade-offs and discrimination: it prevents the response styles that flatten ratings — giving everything a high score, clustering at the midpoint, or differing in how people use a scale — and so can reveal priorities that ratings obscure. The costs are that ranking is more cognitively demanding as the list grows, yields no information about the size of the gaps between ranks or about absolute levels, and can be sensitive to which items are in the set. Because ranking and rating can produce different orderings of the same options, the chosen response format is itself a determinant of the result, echoing scale-compatibility and preference-reversal findings. It matters for survey design, priority-setting, conjoint analysis, and performance evaluation.
Examples
Asked to rate ten product features, customers call them all 'very important'; forced to rank the same ten, they reveal which two they would actually pay for.
A council asking residents to rate local services hears that everything is essential; asking them to rank the same list puts potholes first and hanging baskets last, which is what the budget needs.
A manager who rates every report 'exceeds expectations' has to think once forced to rank them — though the ranking hides that the top three are nearly tied and the fourth is far behind.