Pairwise comparison: how voting in pairs works

Voting in pairs means each person compares two items at a time and picks the one they prefer. It’s also called pairwise comparison or pairwise ranking. Choosing between two is easier than ordering a whole list or giving each item a score.

What a voter sees

A voter opens the poll link, types their name and starts. They see two items side by side and pick one. Then they see the next pair, and so on, until their top list is settled. At the end they see that list.

For videos, the creator can turn on “each video plays once”. Then both videos in a pair play to the end, with no replay, pause or seeking, before the voter can pick. With it off, and for images, voters can look as long as they like.

How the pairs are chosen

Each voter gets their own knockout:

  1. The items are shuffled, so each voter meets them in a different order.
  2. They are paired up. The item you pick moves on to the next round.
  3. If the number of items is odd, some items skip a round.
  4. Rounds continue until the winner is clear. Then a few extra pairs settle the other places in the voter’s top list, such as third place.

A knockout needs far fewer picks than comparing every pair. With 16 items, every possible pair would be 120 picks. A knockout finds the winner in 15.

How the overall ranking works

The creator chooses a top size of 1, 3 or 5. Each finished voter’s top list gives points: with a top 3, first place gets 3 points, second 2 and third 1. The overall ranking adds up everyone’s points. If two items have the same points, the one with more first places ranks higher. If that is equal too, they share the place.

Only voters who finished count. Someone who stops halfway doesn’t change the ranking.

What a knockout can’t tell you

A knockout isn’t a full ranking of every item for each voter. An item that meets a strong rival early leaves the voter’s knockout early, even if it would have beaten the rest. Because the order is shuffled for every voter, this evens out as more people vote.

When to use it

Voting in pairs works best when the items are alike and the question is a matter of taste: which thumbnail, which logo, which cut of a video. If you need a reason for each choice, or a score on a scale, use a survey instead.

All guides

Make your own poll

Free. Upload 2 to 16 images or videos and share one link. Voters don't sign up.

Create a poll

Pairpoll uses Google Analytics cookies to see which pages people visit, only if you accept. Details are on the privacy page.