Page Location:Review > Head to Head Review 
Playbook Section:Review & Decide


H2H Reviews make it easy to ask reviewers about multiple factors that influence the overall value of an idea, but that takes some thought and preparation.

Example Criteria
Very general:” cost, speed, complexity, value, risk, bottom line
More specific:” need for training, within capital budget allocation, appealing to multiple cultures, competitive with existing alternatives, easy for older customers to use, safe for children, lower energy cost

Balance
Decide on the smallest number of factors needed to make the next decision. The next decision in most cases is to simply choose ideas to be further developed. Since the ROI wouldn’t be feasible at this stage, donʼt ask it (yet).

Also try to avoid known redundancy in your factors. If technical complexity always tracks with evaluation time, then ask about one but not both: you wonʼt learn anything and youʼll waste reviewersʼ time.

It can be enlightening to make the last factor the “bottom line”, for example “All things considered, which of these two ideas should be implemented?” The review report shows the correlation between all factors, and so this question might reveal, for example, that the reviewers cared more about cost reduction than competitive differentiation.

Itʼs very important to get the phrasing for review factors “pointed in the same direction,” so that report tables and graphs will sort and display properly. This means that every factor should be phrased such that “more is better,” for example

  • Less Costly, not More Costly
  • Faster Regulatory Approval, not Slower Regulatory Approval
  • Higher Customer Acceptance, not Lower Customer Acceptance

This way the overall score will be correctly calculated, and all the 2×2 graphs will have the best ideas in the upper right quadrant.

Criteria as Seen by the Reviewers

Completing a H2H Review takes no training and little, if any, coaching. With the Ideas presented side-by-side, the process is intuitive: read the Ideas, move the sliders to express the direction and strength of their opinion, and click Submit. Thatʼs it!



Now the importance of phrasing in the setup becomes clear: the entered phrases for each factor must complete the sentence, “Which of these…” with the result that the input form is self-explanatory.

There is also a small progress bar on this form to show each Reviewer how many pairs to complete. To achieve diversity of opinion, itʼs a good idea to have at least three reviewers.