How to build an evidence-based hiring scorecard

A scorecard is useful only when it changes the conversation. The goal is not to produce a more precise-looking number; it is to make the team agree on what evidence matters before familiarity, pedigree, or interview charisma takes over.

Start with outcomes, not personality traits

• Name three to six outcomes the person must produce in the first year.
• Translate each outcome into observable evidence a resume or interview could support.
• Remove criteria that cannot be assessed consistently or are not necessary for the role.
• Weight only genuine tradeoffs; if everything is critical, the weights are not doing any work.

Define the evidence threshold

For every criterion, write what strong, partial, and missing evidence looks like. A reviewer should be able to quote a resume claim or interview answer, connect it to the criterion, and state what remains uncertain.

Freeze the rubric before comparing candidates

Changing a criterion after seeing a favored candidate is a quiet form of moving the goalposts. Version the rubric, document any change, and re-review the whole pool when a material requirement changes.

Use scores to find the next question

A score should route attention, not make the decision. Mixed evidence should produce a targeted follow-up. Panel disagreement should produce a discussion about evidence quality, not an averaged-away opinion.