EI-301b · Module 2

Scorecard Lifecycle Management

3 min read

A vendor scorecard is a living document, not a procurement artifact. The scorecard lifecycle has four phases: design (criteria selection, weighting, scale definition), initial evaluation (scoring, benchmarking, risk adjustment), ongoing monitoring (quarterly re-scoring, health checks, trajectory analysis), and refresh (annual criteria review, weight recalibration, and potentially re-running the full evaluation with updated market options). Each phase feeds the next. Monitoring data informs the annual refresh. The refresh produces updated criteria and weights that improve the next year's monitoring.

Do This

  • Re-score critical vendors quarterly using the same criteria — trending scores reveal improvement or degradation
  • Review criteria and weights annually — your needs evolve and the criteria must evolve with them
  • Include competitive alternatives in the annual refresh — the runners-up from last year may have improved significantly

Avoid This

  • File the scorecard after procurement and never look at it again — it is a monitoring tool, not a purchase receipt
  • Change criteria mid-cycle because a vendor performs poorly on the current criteria — that is rationalization, not analysis
  • Assume the vendor landscape is the same as last year — new entrants, acquisitions, and pivots constantly reshape options

The annual refresh is particularly important in the AI vendor ecosystem, where new entrants appear quarterly and pricing can shift 50% in six months. A vendor that was the clear winner 18 months ago may have been surpassed by a new entrant with better capability at lower cost. The annual refresh ensures your vendor decisions stay current with the market. The cost of switching is real, but the cost of staying with an inferior vendor compounds every month.