DS-101 · Module 2

Vanity vs. Decision Metrics

3 min read

A vanity metric makes you feel good. A decision metric makes you act differently. The difference is not about the metric itself — it is about what happens when the number moves. Page views are vanity if nobody changes their behavior when page views drop. Conversion rate is a decision metric if a 2% decline triggers a landing page review.

Do This

  • Track metrics that change behavior when they move — conversion rate, revenue per employee, customer acquisition cost
  • Apply the action test: "If this dropped 30%, would we do something different tomorrow?"
  • Focus on metrics you can influence directly through specific actions

Avoid This

  • Celebrate page views, followers, or impressions as primary indicators of success
  • Report metrics that make stakeholders nod but never trigger a change in strategy
  • Track 40 KPIs when 5 of them drive every decision that matters

The action test is simple: if this metric dropped 30% overnight, would you do something different tomorrow morning? If the answer is yes, it is a decision metric. If the answer is "we would investigate" or "we would monitor it," it is a monitoring metric at best and a vanity metric at worst. The distinction matters because attention is finite. Every minute you spend reviewing a metric that does not change decisions is a minute you are not spending on one that does.