DS-101 · Module 3

When Data Isn't Enough

3 min read

Data does not replace judgment. It informs judgment. There are entire categories of decisions where the data is incomplete, ambiguous, or simply too slow to be useful — and waiting for better data is itself a decision, usually a bad one.

Analysis paralysis is real and it is expensive. Every week you spend gathering more data before making a decision is a week your competitor spends executing. The question is not "do we have enough data?" — it is "do we have enough data to be directionally correct?" Directionally correct means the data points you toward the right answer even if the magnitude is uncertain. You do not need to know that paid search will return exactly 4.2x ROI. You need to know it will return more than 1x. That is a much lower bar, and most decisions clear it with far less data than teams think they need.

Do This

  • Set a time limit for analysis before deciding — one week for tactical decisions, one month for strategic ones
  • Ask "do I have enough to be directionally correct?" instead of "do I have enough to be precisely right?"
  • Make reversible decisions quickly and irreversible decisions carefully — most business decisions are reversible

Avoid This

  • Delay decisions indefinitely while waiting for perfect data — perfect data does not exist
  • Use "we need more data" as a way to avoid making a hard call
  • Ignore your experience and judgment entirely because the data is inconclusive — experience is a dataset too