CI-201a · Module 3
Confidence Levels & Classification
3 min read
Every intelligence assessment carries uncertainty, and communicating that uncertainty is as important as communicating the assessment itself. Stating a conclusion without a confidence level is like giving a weather forecast without a probability — it sounds definitive, but it leaves the reader unable to calibrate their response. High confidence means multiple corroborating sources from Tiers 1-3. Medium confidence means partial corroboration or reliance on Tier 4-5 sources. Low confidence means a single source, unverified, or speculative inference. The labels are simple. Using them honestly is the hard part.
The temptation to overstate confidence is constant. You have spent hours collecting and analyzing, and your conclusion feels right. But "feels right" is not a confidence level. High confidence requires at least two independent sources from Tiers 1-3 that point to the same conclusion without contradicting each other. If you have one patent filing and a blog post that could be interpreted multiple ways, that is medium confidence at best. If you have a rumor from a conference hallway conversation, that is low confidence regardless of how plausible it sounds. The discipline of honest confidence assessment is what separates intelligence from speculation.
Do This
- Label every key finding and every assessment with a confidence level: high, medium, or low
- Define what each level means in your organization and apply it consistently
- Present low-confidence assessments honestly — they are still valuable if the reader knows the uncertainty
Avoid This
- State conclusions without confidence levels — it implies certainty you may not have
- Reserve briefs for high-confidence findings only — low-confidence early warnings are often the most valuable
- Let confidence inflate over time — a finding that was medium confidence last month does not become high confidence just because time passed
Corroboration is the mechanism that moves findings up the confidence scale. A single job posting is low confidence. That same job posting plus a patent filing in the same technology area moves to medium. Add an earnings call comment about "investing in new capabilities" and you have high confidence. The progression is always: single source to corroborated pattern to multiple independent confirmations. Document the corroboration chain so that anyone reading the brief can trace your reasoning and form their own judgment.