EI-201b · Module 2
Detecting Source Degradation
3 min read
Sources degrade. A once-reliable analyst leaves a firm and the quality drops. A newsletter gets acquired and the editorial standards shift. A vendor blog transitions from engineering-led content to marketing-led content and the signal-to-noise ratio collapses. Source degradation is rarely sudden — it is a gradual decline that is invisible if you are not measuring. The credibility scoring system catches it, but only if you are actually updating scores based on observed accuracy rather than historical reputation.
- Track Accuracy Trends Plot each source's credibility score over time. A source that was a 4 twelve months ago and is a 3 now is degrading. A source that has been stable at 4 for two years is reliable. The trend matters more than the current score — a degrading score-4 source will be a score-3 source next quarter.
- Monitor for Structural Changes Watch for editorial changes, ownership changes, staffing changes, and business model changes at your sources. A newsletter that adds a "sponsored content" section will start publishing signals that serve advertisers, not readers. A vendor blog that shifts from engineering updates to product marketing loses technical accuracy.
- Replace Before Failure When a source shows degradation, begin source acquisition for a replacement immediately — do not wait for the source to become unreliable. Running the old and new sources in parallel for one quarter validates the replacement before you depend on it.