| Choosing what to count |
OutputCounting what is easy — workshops held, participants enrolled — and calling those numbers the impact. |
OutcomeCounting what changed for the people served. The output stays in the report as context, not the headline. |
Whether the report measures effort or effect. The funder reads the headline first. |
| Tracking participants |
AnonymousOne end-of-program survey, or two surveys with no way to link a person's pre to their own post. |
LinkedA Persistent Contact ID assigned at first contact. Pre, post, and follow-up all link to the same record. |
Whether change is attributable at the individual level, not the cohort average. |
| Setting the metric scale |
VagueAspirational language — "improved wellbeing," "increased confidence." No scale, no threshold. |
BoundedA bounded scale named in the definition — a 1-to-10 score, a percent change, a yes-or-no threshold. |
Whether the metric is repeatable across cohorts, or only describes one report. |
| Numerator and denominator |
RawReporting the count alone — "served 500 people." Reach is unknowable; budget growth reads as progress. |
In contextReporting numerator over denominator — "served 500 of 800 eligible, 62 percent." Cohorts compare cleanly. |
Whether the metric scales with program size or just inflates with budget. |
| Numbers and words |
SeparatedA quantitative survey on one platform. Open-ended notes in a separate document. The two never align. |
On one recordScale and open-ended prompt collected in the same instrument, against the same record. Number plus reason. |
Whether the report can explain why a metric moved, not only whether it moved. |
| Choosing a comparison |
Inside onlyPre-to-post change reported as the impact, with no benchmark. "The economy got better" survives as a rival. |
ExternalPre-to-post change paired with a comparison — a waitlist cohort, a regional benchmark, a public dataset. |
Whether the program can credibly claim cause, not mere correlation. |
| Reporting cadence |
AnnualOne annual report, assembled from disconnected sources in the six weeks before the deadline. |
RollingQuarterly cohort reviews against the same metric set. The annual rollup is a summary, not a build. |
How fast the program can correct course when a metric drifts. |