Additional course links
This lesson is for job-training providers, program leads, development teams and evaluators preparing a grant report. Bring the award requirements, your exit findings and the dated support notes. Leave with a report outline, a checked indicator table and an explanation of variances. The fictional dataset below is a separate reporting exercise; its counts are self-contained and do not depend on another lesson.
Watch: Training evaluation with the Kirkpatrick model
7 minutes 21 seconds · Related training-evaluation demonstration; this is not the complete grant-reporting workflow.
▶ Play the training-evaluation video
Build the reporting pack
- Start with the grant agreement and reporting template — signed proposal, approved budget, required indicators, targets, reporting period, special conditions.
- Define the reporting cohort and period — who is in, who is out, and the exact window.
- Lock indicators, targets, and calculation rules — a justified indicator set for each outcome, including required measures and relevant quality or coverage checks.
- Connect and validate the evidence sources — join waves on a generated ID; check coverage and quality.
- Calculate results with denominators and data-quality notes — matched samples, missing-data treatment, self-reported vs verified.
- Explain variance, equity, contribution, and limitations — including where observed change is not a causal claim, and any negative or unintended effects.
- Add consented stories, then review, approve, and submit — human sign-off on wording and disclosure risk.
Step 1 — Start with the grant agreement, not a blank report
The signed proposal, grant agreement, approved budget, reporting template, indicators, targets, reporting period, and special conditions govern the report. Requirements vary widely across foundations, government grants, corporate philanthropy, and multiyear or pay-for-success awards — so retrieve the actual template first. The analytical questions below supplement the grant requirements; they do not replace them.
For US federal awards, 2 CFR 200.301 addresses communicating performance expectations in the award. 2 CFR 200.329 connects performance and financial reporting and covers explanations of missed goals and cost overruns. Those federal provisions do not automatically govern a private foundation award; use the requirements that apply to your grant.
Activities, outputs, outcomes, and impact — what can you claim?
Don't confuse activities and outputs with outcomes — but don't refuse them either. Report required delivery measures concisely, then connect them to reach, quality, outcomes, and variance. Activity-to-outcome test: if a measure describes what the program delivered, label it an activity or output; keep it where the funder requires it or where it explains reach, fidelity, cost, or variance.
And be precise about what your evidence design lets you claim. A before/after cohort comparison shows observed change, not necessarily causal impact (contribution analysis is a defensible middle path):
| Evidence design | Defensible wording |
|---|---|
| Post-program data only | "Participants reported the following outcomes" |
| Matched pre/post data | "Measured outcomes changed among matched respondents" |
| Pre/post + contribution evidence | "Evidence suggests the program contributed to the observed change" |
| Carefully designed / quasi-experimental comparison | "The estimated program effect was… (with design limitations)" |
| Randomized experimental design | "Assignment to the program produced an estimated effect of…" |
| Anecdotal evidence only | "Participants described perceived changes; prevalence is unknown" |
Review negative and unintended outcomes as well as intended benefits — for example, debt incurred during unpaid training, employment instability, displacement, or participants entering jobs with inadequate hours.
The framework: an evidence trail behind every number
The unit of funder evidence is not a number plus a quote — a quote can illustrate a result but cannot validate the calculation, prove representativeness, or establish cause. The unit is an evidence trail: each finding traced to its definition, population, measure, sample, period, source, calculation, missing data, quality note, interpretation, and (optionally) a consented illustration.
| Evidence element | Example |
|---|---|
| Indicator definition | Hourly wage at six-month follow-up |
| Population | All eligible starters; wage statistic uses the matched subgroup |
| Numerator / measure | Reported gross hourly wage |
| Denominator / sample | 41 participants with comparable wage observations |
| Reporting period | Jan–Jun 2027 cohort |
| Source | Intake and six-month follow-up |
| Calculation | Separate intake and follow-up medians among the same matched respondents |
| Missing data | 39 of 80 starters lack comparable wage pairs |
| Data-quality note | Self-reported; not employer-verified |
| Interpretation | Descriptive change, not causal attribution |
| Illustrative evidence | Consented participant quotation |
Data-quality terms (validity, integrity, precision, reliability, timeliness) follow standard MEL data-quality practice; document how each applies to your indicators.
Steps 2–3 — Define the cohort, lock indicators and targets
Define exactly who belongs in the reporting cohort and the observation window. Agree the indicator set, targets and calculation rules before examining results. There is no universal requirement for one indicator per outcome: select enough measures to support the decision and meet the award, without unnecessary collection. Document definitions in your data dictionary. If standardized metrics are required, use the standards-mapping lesson to record the exact metric and version.
Fictional worked example — a fictional training cohort (organization, participants, and figures illustrative). "Living-wage employment" is not one number — a median can be high among a few employed respondents while most are unemployed — so the primary indicator counts the whole cohort:
| Outcome | Primary indicator + target | Supporting indicators |
|---|---|---|
| Living-wage employment | ≥50% of the eligible cohort employed at or above the defined living-wage threshold at 6 months | Employment rate; median wage among employed; hours; benefits; retention; matched-response coverage; subgroup gaps |
| Job-ready confidence | +2.5 pts on an illustrative 1–10 confidence self-rating, intake→exit | Compatible measure at each wave; matched respondents; review whether the threshold is meaningful |
| Completion | 70% completers / enrolled | Reasons for non-completion |
Define the threshold explicitly: living-wage threshold = $X/hour, per [source], [geography], [household assumption], updated [date]. If the grant fixes it, call it a "grant-defined wage threshold of $20/hour" rather than a universal "living wage." For the confidence scale, state what it measures, that the same item is used at both points, how the mean is computed, what counts as meaningful change, whether validation evidence exists, and matched-response coverage — otherwise "+3.1" is reproducible but not necessarily meaningful.
Steps 4–5 — Connect sources, calculate with denominators and data-quality notes
Join reporting waves on internal participant and enrollment identifiers, with dates and measure versions. Restrict access to direct identifiers. A fictional statement might read: “Among 41 participants with comparable wage records at intake and six months, the median self-reported hourly wage was $9.96 at intake and $25.11 at follow-up. These 41 represent 51.25% of 80 eligible starters. This describes the paired sample; it does not establish the program’s causal effect.” The difference between those two medians is not necessarily the median of individual wage changes. Calculate the statistic your indicator actually specifies.
The fictional reporting cohort has 80 enrolled, 62 completed and 58 credentialed participants. Administrative records document 29 program-assisted placements. At six months, 60 participants have known employment status; 41 have comparable wage observations, and 32 meet the grant-defined $20 hourly threshold. Program-assisted placements and all current employment are different measures. Keep those definitions separate.
| Measure | Agreed target | Fictional result | Coverage and interpretation |
|---|---|---|---|
| Confidence self-rating | Mean paired change +2.5 points | +3.1 points | 55 comparable pairs of 80 starters (68.75%); illustrative scale, descriptive change |
| Employment at the grant-defined wage threshold | At least 50% of 80 eligible starters at six months | 32 known qualifying participants / 80 = 40% | Eligibility for this wage-threshold outcome is known for 60 of 80 (75%), including those not employed; 20 are unknown. The 41 matched wage pairs are a separate measure. Do not assume unknowns qualify or fail. |
| Hourly wage, supporting measure | No separate target in this example | Median $25.11 at follow-up; $9.96 at intake | 41 comparable pairs of 80 (51.25%); median wage does not answer the employment-rate target |
| Completion | 70% of enrolled participants | 62 / 80 = 77.5% | Complete administrative records; completion is the measured result |
| Program-assisted placement count | 30 | 29 | Documented program placements; different from employment obtained through any route |
| Twelve-month retention | Not established | Not available | No twelve-month observation yet; do not label missing measurement as zero retention |
Equity, reported responsibly: show subgroup results only where sample sizes support privacy and interpretation. Show counts with percentages, apply an appropriate disclosure rule; combine cells only when the combined category remains meaningful, and avoid ranking groups when uncertainty is high. Never combine demographic, wage, barrier, and narrative detail in a way that could re-identify a participant.
What do the 20 unknown outcomes mean? The known qualifying share is 32/80, or 40%. If all 20 unknowns qualified, it would be 52/80, or 65%. This is a missing-data bound, not a confidence interval. The available data do not establish whether the true cohort rate met the 50% target. Show both the known result and the uncertainty.
Connect performance with financial stewardship
A credible report reconciles performance with expenditure. Report budget vs actual with variance and action; financial figures reconcile to the approved budget and accounting records (fictional; illustrative):
| Budget category | Approved | Actual | Variance | Explanation / action |
|---|---|---|---|---|
| Training delivery | $240,000 | $252,000 | +$12,000 | Additional instructor; approved modification |
| Participant support | $100,000 | $78,000 | −$22,000 | Transportation uptake lower than forecast |
| Placement support | $120,000 | $135,000 | +$15,000 | Employer-matching workload exceeded plan |
| Evaluation / reporting | $40,000 | $38,000 | −$2,000 | Within plan |
In this fictional budget, approved costs total $500,000 and actual costs total $503,000, an overall $3,000 overspend. Category variances still need explanation even when they partly offset. Program systems may connect expenditure to delivery and outcomes, but they should not replace the accounting system — final figures reconcile there.
Step 6 — Explain variance, then grade every claim
Every material variance gets an evidence-based explanation and a corrective action with an owner:
| Finding | Variance | Evidence-based explanation | Corrective action |
|---|---|---|---|
| Placement target | 29 vs 30 | Fictional employer feedback suggests a credential mismatch; test this alongside other explanations | Review employer requirements and participant preferences before changing provision |
| Follow-up coverage | 41 of 80 comparable wage pairs | Document missingness reasons; distinguish no current job from an unanswered wage question | Confirm contact details at exit; add reminder sequence |
| Subgroup outcome | Cell below threshold | Too few records to report safely | Review a safe, meaningful reporting option; do not combine incompatible periods or assume quotations remove disclosure risk |
Then grade each claim by the strength of its evidence trail — including a Contradicted grade for evidence that runs the opposite way:
| Grade | Rule | Permitted wording |
|---|---|---|
| Strongly supported | Defined indicator, complete/high-quality data, reproducible calculation, limitations disclosed | "The cohort achieved…" |
| Supported with limitations | Relevant data and calculation exist, but coverage/quality incomplete | "Among respondents…" |
| Qualitatively supported | Repeated themes/cases exist, prevalence unknown | "Participants described…" |
| Not yet supported | Relevant data exist but not adequately analyzed | "Further analysis is required…" |
| Not measured | No appropriate indicator or source | "The program did not measure…" |
| Contradicted | Reliable evidence indicates a materially different or opposite finding | "The evidence indicates that…" / "The proposed claim was contradicted by…" |
On SROI and economic value
Economic or social-value analysis belongs in a funder report when useful or required and methodologically justified. If you include SROI, show or link the calculation with attribution/contribution adjustment, deadweight, displacement, drop-off, duration, proxy source and date, sensitivity analysis, no double counting, and a clear split of observed vs modeled value — never a bare "SROI ≈ 2.44:1."
Step 7 — Use AI to draft and grade, with human review
Use AI to draft the structure, assemble each finding's evidence trail, and propose a claim grade — then a person reviews and approves the wording and disclosure risk. Do not promise identical AI output every run; apply the same documented rubric each cycle and save the model version, prompt version, source set, and output so results can be reviewed and reproduced as closely as possible.
Where Sopact keeps the report current — and where humans decide
| Reporting need | Sopact function | Human responsibility |
|---|---|---|
| Connect reporting waves | Persistent generated participant ID | Resolve questionable matches |
| Standardize indicators | Shared data dictionary | Approve definitions |
| Validate records | Field rules and anomaly flags | Investigate exceptions |
| Analyze open text | Candidate themes + preserved quotations | Review interpretations |
| Calculate outcomes | Reusable cohort queries | Approve cohort and formula |
| Grade claims | Evidence-completeness rubric | Decide final wording |
| Protect participants | Access controls & de-identification | Confirm consent & disclosure risk |
In a configured Sopact workflow, teams can collect responses and documents, link them to participants, apply agreed definitions and prepare analysis as records arrive. These steps can reduce repeated assembly work. Staff still check source quality, resolve exceptions, approve disclosure and decide what a finding supports. A maintained record helps reporting; it does not guarantee that the underlying evidence is complete or correct.
Frequently asked questions
How do you create a funder impact report from cohort data?
Start from the signed grant requirements, define the cohort and period, lock indicators and targets, connect and validate sources on a generated ID, calculate results with denominators and data-quality notes, explain variance/equity/contribution/limitations, then add consented stories and complete human review before submission.
What should a funder impact report include?
Whatever the grant agreement requires — commonly objectives, delivery and outputs, cohort reach, outcomes vs targets, budget vs actual and variance, equity findings, challenges and corrective action, limitations, participant stories, next-period plan, and a methodology/evidence appendix. Begin with the funder's template, not a generic outline.
What's the difference between an output, an outcome, and impact?
Outputs describe what was delivered; outcomes describe participant change; impact is the change attributable to — or credibly influenced by — the program, considering what likely would have happened otherwise. A contribution analysis can support a credible contribution claim without necessarily estimating a precise causal share. Report outputs where required, but don't present them as outcomes, or call observed change "impact" without a credible counterfactual.
How do you substantiate a claim in an impact report?
Give each major finding an evidence trail: indicator definition, population, measure, sample/denominator, period, source, calculation, missing-data treatment, quality note, and interpretation. A participant quote can illustrate the finding with consent, but it does not substantiate the number.
Should a funder report include SROI?
When it is required or useful to the reporting decision, and methodologically justified. If included, show the calculation with attribution/deadweight/displacement/drop-off adjustments, proxy source and date, sensitivity analysis, and a clear split of observed vs modeled value.
Can AI write a reliable funder report?
AI can draft the structure, assemble evidence trails, and propose claim grades quickly, but general-purpose models don't guarantee identical output every run. Apply a documented rubric, save the model/prompt/source versions, and keep human review and final authority over wording and disclosure.
Sources & versions
- Federal grant performance measurement & reporting — 2 CFR 200.301 and 2 CFR 200.329.
- Contribution analysis — BetterEvaluation.
- Build the dictionary first: How to build a data dictionary.
By Sopact Academy · Updated September 12, 2026. Organizations, participant records and numerical examples in this lesson are fictional.
The placement / investor companion: the same records read for the earned-revenue placement side and reported to impact investors — How to report job placements to impact investors: impact performance beside accounting-reconciled financials, unit economics, risk, and capital scenarios.
Exercise: prepare a report for a colleague to check
- Copy one reporting requirement exactly and identify its approved definition and period.
- Calculate the result from a small source set. Show the numerator, denominator and exclusions.
- Ask a colleague to reproduce it without help. Record any ambiguity.
- Draft the finding, variance and limitation together. Mark explanations as confirmed or still under review.
- Assign the next action and approval owner. Do not invent a commitment that has not been agreed.
For a report structure you can adapt, read How to Write an Impact Report. Browse Sopact’s report examples for presentation ideas, then return to your funder’s requirements. If monetary valuation is relevant, continue to the SROI calculation lesson.