Name the result precisely
Bridge might report completion, performance on the handoff exercise and later reported use. Each is a legitimate result if described accurately. Calling all three “impact” conceals the differences a client needs to understand.
For the exercise, define completion separately from competence. Finishing every session does not necessarily mean the participant met the behavior criteria. Likewise, a self-reported increase in confidence is not the same as independently demonstrated skill.
Put the definition beside the measure: unit, relevant population, collection moment, source, criterion and missing-data rule. A future colleague should be able to interpret it without asking the original course designer.
How different instruments support a common comparison
Start with a question the participating teams genuinely share. For each required field, define the unit, eligible population, period, response options, missing states and calculation. Record how each local field maps to that definition, who reviewed the mapping and which version applies.
Provider A uses a practical assignment; Provider B uses workplace observation. Both can supply a learner identifier, cohort and assessment date. Do not combine the two assessments as one score unless the evidence supports a common interpretation.
For example, completed task can map to demonstrated handoff skill only when the task and assessment criteria support that interpretation. A confidence rating cannot be converted into an observed skill score because both use five response options. Keep the original assessment, criterion version and result; show an unavailable observation rather than inventing a conversion.
Before combining records, check coverage and overlap as well as definitions. State which teams supplied usable evidence, which are pending and whether the same person or transaction appears in more than one source. Report separate results when populations, methods or permissions make combination inappropriate.
In a Sopact workflow, the shared definitions provide context for analysis while the connected record retains local responses, files and history. Your team can review a source-to-field mapping instead of redesigning every local survey. Test that configuration with sample records before relying on a combined result; a data dictionary cannot supply missing evidence or make incompatible measures equivalent.
Keep comparisons grounded in common definitions
If the rubric changes, preserve its version and the original judgments. Decide whether old and new results can be compared and state the limitation. Changing a label from “developing” to “proficient” does not create a continuous measurement scale.
Different client cohorts may practice different skills or have different opportunities to apply them. Report shared measures where they are meaningful and keep client-specific results separate. One portfolio average can conceal that one group was assessed on a different task.
Write a short claim and point to the evidence that supports it. “Six participants supplied a later account of using the handoff method” is narrower and more defensible than “The program transformed leadership across the organization.”
Treat ROI as a separate evaluation question
A client asking about ROI may mean financial return, useful behavior change or whether to renew. Clarify the decision before choosing a calculation. The course should not convert every observed rating increase into a currency value.
A financial comparison needs defined costs, benefits, timing and assumptions about what can be attributed to training. Staff time, implementation effort and opportunity to apply learning may matter. Where those inputs are unavailable, report the evidence you do have and the remaining question.
Use the dictionary to prevent accidental overstatement in recurring reports. AI can draft a narrative from approved evidence and rules, but a reviewer should check the denominator, claim and source. Consistent wording helps only when the underlying definitions remain meaningful.
Work through the Bridge example
This is a fictional teaching example. Adapt the fields and rules to the question your own training program needs to answer.
| Result | Evidence needed | Boundary |
|---|---|---|
| Participation | Defined attendance or completion record | Not proof of learning |
| Learning | Suitable task or assessment | Not automatically workplace application |
| Application | Dated evidence of use and opportunity | Not automatically caused by training |
| Financial return | Defined costs, benefits and attribution assumptions | Do not derive from satisfaction alone |
Build this part of your plan in more detail
These lessons address the next practical questions in this module. Choose the detail your workflow needs, then return to complete the exercise.
- How to Measure Outcome Duration and Drop-Off
Separate a later checkpoint from evidence of sustained change.
- How Do You Measure Change at Exit?
Separate matched change, response coverage and later outcomes.
More practical questions in this module (7)
- How Do You Compare Two Cohorts Fairly?
Check population, timing and coverage before interpreting a difference between groups.
- How Do You Analyze LMS Engagement Data?
Connect platform activity to learning evidence while checking timing, coverage and alternative delivery routes.
- How to Define Impact Metrics Your Team and Funder Can Use
For funder reporting, test which measures match, need a valid translation or require clarification.
- How Do You Connect Training to Results?
Connect behavior evidence to organizational results at the correct record level, without assuming causality.
- How Do You Analyze Survey Results by Demographic Subgroup?
Compare relevant groups while checking coverage, changing profiles, uncertainty and disclosure.
- Turn Reporting Requirements into Evidence: A Practical Mapping Guide
When audiences request different reports, map each requirement to an approved measure, source and unresolved gap.
- How Do You Estimate Impact With Thin Data?
When a claim exceeds the evidence, separate known results, missing coverage and planning assumptions before collecting more.
Add this part to your plan
On workbook page 5, define two results and write one supportable client-report sentence for each. List the claims the evidence cannot support. Map one local field to a common definition. Give one example that must remain separate.
Download workbook (fillable PDF)Compare with a suggested answer
The dictionary separates exercise performance from later use. Each statement identifies its source and population. It leaves financial ROI unresolved because no defensible cost, benefit and attribution analysis has been supplied.
Self-check: Can a client distinguish what was measured from what is still an assumption?
Questions you may have
Should every course report financial ROI?
Only where it serves the decision and the required evidence and method are available. Learning and application can be useful outcomes without being monetized.
Can different cohorts be combined?
Only where the definitions and populations support the intended comparison. Preserve meaningful differences and state coverage.
Apply the method to your work
Use the five-part plan to assess the sources, analysis and permissions your team needs. The solution page shows where a connected platform can support that workflow.
Explore the training and programs solution →