What is youth impact?
Youth impact concerns the changes an initiative seeks to support in young people's lives and the evidence used to understand its contribution. Those changes might involve skills, belonging, opportunity, relationships or participation in decisions. Attendance shows reach; it does not, by itself, show what changed.
A useful youth-impact plan begins with the young people, the program's purpose and the decisions the evidence should inform. It can serve afterschool programs, professional or vocational training, mentoring, coaching and community initiatives. The measures should fit the setting rather than requiring every program to use the same survey.
Distinguish observed outcomes from a claim that the program caused them. Following the same participants over time can improve the analysis of change, but it does not rule out other influences.
Choose outcomes that matter to the program and young people
Start with a small number of important changes. Discuss what they mean with young people and relevant staff or partners. A funder's reporting request may be one input; it should not be the only reason a question is asked.
Scroll horizontally to see all columns →
| Area | Possible question | Evidence consideration |
|---|---|---|
| Access and participation | Who can join, attend and continue? | Distinguish enrollment, attendance and barriers to access |
| Learning and skills | What can participants explain or demonstrate? | Use an appropriate assessment; confidence is a different measure |
| Belonging and relationships | Do participants experience a supportive setting? | Use suitable measures and a safe way to express criticism |
| Application and opportunity | Can participants use what they learned? | Record opportunity and context alongside reported application |
| Agency and contribution | Can young people influence decisions that affect them? | Examine actual influence, not only whether feedback was collected |
These are planning areas, not a validated measurement instrument. Choose or develop measures appropriate to the population, language and intended use. If a framework or instrument has defined administration and scoring rules, follow them and document any adaptations.
Youth.gov's guidance on involving youth includes their role in identifying desired outcomes and developing evaluation instruments. Participation can start with deciding what is worth learning, rather than only answering adult-written questions.
Connect collection to the participant journey
Different points in a program answer different questions. Collect the information needed for the next decision, explain its purpose and avoid repeatedly asking for details already held appropriately.
Scroll horizontally to see all columns →
| Point in the journey | What to learn | Possible next action |
|---|---|---|
| Enrollment | Goals, relevant starting point and access needs | Prepare suitable participation arrangements |
| Early participation | Whether people can attend and what is getting in the way | Clarify a barrier and review practical support |
| During the program | Experience, learning and changing needs | Adjust delivery or discuss an appropriate follow-up |
| Exit or completion | What was delivered and what changed at this point | Plan transition and distinguish completion from outcome |
| Later follow-up | Whether changes persisted or were used | Review the program's longer-term assumptions |
A missed session is a signal to understand, not an automatic label of disengagement. A neutral question such as “What, if anything, made it difficult to attend?” leaves room for transport, scheduling, family responsibilities or other explanations. Staff should not infer sensitive circumstances from attendance alone.
When should you follow the same young people?
Match records when the question is about within-person change or an authorized support journey. Use a suitable stable identifier and a controlled matching process, keeping contact details separate where the design allows. Review duplicates, corrections and re-enrollment instead of assuming any system matches perfectly.
Anonymous surveys remain useful for some questions, including candid feedback about a setting. Repeated anonymous samples can describe group-level patterns, but they cannot establish how each individual changed. State the design honestly rather than treating anonymity as a defect.
Scroll horizontally to see all columns →
| Design | What it can help answer | Limit to report |
|---|---|---|
| Matched baseline and follow-up | How measured outcomes changed among the same observed participants | Missing follow-up and other influences remain important |
| Repeated anonymous surveys | How responses differ across observed groups or periods | Changes may reflect different respondents |
| Administrative participation records | Who enrolled, attended or completed defined activities | Participation alone does not show learning or well-being |
| Qualitative accounts | How participants describe experience, change and barriers | Accounts require context and appropriate interpretation |
Read pre- and post-survey design for planning the waves, and outcome evaluation for assessing what the results support.
Worked example: the average is only part of the story
Fictional example. An afterschool program enrolls 80 participants. Seventy provide a baseline response and 50 provide a later response. Forty-five have usable responses at both points.
- Matched analysis: 45 participants, or 56.25% of the enrolled cohort, can be included in the within-person comparison.
- Baseline without follow-up: 25 participants have a baseline response but no matched later response.
- Follow-up without baseline: five later respondents cannot be included in that paired comparison.
If 27 of the 45 matched participants show an increase on the defined measure, report 60% of the matched group. Do not call that 60% of all enrolled participants. Explain what “increase” means under the instrument and whether the size of change is meaningful for the question.
The 25 missing follow-ups may differ from those who responded. Compare available participation characteristics where appropriate, review why follow-up was missed and state the uncertainty. Do not fill missing results with assumed improvement or decline.
A pre/post increase is not proof that the program caused the change. Depending on the decision, a stronger evaluation may need other comparison evidence and a method suited to the context.
Use youth voice to understand the numbers
A score may show a pattern without explaining the experience behind it. Ask for useful accounts of what helped, what was difficult and what should change. Provide a way to decline and avoid asking for sensitive details that are unnecessary for the purpose.
For example, participants may report greater confidence but describe few opportunities to use a skill. That combination suggests a question about access or program design. It should not be simplified into a positive headline about successful application.
For larger volumes, a human-owned codebook can define themes and guide AI-assisted application across eligible responses. Review examples, contradictions and uncertain classifications. Keep the question, period and appropriate participant or group context attached. When definitions change, record which analysis used which version.
The practical difference is reducing repeated coding and manual joining while keeping interpretation reviewable. See the visual and worked effort example in qualitative and quantitative analysis. Savings depend on the volume, review requirements and workflow; automation does not remove the responsibility to interpret carefully.
Compare across schools or sites without imposing one survey
A network of youth programs may have different activities, languages and local needs. Agree a limited common core for the questions that genuinely need aggregation. Keep locally useful questions where they belong.
The shared dictionary should define the measure, unit, eligibility, period, response options, missing-value treatment and relevant source method. “Completed the program” may mean different things at two sites; either agree an appropriate common definition or keep the distinction visible.
For comparable rates, use the relevant counts rather than averaging percentages blindly. Fictional example: 30 of 50 eligible participants at one site and 8 of 10 at another give 38 of 60, or 63.3%, when the definitions and populations are compatible. The simple average of 60% and 80% would be 70% and would give the small site equal weight.
Some results should remain separate because the measures or settings differ. A clear explanation of non-comparability is more useful than a misleading combined score. See equity and access in education for examining who can participate and benefit.
Make participation safe and useful
Explain why information is collected, who will see it and how it may be used. Follow the consent, assent, safeguarding and ethical-review arrangements appropriate to the activity and setting. Design access and reporting around the purpose; a funder's need to understand results does not automatically justify access to identifiable youth records.
Check whether small groups, quotations or combined details could reveal someone even after names are removed. Keep support follow-up separate from anonymous feedback when that is the agreed design. Do not promise anonymity while using a record for individual outreach.
UNICEF's adolescent participation guidance addresses meaningful, safe involvement in monitoring and evaluation. A practical return to participants is to explain what was heard, what will change and what cannot change yet.
What should a connected youth-impact workflow make easier?
The operational challenge is often repeated assembly: matching permitted records, resolving changed definitions, finding comments, checking missing follow-up and rebuilding the report. A dashboard alone does not settle those decisions, though existing survey and case-management tools may support parts of the workflow.
Sopact's approach connects collection, relevant record context, quantitative and qualitative analysis, and review. For a participant journey, the goal is to keep authorized evidence with the correct person and enrollment. For anonymous learning, preserve the agreed group-level design.
Evaluate the fit with synthetic or appropriately authorized data. Include a re-enrollment, changed contact detail, missing wave, restricted note, corrected outcome and local survey variation. Have program staff reproduce one result and inspect its denominator and supporting evidence. Then test whether routine changes remain manageable without repeated specialist rebuilding.
Trained staff retain decisions about support and safeguarding. AI summaries should not automatically determine a young person's risk, eligibility or priority. Verify the controls needed for the actual program rather than assuming a general demonstration proves them.
Report findings that people can use
For each important result, state the outcome definition, population, period, source, calculation and limitations. Distinguish delivery from observed change and contribution from causality. Include youth perspectives where appropriate and authorized, and explain the next action with an owner.
Develop the practical collection and review plan through the Case Intelligence course, including the related youth-development framework lesson. For reporting, use the impact-report writing guide and reporting examples.
Watch: connect collection to useful evidence
This introduction explains the broader collection and evidence workflow. Apply it with the youth-specific participation, confidentiality and evaluation decisions described above.
Frequently asked questions
What is the difference between youth reach and youth impact?
Reach describes who participated or received an activity. Youth impact concerns changes in young people's lives and evidence about the initiative's contribution. Participation counts alone do not establish those changes.
Do all youth surveys need named participant records?
No. Match records when within-person analysis or authorized support requires it. Anonymous designs can be appropriate for other questions; report their group-level limits clearly.
How should missing follow-up be handled?
Show the eligible, responding and matched groups. Review available evidence about nonresponse and state the uncertainty. Do not assume missing participants improved or failed.
Can different sites use different surveys?
Yes. Agree the limited common fields and definitions needed for valid comparison, while retaining local questions and context. Keep incompatible measures separate.
Can a funder inspect individual youth records?
Only where the purpose, authorization and safeguards allow it. Many reporting needs can be met through appropriate aggregated or de-identified evidence without exposing personal records.
