Purpose
Build confidence in findings through transparency about data sources, methods, and limitations.
Prompts to Guide Your Writing:
• What research design did you use? (Pre/post, comparison group, longitudinal tracking)
• Who provided data? (Sample size, demographics, response rates)
• How was data collected? (Surveys, interviews, document review, observations)
• How was data analyzed? (Statistical methods, qualitative coding framework)
• What quality checks ensured data validity?
• What can't this evaluation claim due to design limitations?
- Research design: Evaluation type and approach (quasi-experimental, case study, mixed-methods)
- Data sources and sample: Who participated, response rates, representativeness assessment
- Data collection instruments: Survey tools, interview protocols, document analysis guides
- Analysis methods: Statistical approaches for quantitative data, coding process for qualitative data
- Quality assurance: Validation checks, triangulation, inter-rater reliability measures
- Limitations and mitigations: Honest assessment of what findings can and cannot conclude
✓ Best Practice
Frame limitations alongside strengths. "While we cannot assess causality without a control group, the consistent pre-post improvements across all cohorts and demographic subgroups provide strong evidence of program effectiveness."