play icon for videos
← Academy
SOPACT ACADEMY · PORTFOLIO INTELLIGENCE · ANALYZE

How Do I Evaluate an Accelerator or Startup Cohort?

Counting applicants and graduates isn't evaluation. Baseline every founder at intake, track the same outcomes through the program, and compare cohorts on identical measures so you can prove what actually changed.

In short: Evaluating an accelerator or startup cohort means measuring what actually changed for founders between intake and demo day and beyond — readiness, traction, capability, and survival — not just counting how many companies applied and graduated. A real evaluation baselines every founder at intake, tracks the same measures through the program, and compares this cohort to the last one on identical questions. Sopact keeps each founder on one record under a persistent Contact ID, so intake, in-program milestones, and post-program follow-up stay comparable across cohorts.

Most programs already collect two things: an application at the front and a demo-day survey at the end. The problem shows up the moment someone asks a harder question. Was this cohort stronger than last year's? Which founders gained the most confidence, and on what? Where are the companies from two cohorts ago now? The application and the exit survey were built in different tools, use different questions, and were never linked to the same founder — so the answer is a guess. You can report outputs. You cannot yet report outcomes.

1 · Baseline every founder at intake

Evaluation starts before the program does. Capture each founder's starting point at intake: current revenue and users, funding raised to date, a self-rated readiness or confidence score, and the specific capability gaps they name in their own words. This baseline is the "before" half of every claim you will make later, so collect it the same way for every founder. In Sopact each founder becomes one Contact record at intake, and that Contact ID persists through the whole program — every later survey, milestone, and follow-up attaches to the same record instead of living in a separate spreadsheet.

2 · Define the founder outcomes your program drives

Decide what your accelerator is actually trying to move, and separate it cleanly from what you happen to count. Outputs are activity: applications received, companies admitted, mentoring sessions delivered, demo-day attendance. Outcomes are change in the founder or the company: readiness and confidence gained, traction (revenue, users, funding raised), new capability, and, later, company survival and follow-on investment. Write two or three outcome measures you will ask about at intake and at exit using the same wording, so the before/after comparison is honest rather than reworded.

3 · Track milestones through the cohort

Don't wait for demo day to learn how the cohort is doing. Track a short set of milestones at fixed points — a mid-program check-in, a mentor assessment, a metrics update — against the same measures you baselined. Because every check-in writes back to the founder's persistent Contact ID, you can see movement per founder over the program instead of one snapshot at the end, and you can flag a founder who is stalling while there is still time to intervene.

4 · Compare cohorts on the same measures

A cohort evaluation only means something next to another cohort. Ask the identical intake and exit questions of every cohort, so this year's readiness gain, traction change, and completion sit beside last year's on the same scale. When the questions drift year to year, the comparison quietly breaks; keeping one measure set on one data model is what lets you say "this cohort raised more follow-on funding than the last two" and defend it. Watch for confounds; a stronger applicant pool, not a better program, can lift the numbers.

5 · Follow founders after demo day

The outcomes funders care about most land after the program ends: which companies are still operating a year later, which raised a priced round, which hired their first employees. This is longitudinal work, and it only functions if the post-program survey reaches the same founder record you baselined at intake. Because the Contact ID persists after graduation, a six-month or twelve-month follow-up sits on the same timeline as intake and demo day — so survival and follow-on investment become a measured trend, not an anecdote you chase down over email.

6 · Analyze the open-ended feedback, don't just read it

Founders and mentors write the most useful things in the comment boxes: what unblocked them, what the program missed, what they still can't do. Theme that qualitative feedback the same way each cohort: pull the recurring barriers, the capability gains founders describe unprompted, and the mentor observations, so the story lines up with the numbers instead of sitting in a folder no one reopens.

Three prompts you can run against your own cohort data once it sits on one record:

Compare pre-program and post-program founder readiness scores for [COHORT YEAR A] and [COHORT YEAR B]. Report the average gain per cohort, the share of founders who improved, and any measure where the newer cohort did worse.
Using post-demo-day and [N]-month follow-up data, list the founders in [COHORT] by traction change (revenue, users, funding raised) and flag any company with no activity since graduation as a survival risk.
Theme the open-ended mentor and founder feedback from [COHORT] into the top 5 recurring barriers and the top 5 capability gains founders describe in their own words. Quote two verbatim responses per theme.

GRADE: green | one founder record from intake through post-program, same measures every cohort | a few questions reworded between years; amber | application and exit survey linked but no mid-program or post-program tracking | cohorts comparable on outputs only; red | applications and demo-day survey in separate tools, no shared founder ID | counting applicants and graduates and calling it evaluation.

Tricks, tips, and troubleshooting

Ask the outcome question at intake, not just at exit. The most common evaluation failure is having a great demo-day survey and no baseline to compare it against. If you only measure readiness at the end, you can report a level but never a gain. Add the same two or three outcome questions to your application form.

Freeze your measure set before you launch the cohort. Every time a question changes wording between cohorts, that measure drops out of your year-over-year comparison. Lock the core intake and exit questions, and add new ones as extras rather than by rewriting the ones you need to trend.

Separate a stronger cohort from a stronger program. If this year's numbers jumped, check whether your applicant pool got stronger before you credit the curriculum. Compare intake baselines across cohorts first; a higher starting point explains a lot of "improvement." See how to compare cohorts without being fooled by confounds.

Don't let post-program follow-up depend on chasing email. Founders scatter after demo day. If the follow-up survey isn't tied to the same record you built at intake, response rates collapse and your longitudinal data gets thin. Keep everyone on one persistent record and schedule the follow-up as part of the program, not as an afterthought.

Frequently asked questions

What metrics should an accelerator track?

Track both outputs and outcomes, and keep them labeled separately. Outputs are activity you can count: applications received, companies admitted, sessions delivered, demo-day attendance. Outcomes are what changed for founders: readiness and confidence gain, traction (revenue, users, funding raised), new capability, company survival, and follow-on investment. A useful accelerator evaluation reports the outcomes as before/after changes, with the outputs as context, not the other way around.

How do you compare cohorts over time?

Ask every cohort the same intake and exit questions on the same scale, and keep each founder on one persistent record so the numbers line up. Comparison breaks when questions get reworded year to year or when data lives in separate tools. In Sopact, holding one measure set across cohorts under a stable Contact ID is what lets an accelerator say a cohort improved and show the evidence, while still checking whether a stronger applicant pool, not the program, drove the change.

What is the difference between outputs and outcomes for an accelerator?

Outputs describe what the accelerator did: how many startups it admitted, how many mentoring hours it delivered, how many founders showed up to demo day. Outcomes describe what happened to the founders because of it: they got more investment-ready, grew revenue or users, raised follow-on funding, or kept the company alive a year later. Outputs are easy to count and easy to game; outcomes require a baseline and follow-up, which is why most cohort reports stop at outputs.

How do you follow founders after the program?

Send a scheduled follow-up survey — commonly at six and twelve months — to the same founder record you created at intake, and measure survival, traction, and follow-on investment against that starting baseline. The follow-up only works longitudinally if it attaches to a persistent ID rather than a fresh, unlinked form. Treat it as a built-in program milestone, and see longitudinal data collection for how the same record carries across time.

How does Sopact evaluate accelerator cohorts?

Sopact keeps each founder on one record under a persistent Contact ID, so a cohort's intake baseline, in-program milestones, demo-day results, and post-program follow-up all sit on the same timeline instead of in separate tools. Because every cohort answers the same measure set on that shared model, Sopact can compare cohorts on identical outcomes, track traction and survival after graduation, and theme the open-ended founder and mentor feedback alongside the numbers. See accelerator software, the broader practice of impact measurement, and how to analyze pre, mid, and post survey data for the mechanics behind each step.

Ready to try it for yourself?

ChatGPT, Claude, and Gemini are fine for a quick test — but not for an answer you'll put in front of a funder or board. When it has to hold up, run it in Sopact Sense.

Try it in Sopact →
The Loop
The Loop — the method in one read
the-loop
Loop
The method
0
One continuous method for reliable, traceable AI reporting across case, application, grant, and program workflows: collect clean, analyze on arrival, and improve in time.
Teams running cases, applications, grants, or programs that need AI-assisted reporting they can reproduce, trace to source evidence, and act on before the cycle ends.
What Is Case Intelligence?
What Is Case Intelligence?
what-is-case-intelligence
Case
Foundation
1
One current, traceable record for each person—connecting intake, services, notes, surveys, documents, outcomes, decisions, and follow-up.
Workforce and training · Youth and mentoring · Case management · Scholarships · Accelerators · Education · Nonprofit programs
What Is Grant Intelligence?
What Is Grant Intelligence?
what-is-grant-intelligence
Grant
Foundation
1
One connected evidence record from application and committee review through the awarded grant, grantee reporting, renewal, and board accountability.
Foundations and grantmakers · Public grant programs · Scholarships and fellowships · Accelerators
What Is Portfolio Intelligence?
What Is Portfolio Intelligence?
what-is-portfolio-intelligence
Portfolio
Strategy
1
A source-linked portfolio view that connects each investee or grantee's agreed plan, reporting cadence, evidence, risks, and results.
Impact funds and investors · Foundations with grant portfolios · Family offices · Blended-finance vehicles
What Is Connected Data Intelligence?
What Is Connected Data Intelligence?
connected-data-intelligence
Feedback
Foundation
1
Keep evidence from surveys, files, notes, documents, systems, sites, and reporting periods connected to one continuing record.
Multi-program nonprofits · Member and chapter networks · Research associations · Training and coaching teams · Organizations with scattered evidence
What Is Impact Measurement and Reporting?
What Is Impact Measurement and Reporting?
embedded-impact-measurement
Reporting
Align
1
Define intended change, align organization and funder context, govern measures, interpret evidence, and produce traceable reports for decisions.
Program and impact teams · MEL leads · Funders and donors · Foundations · Impact funds · Organizations building rigorous impact reports
The Loop Methodology
Methodology — continuous, not annual
loop-methodology
Loop
The method
1
The continuous collect–analyze–improve cycle, adopted as an experiment: start with the step that already pays and add one data-collection step at a time.
Teams tired of rebuilding spreadsheets and forms who want a measurement system that compounds instead of resetting.
How to Build a Theory of Change with AI: Prompts, Workflow & Examples
Build a Theory of Change You Can Test
how-to-build-a-theory-of-change
Reporting
Align
2
How Do You Onboard a Portfolio and Track Results?
Onboard a Portfolio & Lock the Impact Agreement
onboard-portfolio-lock-impact-agreement-track-results
Portfolio
Data Dictionary
2
The Loop: Reliability
Reliability — the same answer twice
loop-reliability
Loop
The method
2
Determinism as a feature: the same question over the same data returns the same answer every run — the opposite of a generic AI chat that drifts.
Anyone who has watched a general AI tool give two different numbers for the same question and needs results they can stand behind.
How to Design a Fair Application and Selection Process
Design an Application Process
how-to-design-an-application-process
Grant
Foundation
2
Which Shape Is Your Data?
Which shape is your data?
which-shape-is-your-data
Feedback
Foundation
2
How Do You Build a Logic Model?
Build a Logic Model You Can Use
how-to-build-a-logic-model
Reporting
Align
3
How Do You Onboard a Grant or RFP Program?
Onboard a Grant or RFP Program
how-to-onboard-a-grant-rfp-program
Grant
Foundation
3
Theory of Change to Data Collection: A Four-Step Workflow
Turn a Theory of Change into a Data-Collection Workflow
theory-of-change-to-data-collection-workflow
Case
Foundation
3
How Do You Map Portfolio Data to IRIS+, GRI, and ESRS?
One Data Dictionary & Standards Mapping (IRIS+ / GRI / ESRS / CSRD)
portfolio-data-dictionary-standards-mapping
Portfolio
Chapters
3
The Loop: Traceability & Transparency
Traceability & Transparency
loop-traceability
Loop
The method
3
Every figure links back to the exact response, note, or document it came from — a full audit trail from headline result to raw evidence.
Teams whose numbers get scrutinized — by funders, boards, auditors, or standards — and who need to answer where did this come from on the spot.
How Do You Change a Question Without Breaking the Record?
Change questions without breaking the record
change-questions-without-breaking-the-record
Feedback
Control
3
Versioning questions and rules so a programme team can improve the instrument mid-cycle without silently breaking the trend line.
Programme & MEL leads · Teams whose questionnaire has ossified · Anyone evaluating a platform where configuration is a purchased service
What Are the IMP Five Dimensions of Impact?
Use the Five Dimensions to Test the Evidence
five-dimensions-of-impact
Reporting
Align
4
How Do You Design a Grant Rubric and Eligibility Rules?
Design Your Rubric & Eligibility Rules
grant-rubric-eligibility-rules
Grant
Foundation
4
How Do You Frame Portfolio Outcomes Over Outputs?
Frame Outcomes Over Outputs at Portfolio Level
frame-outcomes-portfolio-level
Portfolio
Chapters
4
The Loop: Flexibility
Flexibility — one method, four workflows
loop-flexibility
Loop
The method
4
The same collect–analyze–improve cycle, shaped to four kinds of impact work — case, grant, portfolio, and feedback — each shown end to end.
Anyone deciding where the Loop fits their work, who wants to see the full path from messy input to a report they can defend.
How Do You Collect Feedback Offline and in the Field?
Collect Feedback Offline & in the Field
collect-feedback-offline
Feedback
Connect
4
Capturing stakeholder feedback where there's no connectivity and syncing each answer to one continuing record — so field and multi-site programs keep a single identity from intake to endline.
Field & multi-site programs · Low-connectivity contexts · Nonprofits collecting in person
How Do You Design an Intake Form for a Baseline?
Design an Intake Form That Captures a Usable Baseline
intake-form-usable-baseline
Case
Nonprofit Track
5
What's the Difference Between Outcomes and Outputs?
Outcomes vs Outputs
frame-outcomes-over-outputs
Grant
Foundation
5
How Do You Do Pre-Investment Due Diligence?
Pre-Investment Due Diligence & Screening
pre-investment-due-diligence-screening
Portfolio
Chapters
5
The Loop Guarantee
The Guarantee — first workflow in 2 months
loop-guarantee
Loop
The method
5
How Do You Build an Organization Evidence Model?
Build the Organization Evidence Model
build-organization-evidence-model
Reporting
Align
5
How Do You Use Documents as Evidence?
Read documents as evidence
read-documents-as-evidence
Feedback
Connect
5
How to Clean Open-Ended Survey Responses
Clean Open-Ended Responses at the Source
clean-open-ended-survey-responses
Feedback
Clean
6
How Do You Spot At-Risk Participants Mid-Program?
Spot At-Risk Participants Mid-Program
spot-at-risk-participants-mid-program
Case
Nonprofit Track
6
How to Write a Nonprofit Grant Application: Template and Example
Grant Application for Nonprofits
grant-application-for-nonprofit-organizations
Grant
Foundation
6
How Do You Collect Investee Reporting Without Burden?
Collect Standardized Reporting from Every Investee, Without Burden
collect-investee-reporting-without-burden
Portfolio
Chapters
6
How Do You Build a Funder Context Profile?
Build a Sourced Funder Context Profile
build-funder-context-profile
Reporting
Align
6
How Do You Measure Change at Exit?
Measure Change at Exit (Not Just Completion)
measure-change-at-exit
Case
Nonprofit Track
7
How Do You Collect Applications Clean at the Source?
Collect Applications Clean at the Source
collect-applications-clean-at-source
Grant
Collect
7
How Do You Chase Missing Investee Data?
Chase Missing Investee Data — Automatically
chase-missing-investee-data
Portfolio
Chapters
7
How Do You Analyze Multilingual Feedback?
Analyze Multilingual Feedback
analyze-multilingual-feedback
Feedback
Clean
7
Cleaning and theming multilingual open-ended feedback across languages on one continuing record — every theme cited to the person's own words, with no manual translate-then-code step.
Multi-country programs · Multilingual survey data · Global networks & chapters
How Do You Define Measures the Organization and Funder Can Both Use?
Define Measures the Organization and Funder Can Both Use
define-impact-metrics-funders-want
Reporting
Align
7
How Do You Find Who Is Missing Survey Waves?
Survey attrition — who is missing waves
survey-attrition-longitudinal-studies
Feedback
Read
8
How to Catch At-Risk Participants Early with Mentor Notes
Catch At-Risk Participants Early with Mentor Notes
mentor-notes-early-warning
Case
Nonprofit Track
8
How Do You Reduce Applicant Burden?
Reduce Applicant Burden
reduce-applicant-burden-auto-clarification
Grant
Collect
8
How Do You Analyze Investee Reports?
Read Investee Reports Across Qual + Quant + Financial + Social
read-investee-reports-multi-signal
Portfolio
Chapters
8
How Do You Define an Impact Metric So Everyone Counts It the Same Way?
Give Every Number One Definition
one-definition-for-every-number
Reporting
Define
8
How Do You Connect Quantitative and Qualitative Data?
Connect Quantitative & Qualitative Data
connect-quantitative-qualitative-survey-data
Feedback
Read
9
How Do You Calculate SROI Live?
Calculate SROI — Live, Sourced, and Honest
calculate-sroi-live
Case
Nonprofit Track
9
How Do You Collect Grantee Reports Without Burden?
Collect Grantee Reports Without Burden
collect-grantee-reporting-without-burden
Grant
Collect
9
How Do You Track Investees Against the Impact Agreement?
Track Investees Against the Impact Agreement (Variance)
track-investees-impact-agreement-variance
Portfolio
Chapters
9
How Do You Turn Reporting Requirements Into Evidence You Can Collect?
Turn Requirements Into Collectable Evidence
turn-reporting-requirements-into-evidence
Reporting
Define
9
How to Analyze Pre and Post Survey Data
Analyze Pre / Mid / Post Data
analyze-pre-mid-post-survey-data
Feedback
Read
10
How to Report a Job-Training Program to Grant Funders
Turn a Cohort into a Funder Impact Report
job-training-grant-impact-report
Case
Nonprofit Track
10
How Do You Chase Missing Grantee Data?
Chase Missing Grantee Data
chase-missing-grantee-data
Grant
Collect
10
How Do You Monitor Portfolio Risk in Real Time?
Portfolio Risk Monitoring & Early-Warning Alerts
portfolio-risk-monitoring-alerts
Portfolio
Chapters
10
How Do You Collect Clean Evidence Inside the Workflow?
Collect Clean Evidence Inside the Workflow
collect-clean-data-at-the-source
Reporting
Embed
10
How Do You Analyze Longitudinal Survey Data?
Track One Person’s Change Across Years
analyze-longitudinal-survey-data
Feedback
Read
11
How Do You Turn a Job Description Into a Checklist?
Turn a Job Description into a Requirements Checklist
job-description-requirements-checklist
Case
Social Enterprise Track
11
How Do You Review Applications Without Reviewer Bias?
Review Without Reviewer Bias
review-applications-without-reviewer-bias
Grant
Analyze
11
Ask Your Whole Portfolio Anything (Claude + MCP)
Ask Your Whole Portfolio Anything (Claude + MCP)
ask-your-portfolio-anything
Portfolio
Chapters
11
How Do You Get Stable Results From Governed Data?
Get Stable Results From Governed Data
same-numbers-every-time
Reporting
Read
11
How Do You Analyze a Batch of Grant Applications?
Analyze a Whole Round
how-to-analyze-a-batch-of-grant-applications
Grant
Analyze
12
How Long Do Program Outcomes Last?
Measure how long outcomes last
measure-outcome-duration-drop-off
Feedback
Read
12
How Do You Score Candidate-Role Matches Without Bias?
Score Candidate–Role Matches Without Bias
score-candidate-role-matches-without-bias
Case
Social Enterprise Track
12
How Do You Trace Every Result Back to Its Evidence?
Trace Every Result Back to Its Evidence
where-every-number-came-from
Reporting
Read
12
How Do You Roll Up a Grant Portfolio?
Aggregate Outcomes Across the Portfolio
how-to-roll-up-a-grant-portfolio
Portfolio
Communicate
13
How to Report Job Placements to Impact Investors
Turn a Cohort into a Social-Enterprise Investor Report
job-placement-investor-impact-report
Case
Social Enterprise Track
13
How Do You Track Reviewer Conflicts of Interest?
Track Reviewer Conflicts of Interest
track-conflicts-of-interest-audit
Grant
Analyze
13
How Do You Write a Donor Report?
Design a Report for a Real Funding Decision
donor-report-funders-trust
Reporting
Decide
13
A practical, step-by-step track for building a donor or grant report funders trust — from the funder's decision back through metrics, clean data, and traceable numbers.
Program & grant managers who report to funders
What Should AI Be Allowed to See in Your Stakeholder Data?
What the assistant may see
what-the-assistant-may-see
Feedback
Prove
13
How Do You Write an Impact Narrative for a Funder?
Write a Cited Impact Narrative
impact-narrative-funder-report-cited
Feedback
Prove
14
How Do You Read a Grantee Report?
Read a Grantee Report
read-grantee-report-multi-signal
Grant
Analyze
14
How Do You Monetize Impact with SROI?
Monetize Impact with SROI Across Levels
monetize-impact-sroi-across-levels
Portfolio
Chapters
14
How Do You Get AI to Write a Funder Report?
Generate the Audience-Specific Report From Evidence
assistant-writes-the-funder-report
Reporting
Decide
14
How Do You Compute Grantee Variance?
Compute Grantee Variance
how-to-compute-grantee-variance
Grant
Analyze
15
How Do You Put a Dollar Value on Impact?
Add a Credible Dollar Value With SROI
credible-dollar-value-on-impact
Reporting
Optional method
15
How Do You Set Up a Study That Follows People for Years?
One person, followed for years
one-person-followed-for-years
Feedback
Shapes
15
How Do You Build an SROI Value Map?
Build an SROI Value Map
how-to-build-an-sroi-value-map
Reporting
Optional method
16
How Do You Track Budget and Actual Spend?
Track Budget vs Actual Spend
how-to-track-budget-invoices-actual-spend
Grant
Analyze
16
How Do You Collect Feedback From Several People About One Person?
Several people describing one person
several-people-describing-one-person
Feedback
Shapes
16
How Do You Pick a Financial Proxy for SROI?
Pick a Defensible Financial Proxy
how-to-pick-a-financial-proxy-for-sroi
Reporting
Optional method
17
How Do You Analyze Grantee Reporting Longitudinally?
Analyze Grantee Reporting Over Time
analyze-grantee-reporting-longitudinal
Grant
Analyze
17
How Do You Compare and Benchmark Investees?
Compare & Benchmark Investees
compare-benchmark-investees
Portfolio
Chapters
17
How Do You Report Across Programs That Were Designed Separately?
Many programs, one picture
many-programs-one-picture
Feedback
Shapes
17
How Do You Calculate the SROI Ratio?
Calculate the SROI Ratio With a Range
how-to-calculate-the-sroi-ratio
Reporting
Optional method
18
How Do You Read a 990 for Compliance?
Read a 990 for Compliance
how-to-read-a-990-for-compliance
Grant
Analyze
18
How Do You Build Dashboards and Compliance Reports?
Portfolio Dashboards & Geographic Mapping
dashboards-sroi-compliance-reports
Portfolio
Communicate
18
How Do You Run a Survey Across a Member Network?
A network where each member sees their own part
member-network-survey
Feedback
Shapes
18
Ask Your Whole Grant Round Anything (Assistant + MCP)
Ask Your Whole Grant Round Anything
ask-your-grant-round-anything
Grant
Analyze
19
How Do You Produce an LP and Board Impact Report?
Produce the LP / Board Impact Report — Live, Not Annual
portfolio-lp-board-impact-report
Portfolio
Chapters
19
How Do You Build a Grant Audit Trail?
Build a Grant Audit Trail
grant-audit-compliance-trail
Grant
Communicate
20
How Do You Connect Your Stack Without Lock-In?
Connect Your Stack Without Lock-In (Microsoft Dynamics, Power BI, Affinity, MCP)
portfolio-connect-your-stack
Portfolio
Chapters
20
How Do You Produce Grant Compliance Reports?
Produce Compliance Reports
grant-compliance-regulatory-reports
Grant
Communicate
21
How Do You Roll Grantees Into a Board Report?
Roll Grantees Into a Board Report
roll-grantees-funder-board-report
Grant
Communicate
22
How Do You Build Grant Dashboards and Maps?
Grant Dashboards & Maps
grant-dashboards-geographic-mapping
Grant
Communicate
23