Pulled from search-console data for this page. Each answer leads with the bottom-line answer, followed by the supporting context.
How do you calculate survey sample size?
Survey sample size is calculated using Cochran's formula: n₀ = Z² · p · (1 − p) / e². Z is the z-score for the chosen confidence level (1.96 for 95%), p is the expected response distribution (0.5 for maximum variability), and e is the margin of error (0.05 for ±5%). For known populations under 5,000, apply the finite population correction n = n₀ / (1 + (n₀ − 1) / N). At 95% confidence with ±5% margin and unknown population size, the required sample is 384.
How many survey responses do I need to be statistically valid?
For 95% confidence with ±5% margin: 80 responses for a population of 100, 217 for 500, 278 for 1,000, 370 for 10,000, and 384 for unknown or very large populations. These are minimum completed responses, not invitations sent. Divide the required sample by the expected response rate to determine how many people to invite. A 50% response rate doubles the invitation count required.
What is a good survey sample size?
A good survey sample size is the smallest number that produces results accurate enough to support the specific decision being made. For most program evaluations, 95% confidence with ±5% margin (278 to 384 responses) is appropriate. For high-stakes decisions, use 99% confidence or ±3% margin. The most common mistake is treating larger as always better. Collecting twice the needed responses wastes resources without improving precision.
What is Cochran's formula for sample size?
Cochran's formula is n₀ = Z² · p · (1 − p) / e², developed by statistician William Cochran. Z is the z-score for the chosen confidence level (1.645 for 90%, 1.96 for 95%, 2.576 for 99%), p is the expected proportion (use 0.5 for maximum variability), and e is the margin of error. At 95% confidence and ±5% margin, n₀ = 1.96² · 0.5 · 0.5 / 0.05² = 384. For finite populations, apply the correction n = n₀ / (1 + (n₀ − 1) / N).
What is the finite population correction?
The finite population correction reduces the required sample size when surveying a known, bounded population under 5,000. The formula is n = n₀ / (1 + (n₀ − 1) / N), where n₀ is the initial Cochran sample size and N is the total population. For a population of 500, the correction shrinks the required sample from 384 to 217, a 43% reduction. For populations above 10,000 the correction has minimal effect.
What is a statistically valid survey response rate?
Response rate alone does not determine validity. The absolute number of completed responses does. Plan invitations so that even at a conservative 20 to 30% completion rate the required n is cleared. A 15% response rate from 3,000 contacts (450 responses) can be statistically valid; a 60% rate from 60 contacts (36 responses) typically is not. Non-response bias is the real threat, not response rate itself.
What is the margin of error in a survey?
Margin of error is the maximum acceptable gap between the sample result and the true population value. At ±5%, a finding of 72% satisfaction means the true value lies between 67% and 77% with the chosen confidence. Halving the margin of error quadruples the required sample: moving from ±5% (384 responses) to ±2.5% (1,537 responses). Choose the margin based on how much uncertainty the decision can absorb.
Confidence level: 90%, 95%, or 99% · which?
95% confidence is the default for program evaluation, board reporting, and most funder-facing work. Use 90% when the decision is internal and a wider margin is acceptable. That choice cuts the required sample by roughly 30%. Use 99% only for high-stakes decisions where the cost of being wrong is severe. It pushes the required sample size up by roughly 73% versus 95%.
How many responses for statistical significance?
Statistical significance for hypothesis testing differs from descriptive survey sample size. For descriptive surveys, use Cochran's formula: typically 278 to 384 responses. For testing whether group differences are statistically significant (t-test, chi-square), each subgroup must meet its own minimum threshold. If comparing two program sites, each needs its own Cochran-calculated minimum, not just the aggregate.
What sample size do I need for 99% confidence?
At 99% confidence with ±5% margin and unknown population: 664 responses. At 99% with ±2% margin: 4,148 responses. For smaller populations: 87 responses for a population of 100, 286 for 500, 400 for 1,000. The jump from 95% to 99% confidence increases the required sample by approximately 73% across most scenarios. Reserve 99% for decisions where being wrong has serious cost.