7 min read
How many survey responses do you need?
The response target depends on what you want to estimate and how precise it needs to be. This guide explains common sample-size calculations, how to allow for response rates, and when a smaller study is useful.
Precision, not headcount
Start with two questions: how precise must the answer be, and how confident must you be in that precision. Those are the margin of error and the confidence level, and once you fix them, the sample size falls out.
Margin of error is the ± band around your result. If 60% pick option A with a 5% margin, the true figure is somewhere between 55% and 65%. Confidence level is how often that band would contain the truth if you repeated the survey many times; 95% is the near-universal default. Tighten either one and you need more people.
The numbers to reach for
For a large population at 95% confidence, these are approximate targets for a proportion using the conservative 50% assumption:
Pick the precision, read off the sample:
- ±10% margin — about 100 completed responses
- ±5% margin — about 385 completed responses
- ±3% margin — about 1,070 completed responses
- ±1% margin — about 9,600 completed responses
Notice the shape: halving the margin of error roughly quadruples the sample. Going from ±5% to ±3% is cheap; chasing ±1% is a different budget entirely. The 385-response target is a common starting point, subject to the sampling assumptions above.
Why your audience size barely matters
The instinct is that a bigger population needs a bigger sample. It mostly does not. Sampling theory cares about the absolute number of responses, not the fraction of the whole, once the whole is large. The 385 that gives ±5% works for a city of 80,000 or a country of 80 million.
The exception is small, closed groups. If you are surveying a 300-person company, sampling 385 is impossible and unnecessary; you would aim for roughly 170 for the same precision, because each response now covers a bigger slice of everyone. When your population is under a few thousand, use a finite-population calculator. Above that, the round numbers in the previous section hold.
Response rate is the real constraint
Every number so far is completed responses, not invitations sent. The gap between the two is your response rate, and it is almost always where sample plans go wrong. Decide the responses you need, then divide by the rate you honestly expect:
To net 385 responses:
- At 40% (engaged customers) — invite about 960
- At 15% (typical email list) — invite about 2,600
- At 4% (cold outreach) — invite about 9,600
- On a paid panel (~100%) — recruit about 400
Do
- Estimate response rate from your last similar send, not from hope.
- Over-recruit a little; drop-off and quality screening will trim the top.
- Track completion separately from starts so you see where people quit.
Don't
- Don't count partials and starts as responses; report completes.
- Don't send one giant blast; stagger so you can stop at your target.
- Don't buy a list to hit a number. Junk responses widen error, not shrink it.
When smaller is the right call
Big samples buy precise numbers. Plenty of good survey work does not need precise numbers. If you are running a usability study, sanity- checking a concept, or gathering open-text feedback, you are looking for themes and problems. A smaller sample can be useful for that purpose, though it cannot support precise estimates for the whole population.
The trap is subgroups. A sample of 400 feels comfortable until you slice it by four regions and two age bands and each cell holds a dozen people. If a comparison between segments is the point, size for the smallest cell you care about, not the total. That is usually what pushes a sample from hundreds into thousands.
Quick answers
How many responses is statistically significant?
Does the size of my audience change the sample I need?
What is a good survey response rate?
Can a small survey still be useful?
Keep reading: Calculate your sample size · Plan follow-up waves · Catching low-quality responses · Writing attention checks
Start
Put it into practice.
Start with 100 responses a month free. Pro includes 10,000 responses and the advanced research controls described in these guides.