Skip to content

GUIDES8 MIN READ

Screening that finds your people fast.

Every screener balances three costs: your money (paying people who don't qualify), your participants' time (answering questions that lead to a dead end), and your data (fakers who guess what you want to hear). A good screener runs in under a minute, gives nothing away, exits people courteously, and closes itself segment by segment as quotas fill. This guide covers each piece.

01Screen in layers: panel first, then verify

The cheapest screening happens before anyone clicks your link. Panel platforms hold rich prescreening data — demographics, languages, employment, devices — and filtering there costs nothing and wastes nobody's time. Use it for every criterion the panel can express.

Your own screener exists for the criteria the panel cannot know: behavior (“grocery shopped online in the past month”), ownership, experience with a specific product, a clinical population. Put those questions on the first page, route ineligible answers to the screen-out immediately, and only then let the real survey begin. Screening on page one instead of page five is the single biggest cost lever you control.

02Write questions people can't reverse-engineer

The moment payment enters, a screener stops being a measurement and becomes a negotiation with strangers who want the job. The rule: ask so the qualifying answer is invisible.

LEAKY — TELEGRAPHS THE ANSWER

This study is about electric vehicles. Do you own an electric vehicle?

  • Yes
  • No
CATEGORICAL — NOTHING TO GAME

Which of the following do you currently own or lease? Select all that apply.

  • A gasoline or diesel car
  • A hybrid car
  • A fully electric car
  • A motorcycle or scooter
  • None of these

The second version reads like a demographic question. The person who qualifies doesn't know which option mattered, and neither does the person who doesn't. For higher-stakes eligibility, verify with a follow-up only a genuine member of the group answers easily — an EV owner knows roughly where they charge; a faker improvises.

Resist the mirror-image mistake, too: screeners so long they become the study. Every screening question is unpaid work for the majority who won't qualify. Two or three questions is a screener; ten is a survey with a trapdoor.

03Quotas: let segments close themselves

Quotas cap segments so your sample arrives shaped the way your analysis needs it — 100 per condition, 50/50 gender, no more than 40% from any one age band. Two mechanics matter more than the rest:

Enforcement must be server-side and race-safe. Panels deliver participants in bursts; when the last slot of a cell has thirty people mid-survey, client-side counting oversubscribes it every time. The count-and-close has to happen atomically at the database, not in the browser.

Full cells should turn people away early.The respectful version of “quota full” happens at the first qualifying answer, not after the last page. In Plumeform, quotas are conditions with a limit; full segments screen out at the page boundary where they qualify, the enforcement runs inside the database under a lock, and screened rows never count against your response cap or monthly limit.

04Screen-out etiquette on paid panels

A screened-out participant did nothing wrong — they answered your questions honestly and lost the lottery. Two obligations follow. Resolve their submission properly:give them the panel's screen-out exit (a separate completion code and redirect) so their status resolves instead of hanging at awaiting review; never reject someone for failing to be eligible. And write the exit like you mean it— “this study needs a specific mix of participants and this one isn't a match; your time is appreciated” costs nothing and is the difference between a participant who returns for your next study and one who leaves you a one-star review on the panel forum.

DO

  • Screen on page one; disqualify at the first failing answer.
  • Use the panel's prescreening filters for everything they can express.
  • Give screen-outs their own code, redirect, and courteous copy.
  • Pilot the screener itself — a 90% screen-out rate means your panel filters are wrong.
  • Track your screen-out rate; it is a live gauge of targeting quality.

DON'T

  • Name the eligibility criterion in the question or the study title.
  • Ask yes/no when a categorical list hides the answer.
  • Screen out after people have invested ten minutes.
  • Reject panel submissions for ineligibility — that is what screen-out codes are for.
  • Let 'quota full' look like an error page. It is a normal ending and should read like one.

Quick answers

Should I use the panel's built-in filters or my own screener questions?+

Both, in that order. Panel prescreening (Prolific's demographic filters, Connect's targeting) is free and removes the bulk of ineligible people before they click. Your own screener then verifies the one or two criteria the panel cannot know — recent behavior, product usage, a diagnosis, a job title. Panel filters narrow; your screener verifies.

Why shouldn't the screener reveal what I'm looking for?+

Because on paid panels, eligibility is money. If your first question is 'Do you own a dog? (dog owners needed for this study)', some fraction of non-owners will say yes. Ask categorically — 'Which of these do you have at home?' with several options — and the honest answer and the qualifying answer stop being distinguishable.

Do screened-out participants count against my response limit or sample size?+

They shouldn't, and in a well-built tool they don't — a screen-out is recorded separately from a completion. Budget-wise, panels treat very early screen-outs differently from mid-study ones; check the panel's current compensation policy and design the screener to finish inside the first minute.

How many quota cells can I realistically fill?+

Multiply the cells out before you launch: 2 genders × 3 age bands × 2 conditions is already 12 cells, and the last cell always fills slowest — often 3–5× slower than the average, because arrivals are not uniform. If a cell matters to your analysis, budget time for the tail or loosen the cell you care least about.

Keep reading: Completion codes, set up right · How many responses do you need? · Plumeform for researchers

Put it into practice.

Start free →

250 responses a month free. Every control in these guides is built in.