Skip to content

8 min read

Screening that finds your people fast.

A screener checks eligibility before someone spends time on the full study. Keep it short, avoid revealing the qualifying answer, and give people a clear ending if they do not qualify or a quota is full.

Screen in layers: panel first, then verify

The cheapest screening happens before anyone clicks your link. Panel platforms hold rich prescreening data — demographics, languages, employment, devices — and filtering there costs nothing and wastes nobody's time. Use it for every criterion the panel can express.

Your own screener exists for the criteria the panel cannot know: behavior (“grocery shopped online in the past month”), ownership, experience with a specific product, a clinical population. Put those questions on the first page, route ineligible answers to the screen-out immediately, and only then let the real survey begin. Screening on page one instead of page five is the single biggest cost lever you control.

Ask neutral eligibility questions

To reduce the chance of someone guessing the answer that qualifies, include plausible alternatives without naming the eligibility rule.

Reveals the qualifying answer

This study is about electric vehicles. Do you own an electric vehicle?

  • Yes
  • No
Asks about several options

Which of the following do you currently own or lease? Select all that apply.

  • A gasoline or diesel car
  • A hybrid car
  • A fully electric car
  • A motorcycle or scooter
  • None of these

The second version reads like a demographic question. The person who qualifies doesn't know which option mattered, and neither does the person who doesn't. For higher-stakes eligibility, verify with a follow-up only a genuine member of the group answers easily — an EV owner knows roughly where they charge; a faker improvises.

Ask only the questions needed to establish eligibility. Longer screeners take more participant time, especially for people who will not qualify.

Quotas: let segments close themselves

Quotas limit responses in each segment, such as 100 per condition or no more than 40% from one age band. Check how the tool enforces limits and handles people who reach a full quota:

Enforcement must be server-side and race-safe. Panels deliver participants in bursts; when the last slot of a cell has thirty people mid-survey, client-side counting oversubscribes it every time. The count-and-close has to happen atomically at the database, not in the browser.

Full cells should turn people away early. The respectful version of “quota full” happens at the first qualifying answer, not after the last page. In Plumeform, quotas are conditions with a limit; full segments screen out at the page boundary where they qualify, the enforcement runs inside the database under a lock, and screened rows never count against your response cap or monthly limit.

Report a full quota as over-quota. Sample vendors usually give you three return links: complete, terminate and over-quota. Someone turned away by a full cell qualified, so sending them to the terminate link understates your incidence rate. In Plumeform, a full quota has its own code and redirect; without one, it uses the screen-out exit, which is all Prolific needs.

Screen-out etiquette on paid panels

People who do not qualify still need a clear ending and the payment treatment required by your panel. Resolve their submission properly: give them the panel's screen-out exit (a separate completion code and redirect) so their status resolves instead of hanging at awaiting review; never reject someone for failing to be eligible. Use a courteous exit message, such as “This study needs a specific mix of participants, and you do not qualify for this one. Thank you for your time.”

Do

  • Screen on page one; disqualify at the first failing answer.
  • Use the panel's prescreening filters for everything they can express.
  • Give screen-outs their own code, redirect, and courteous copy.
  • Pilot the screener and check your recruitment filters if most participants do not qualify.
  • Track your screen-out rate; it is a live gauge of targeting quality.

Don't

  • Name the eligibility criterion in the question or the study title.
  • Ask yes/no when a categorical list hides the answer.
  • Screen out after people have invested ten minutes.
  • Treat ineligibility as a failed quality check. Use the panel’s screening process.
  • Let 'quota full' look like an error page. It is a normal ending and should read like one.

Quick answers

Should I use the panel's built-in filters or my own screener questions?
Both, in that order. Panel prescreening (Prolific's demographic filters, Connect's targeting) is free and removes the bulk of ineligible people before they click. Your own screener then verifies the one or two criteria the panel cannot know — recent behavior, product usage, a diagnosis, a job title. Panel filters narrow; your screener verifies.
Why shouldn't the screener reveal what I'm looking for?
Because on paid panels, eligibility is money. If your first question is 'Do you own a dog? (dog owners needed for this study)', some fraction of non-owners will say yes. Ask categorically — 'Which of these do you have at home?' with several options — and the honest answer and the qualifying answer stop being distinguishable.
Do screened-out participants count against my response limit or sample size?
They shouldn't, and in a well-built tool they don't — a screen-out is recorded separately from a completion. Budget-wise, panels treat very early screen-outs differently from mid-study ones; check the panel's current compensation policy and design the screener to finish inside the first minute.
How many quota cells can I realistically fill?
Multiply the cells out before you launch: 2 genders × 3 age bands × 2 conditions is already 12 cells, and the last cell always fills slowest — often 3–5× slower than the average, because arrivals are not uniform. If a cell matters to your analysis, budget time for the tail or loosen the cell you care least about.

Keep reading: Set up screening in Plumeform · Screener + consent template · Completion codes, set up right · How many responses do you need? · Academic research · Random assignment

Start

Put it into practice.

Start with 100 responses a month free. Pro includes 10,000 responses and the advanced research controls described in these guides.