Survey attention checks and response quality controls
An attention check should make your data easier to interpret. Pair a straightforward instruction with response timing and other quality signals, then review the evidence together before excluding a response.
In practice
A check that does not require a trick
Example: “For this item, please select Disagree.” Offer Strongly agree, Agree, Disagree, and Strongly disagree. Keep the instruction visible and readable on a phone. An incorrect response is a signal to review, not proof that every other answer is unusable.
Decide what failure means before fielding
Document your exclusion rule, where checks appear, and whether a failure will end participation or only flag the response. Avoid changing those rules after seeing the study outcome. When appropriate, record multiple signals rather than relying on one item.
Make the check accessible
Use plain instructions and avoid obscure knowledge, double negatives, or tiny visual details. Check the item on a narrow screen and with keyboard navigation. A check should test whether someone follows an instruction, not whether they share your cultural knowledge.
Review timing in context
Plumeform captures response timing and supports quality flags for speeders and straight-lining. Review them alongside answer content and survey length. A short path can legitimately be fast, and repeated ratings can be sincere. Pilot timing before deciding what counts as unusually quick.
Keep the review auditable
Use the results view to inspect flagged responses and export the available quality signals with your data. Preserve a copy of the original export and record why you exclude rows. Report your quality rules alongside the final sample size.
Set it up in Plumeform
- 1Write a simple instruction item and define the expected answer.
- 2Set attention and quality controls for your survey, then preview the experience.
- 3Pilot on desktop and mobile to check comprehension and timing.
- 4Review flags together and document the final exclusion decisions.
Advanced research controls are part of Pro. Quality flags are review aids; they do not establish fraud or guarantee a representative sample.
A useful next step
Examples and design choices for instruction and comprehension questions.
Combine timing, content, duplicate, and consistency signals.
Plan respondent effort before you pilot real completion times.