Instructed Response Item Attention Checks in Mixed-mode Questionnaires
Evidence from a Probability-based Mail and Online Panel
Dados Bibliográficos
| ID | 7154407 |
|---|---|
| Autores | Jessica Daikeler (0000-0002-4879-8344, GESIS - Leibniz Institute for the Social Sciences, autor correspondente), Joss Roßmann (0000-0003-2701-0690, GESIS - Leibniz Institute for the Social Sciences), David Bretschi (UnDeSkRiMiNaLa), Tobias Gummer (0000-0001-6469-7802, University of Mannheim), H Silber (0000-0002-3568-3257, University of Mannheim) |
| Ano | 2025 |
| Volume | 37 |
| Fascículo | 3 |
| Páginas | 228-243 |
| Data de publicação | 2025-08-01 |
| Peer Reviewed | Sim |
| Open Access | Sim |
| Tipo | ARTICLE |
| Periódico | CAM (JOURNAL) |
| Identificadores do periódico | ISSN: 1087-8513 • E-ISSN: 1552-3969 |
| Editora | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/1525822x241274103 |
| OpenAlex | W4404020153 |
| Idioma | EN |
| Citações recebidas | 1 |
| Referências citadas | 24 |
Mostly in web surveys, attention checks have been proposed to identify inattentive respondents in self-administered surveys as previous research has argued that low-quality answers may introduce severe biases in data analyses. The increasing popularity of mixing survey modes for conducting probability-based surveys amplifies the need for systematic research on the implementation of attention checks in these survey designs. Our study investigates whether an instructed response item (IRI) can be an adequate predictor of response quality in a self-administered mixed-mode panel survey with a probability-based German general population sample. By doing so, we compare the results of the attention check with those of other response quality indicators. However, while the results for the online respondents were somewhat promising, the mail respondents result suggests that this response quality indicator seems unreliable, so that we cannot recommend using IRIs in general population mixed-mode surveys, which include a mail option
Human–computer interaction · Mode (computer interface · Statistics · Applied Psychology · Behavioral Health and Interventions · Computer Science · Mathematics · Psychology · Psychometric Methodologies and Testing · Social Psychology · Survey Methodology and Nonresponse
A Review of Conceptual Approaches and Empirical Evidence on Probability and Nonprobability Sample Survey Research
Improving propensity score weighting using machine learning
Methodology of Longitudinal Surveys
Web Survey Methodology
Response strategies for coping with the cognitive demands of attitude measures in surveys
Web Versus Other Survey Modes
Short and Long Instructional Manipulation Checks
Establishing an Open Probability-Based Mixed-Mode Panel of the General Population in Germany
Why Do Web Surveys Take Longer on Smartphones
Using Instructed Response Items as Attention Checks in Web Surveys
Methods for the detection of carelessly invalid responses in survey data
Instructional manipulation checks
The European Values Study 2017
The Issue of Noncompliance in Attention Check Questions
Web Surveys
It's a Trap! Instructional Manipulation Checks Prompt Systematic Thinking on "Tricky" Tasks
Disentangling mode-specific selection and measurement bias in social surveys
| Obras citantes distintas | 1 |
|---|---|
| Citações por ano | 1 |
| Intervalo de citações | 2026 - 2026 (1) |
| Velocidade de citação | current |
| Altamente citado | Não |