Do Different Devices Perform Equally Well with Different Numbers of Scale Points and Response Formats? A test of measurement invariance and reliability
Dados Bibliográficos
| AUTOR(ES) | |
|---|---|
| AFILIAÇÃO(ÕES) | Technische Universität Dresden, Institute of Sociology, Technische Universität Dresden, D-01062 Dresden, Utrecht University, Padualaan 14, 3584CH Utrecht, Netherlands |
| ANO | 2024 |
| TIPO | Artigo |
| PERIÓDICO | Sociological Methods and Research |
| ISSN | 0049-1241 |
| E-ISSN | 1552-8294 |
| EDITORA | Annual Reviews (United States) |
| DOI | 10.1177/00491241221077237 |
| CITAÇÕES | 1 |
| ADICIONADO EM | 2025-08-18 |
Resumo
Research on mixed devices in web surveys is in its infancy. Using a randomized experiment, we investigated device effects (desktop PC, tablet and mobile phone) for six response formats and four different numbers of scale points. N = 5,077 members of an online access panel participated in the experiment. An exact test of measurement invariance and Composite Reliability were investigated. The results provided full data comparability for devices and formats, with the exception of continuous Visual Analog Scale (VAS), but limited comparability for different numbers of scale points. There were device effects on reliability when looking at the interactions with formats and number of scale points. VAS, use of mobile phones and five point scales consistently gained lower reliability. We suggest technically less demanding implementations as well as a unified design for mixed-device surveys.