Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions
Bibliographic Data
| ID | 2330694 |
|---|---|
| Authors | Thomas Klausch (0000-0001-8771-1742, Utrecht University, corresponding author), Joop J Hox (Utrecht University), Barry Schouten (0000-0002-6176-7171, Utrecht University) |
| Year | 2013 |
| Volume | 42 |
| Issue | 3 |
| Pages | 227-263 |
| Publication date | 2013-08-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Sociological Methods & Research (JOURNAL) |
| Journal identifiers | ISSN: 0049-1241 • E-ISSN: 1552-8294 |
| Publisher | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/0049124113500480 |
| OpenAlex | W1964310644 |
| Language | EN |
| Citations received | 23 |
| References cited | 65 |
This study applies ordinal confirmatory factor analysis for multiple groups to assess equivalence of scale, random errors and systematic (nonrandom) errors of attitudinal questions surveyed on rating scales under different survey modes (Face-to-Face [F2F], Telephone, Paper, and Web). Empirical findings from a large-scale experiment are presented. Consistent with theoretical expectations, interviewer- and self-administered surveys measured all assessed questions on systematically different scales, with different systematic bias, and with differing extents of random error. These measurement effects were absent when comparing Paper with Web or F2F with Telephone. It is concluded that modes impact primarily systematic measurement effects affecting multiple items equally. Interviewer- and self-administered modes should only be combined with great care in mixed-mode surveys that focus on attitudinal constructs. Combining Paper and Web or Telephone and F2F are the viable options. Thereby choosing the self-administered modes appears more efficient, because these modes exhibited higher indicator reliabilities (smaller random error) than the interviewer modes
Confirmatory factor analysis · Econometrics · Equivalence (formal languages) · Interview · Observational error · Rating scale · Scale (ratio) · Social desirability · Social desirability bias · Statistics · Structural equation modeling · Telephone interview · Applied Psychology · Customer Service Quality and Loyalty · Mathematics · Psychology · Social and Intergroup Psychology · Social Psychology · Survey Methodology and Nonresponse
Disentangling Setting and Mode Effects for Online Competence Assessment
Mosquito-borne infectious diseases in northeastern Italy
Improving measurements by survey infrastructures synergies
Transitioning from interviewer-administered to self-administered survey modes
Causal attributions of poverty
Survey mode effects on measured income inequality
Who is most affected by the Corona crisis? An analysis of changes in stress and well-being in Switzerland
Presentation matters
Straightlining
Analysing mixed-mode effects of computer assisted telephone and personal interviews
Building a Framework for Mode Effect Estimation in United States Presidential Election Polls
Assessing the effects of a mixed-mode design in a longitudinal household travel survey
Environmental Attitudes, Concerns, and Behaviors Across Survey Modes. Assessing Selection and Measurement Biases in ISSP 2020 ‘Push-to-Web’ Surveys
Do Different Devices Perform Equally Well with Different Numbers of Scale Points and Response Formats? A test of measurement invariance and reliability
Measurement invariance in the social sciences
Comparing Web and Mail Protocols for Administering Hospital Consumer Assessment of Healthcare Providers and Systems Surveys
The European Values Study 2017
A randomized experiment evaluating survey mode effects for video interviewing
Comparing in person and internet methods to recruit low-SES populations for tobacco control policy research
Generations and Gender Programme Wave 1 data collection
The Impact of Survey Mode Design and Questionnaire Length on Measurement Quality
Evaluating Bias of Sequential Mixed-mode Designs Against Benchmark Surveys
Advances in the Science of Asking Questions
Statistical Theories of Mental Test Scores
Counterfactuals and Causal Inference
Generalized Latent Variable Modeling
Measurement Error Models
Statistical Approaches to Measurement Invariance
Margins of Error
Item bias and item response theory
Mode of questionnaire administration can have serious effects on data quality
A Comparison of Item Response Theory and Confirmatory Factor Analytic Methodologies for Establishing Measurement Equivalence/Invariance
Detecting differential item functioning with confirmatory factor analysis and item response theory
A General Structural Equation Model with Dichotomous, Ordered Categorical, and Continuous Latent Variable Indicators
Model-Based Direct Adjustment
Simultaneous Factor Analysis in Several Populations
Testing Measurement Invariance
Modeling Acquiescence in Measurement Models for Two Balanced Sets of Items
A Note on the Relation Between Factor Analytic and Item Response Theory Models
Sampling Weights in Latent Variable Modeling
A Review and Synthesis of the Measurement Invariance Literature
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
The central role of the propensity score in observational studies for causal effects
Measurement Invariance, Factor Analysis and Factorial Invariance
Structural Equations with Latent Variables
The Psychology of Survey Response
Response strategies for coping with the cognitive demands of attitude measures in surveys
International Handbook of Survey Methodology
Internet, mail, and mixed-mode surveys
Assessing Factorial Invariance in Ordered-Categorical Measures
An Extension of the Propensity Score Adjustment Method for the Analysis of Group Differences in MIMIC Models
A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey
Testing the Stability of an Acquiescence Style Factor Behind Two Interrelated Substantive Variables in a Panel Design
Measurement Equivalence of Ordinal Items
Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet
Dealing with Extreme Response Style in Cross-Cultural Research
National Surveys Via Rdd Telephone Interviewing Versus the Internet
Nonrandom Measurement Error and Race of Interviewer Effects Among African Americans
Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires
Spacing, Position, and Order
A Method for Evaluating Mode Effects in Mixed-mode Surveys
Construct Validity and Error Components of Survey Measures
An Experimental Comparison of Web and Telephone Surveys
Measurement Error and the Structure of Attitudes
Detection and Determinants of Bias in Subjective Measures
A Causal Approach to Nonrandom Measurement Errors
On the Meaning of within-Factor Correlated Measurement Errors
The Validity and Reliability of Survey Questions
The Influence of Data Collection Method on Structural Models
Evaluating Relative Mode Effects in Mixed-Mode Surveys
Adjustment for Acquiescence in the Assessment of the Construct Equivalence of Likert-Type Score Items
| Unique citing works | 23 |
|---|---|
| Citations per year | 1,92 |
| Citation span | 2014 - 2026 (13) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 23 |