Response Rates, Nonresponse Bias, and Data Quality

Dados Bibliográficos

ID7363871
AutoresMark Meterko (0000-0002-2818-8725), Joseph D Restuccia, Kelly Stolzmann (0000-0002-3491-9803), David C Mohr (0000-0002-5443-7596), David Mohr, Caitlin W Brennan (0009-0004-8502-4948), Caitlin Brennan, Justin Glasgow (0000-0003-1449-2643), Peter J Kaboli (0000-0003-0993-0952, autor correspondente), Peter Kaboli
Ano2015
Volume79
Fascículo1
Páginas130-144
Data de publicação2015-01-01
Peer ReviewedSim
Open AccessNão
TipoARTICLE
PeriódicoPublic Opinion Quarterly (JOURNAL)
Identificadores do periódicoISSN: 0033-362X • E-ISSN: 1537-5331
EditoraOxford University Press (OUP) (PUBLISHER)
DOI10.1093/poq/nfu052
OpenAlexW2102138028
IdiomaEN
Citações recebidas16
Referências citadas12

Survey response rate is regarded as a key data-quality indicator, yet response rate is not necessarily predictive of nonresponse bias. Our study objective was to use a high-response-rate survey to assess nonresponse bias across successive waves. This survey of healthcare leaders utilized a web-based, self-report format with an initial invitation and four nonrespondent follow-ups. Across five waves, comparisons were made for demographic and facility characteristics, proportion of items completed, and distribution of three question types: factual reports of customized categorical responses; single-item evaluations using five-point Likert scales; and multi-item scales, across four- or five-point Likert scales. The overall response rate was 95 percent (118/124); waves did not differ by demographic and facility characteristics or missing data. Across waves, there were no significant differences between responses to two factual report questions or the single- or multi-item scale measures of attitudes. According to a “what-if” analysis of cumulative results by wave, the same conclusions would have been reached if data collection had been halted at earlier points in time. Precision and statistical power increased as number of respondents accumulated by wave. The high response rate facilitated studying the impact of nonresponse bias by wave. Although high response rates are desirable because of precision and power, as survey fatigue increases, absolute thresholds representing “adequate” response rates may be less realistic. Results from “low” response-rate surveys should be considered on their merits, as they may accurately represent attitudes of the population. Therefore, low response rates should not be cited as reasons to dismiss results as uninformative

Categorical variable · Data collection · Econometrics · Item response theory · Likert scale · Non-response bias · Psychometrics · Response bias · Statistics · Healthcare Policy and Management · Mathematics · Patient Satisfaction in Healthcare · Psychology · Survey Methodology and Nonresponse