Comparing Web and Mail Protocols for Administering Hospital Consumer Assessment of Healthcare Providers and Systems Surveys

OBJECTIVE: The objective of this study was to compare results of using web-based and mail (postal) Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) data collection protocols. RESEARCH DESIGN: Patients who had been hospitalized in a New England Hospital were surveyed about their hospital experience. Patients who provided email addresses were randomized to 1 of 3 data collection protocols: web-alone, web with postal mail follow-up, and postal mail only. Those who did not provide email addresses were surveyed using postal mail only. Analyses compared response rates, respondent characteristics, and patient-reported experiences. SUBJECTS: For an 8-week period, patients were discharged from the study hospital to home. MEASURES: Measures included response rates, characteristics of respondents, 6 composite measures of their patient experiences, and 2 ratings of the hospital. RESULTS: Response rates were significantly lower for the web-only protocol than the mail or combined protocols, and those who had not provided email addresses had lower response rates. Those over 65 were more likely than others to respond to all protocols, especially for the mail-only protocols. Respondents without email addresses were older, less educated, and reported worse health than those who provided email addresses. After adjusting for respondent differences, those in the combined protocol differed significantly from the mail (postal) only respondents on 2 measures of patient experience; those in the web-only protocol differed on one. Those not providing an email address differed from those who did on one measure. CONCLUSION: If web-based protocols are used for HCAHPS surveys, adjustments for a mode of data collection are needed to make results comparable

Alternative medicine · Data collection · Family medicine · Health care · MEDLINE · Protocol (science) · Respondent · World Wide Web · Computer Science · Medicine · Mobile Health and mHealth Applications · Patient Satisfaction in Healthcare · Survey Methodology and Nonresponse

• Survey Protocols, Response Rates, and Representation of Underserved Patients

  Open Access•Marc N Elliott, Julie A Brown et al.•JAMA Health Forum•2024

  Incluir item

• Updated Adjustment of the HCAHPS Survey for New Modes of Survey Administration and Patient Mix

  Marc N Elliott, Megan K Beckett et al.•Medical Care•2025

  Incluir item

• Examining the Role of Patient Experience Surveys in Measuring Health Care Quality

  Open Access•Rebecca Anhang Price, Marc N Elliott et al.•Medical Care Research and Review•2014

  Incluir item

• International Handbook of Survey Methodology

  Joop J Hox, Don A Dillman et al.•International Handbook of Survey…•2012

  Incluir item

• Response Rates for Mixed-Mode Surveys Using Mail and E-mail/Web

  Open Access•Patrick D Converse, Edward W Wolfe et al.•American Journal of Evaluation•2008

  Incluir item

• Comparing Response Rates from Web and Mail Surveys

  Open Access•Tse-Hua Shih, Xitao Fan et al.•CAM•2008

  Incluir item

• When More Gets You Less

  Rebecca L Medway, J Fulton•Public Opinion Quarterly•2012

  Incluir item

• The Impact of Nonresponse Rates on Nonresponse Bias

  Robert M Groves, Emilia Peytcheva•Public Opinion Quarterly•2008

  Incluir item

• Nonresponse Rates and Nonresponse Bias in Household Surveys

  Robert M Groves•Public Opinion Quarterly•2006

  Incluir item

• Surveying the General Public over the Internet Using Address-Based Sampling and Mail Contact Procedures

  Benjamin L Messer, D A Dillman•Public Opinion Quarterly•2011

  Incluir item

• Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions

  Open Access•Thomas Klausch, Joop J Hox et al.•Sociological Methods & Research•2013

  Incluir item