Do Differential Response Rates to Patient Surveys Between Organizations Lead to Unfair Performance Comparisons

BACKGROUND: Patient surveys typically have variable response rates between organizations, leading to concerns that such differences may affect the validity of performance comparisons. OBJECTIVE: To explore the size and likely sources of associations between hospital-level survey response rates and patient experience. RESEARCH DESIGN, SUBJECTS, AND MEASURES: Cross-sectional mail survey including 60 patient experience items sent to 101,771 cancer survivors recently treated by 158 English NHS hospitals. Age, sex, race/ethnicity, socioeconomic status, clinical diagnosis, hospital type, and region were available for respondents and nonrespondents. RESULTS: The overall response rate was 67% (range, 39% to 77% between hospitals). Hospitals with higher response rates had higher scores for all items (Spearman correlation range, 0.03-0.44), particularly questions regarding hospital-level administrative processes, for example, procedure cancellations or medical note availability.From multivariable analysis, associations between individual patient experience and hospital-level response rates were statistically significant (P<0.05) for 53/59 analyzed questions, decreasing to 37/59 after adjusting for case-mix, and 25/59 after further adjusting for hospital-level characteristics.Predicting responses of nonrespondents, and re-estimating hypothetical hospital scores assuming a 100% response rate, we found that currently low performing hospitals would have attained even lower scores. Overall nationwide attainment would have decreased slightly to that currently observed. CONCLUSIONS: Higher response rate hospitals have more positive experience scores, and this is only partly explained by patient case-mix. High response rates may be a marker of efficient hospital administration, and higher quality that should not, therefore, be adjusted away in public reporting. Although nonresponse may result in slightly overestimating overall national levels of performance, it does not appear to meaningfully bias comparisons of case-mix-adjusted hospital results

Affect (linguistics) · Environmental health · Ethnic group · Family medicine · Population · Socioeconomic status · Demography · Healthcare Quality and Management · Medicine · Patient Satisfaction in Healthcare · Psychology · Survey Methodology and Nonresponse

• Survey Protocols, Response Rates, and Representation of Underserved Patients

  Open Access•Marc N Elliott, Julie A Brown et al.•JAMA Health Forum•2024

  Incluir item

• Insight into Patients’ Experiences of Cancer Care in Taiwan

  Open Access•Tsung‐Hsien Yu, Kuo-Piao Chung et al.•International Journal of…•2018

  Incluir item

• New Instrument to Measure Hospital Patient Experiences in Flanders

  Open Access•Luk Bruyneel, Else Tambuyzer et al.•International Journal of…•2017

  Incluir item

• Trends in patient perceptions of care toward rural and urban hospitals in the United States

  Open Access•Zhong Li, Vivian Ho et al.•The Journal of Rural Health•2024

  Incluir item

• A Systematic Review of Strategies to Enhance Response Rates and Representativeness of Patient Experience Surveys

  Open Access•Rebecca Anhang Price, Denise D Quigley et al.•Medical Care•2022

  Incluir item

• Impact of Cross-level Measurement Noninvariance on Hospital Rankings Based on Patient Experiences With Care in 7 European Countries

  Benedict O Orindi, Benedict Orindi et al.•Medical Care•2017

  Incluir item

• Contribution of HCAHPS Specific Care Experiences to Global Ratings Varies Across 7 Countries

  Benedict O Orindi, Benedict Orindi et al.•Medical Care•2019

  Incluir item

• National Testing of the Emergency Department Patient Experience of Care Discharged to Community Survey and Implications for Adjustment in Scoring

  Layla Parast, Megan Mathews et al.•Medical Care•2019

  Incluir item

• Supplemental Items Reduce HCAHPS Response Rates, but Response Rates Do Not Affect HCAHPS Scores

  Megan K Beckett, Katrin Hambarsoomian et al.•Medical Care•2025

  Incluir item

• Updated Adjustment of the HCAHPS Survey for New Modes of Survey Administration and Patient Mix

  Marc N Elliott, Megan K Beckett et al.•Medical Care•2025

  Incluir item

• Adapting Patient Experience Data Collection Processes for Lower Literacy Patient Populations Using Tablets at the Point of Care

  Lina Tieu, Alicia Hobbs et al.•Medical Care•2019

  Incluir item

• Increasing response rates to postal questionnaires

  Open Access•Phil Edwards, Ian Roberts et al.•BMJ•2002

  Incluir item

• American Public Opinion

  Robert S Erikson, Robert Erikson et al.•American Public Opinion•2015

  Incluir item

• Adjusting for Patient Characteristics When Analyzing Reports From Patients About Hospital Care

  J Lee Hargraves, Ira B Wilson et al.•Medical Care•2001

  Incluir item

• An Evaluation of the Impact of Nonresponse Bias on Patient Satisfaction Surveys

  Rebecca J Lasek, William M Barkley et al.•Medical Care•1997

  Incluir item

• Examining the Relationship Between Nonresponse Propensity and Data Quality in Two National Household Surveys

  Scott Fricker, Roger Tourangeau•Public Opinion Quarterly•2010

  Incluir item

• Sensitive Topics and Reluctant Respondents

  Roger Tourangeau, Robert M Groves et al.•Public Opinion Quarterly•2010

  Incluir item

• The Impact of Nonresponse Rates on Nonresponse Bias

  Robert M Groves, Emilia Peytcheva•Public Opinion Quarterly•2008

  Incluir item

• Nonresponse Rates and Nonresponse Bias in Household Surveys

  Robert M Groves•Public Opinion Quarterly•2006

  Incluir item