Using Multilevel Modeling to Assess Case-Mix Adjusters in Consumer Experience Surveys in Health Care

BACKGROUND: Ratings on the quality of healthcare from the consumer's perspective need to be adjusted for consumer characteristics to ensure fair and accurate comparisons between healthcare providers or health plans. Although multilevel analysis is already considered an appropriate method for analyzing healthcare performance data, it has rarely been used to assess case-mix adjustment of such data. The purpose of this article is to investigate whether multilevel regression analysis is a useful tool to detect case-mix adjusters in consumer assessment of healthcare. METHODS: We used data on 11,539 consumers from 27 Dutch health plans, which were collected using the Dutch Consumer Quality Index health plan instrument. We conducted multilevel regression analyses of consumers' responses nested within health plans to assess the effects of consumer characteristics on consumer experience. We compared our findings to the results of another methodology: the impact factor approach, which combines the predictive effect of each case-mix variable with its heterogeneity across health plans. RESULTS: Both multilevel regression and impact factor analyses showed that age and education were the most important case-mix adjusters for consumer experience and ratings of health plans. With the exception of age, case-mix adjustment had little impact on the ranking of health plans. CONCLUSIONS: On both theoretical and practical grounds, multilevel modeling is useful for adequate case-mix adjustment and analysis of performance ratings

Case mix index · Data science · Economic growth · Economics · Health care · Multilevel model · Computer Science · Customer Service Quality and Loyalty · Medicine · Nursing · Patient Satisfaction in Healthcare · Primary Care and Health Outcomes · Psychology

• Measuring chronic care management experience of patients with diabetes

  Open Access•Hanneke W Drewes, Janneke Van Til-de Jong et al.•International Journal of…•2012

  Incluir item

• Inter-doctor variations in the assessment of functional incapacities by insurance physicians

  Open Access•Antonius JM Schellart, Henny Mulders et al.•BMC Public Health•2011

  Incluir item

• The Consumer Quality Index in an accident and emergency department

  Open Access•Nanne Bos, Leontien M Sturms et al.•Health Expectations•2015

  Incluir item

• Closing the patient experience chasm

  Open Access•Alina Smirnova, Kiki M J M H Lombarts et al.•Health Expectations•2017

  Incluir item

• Associations between technical quality of diabetes care and patient experience

  Open Access•Onyebuchi A Arah, Roman Blaško et al.•Health Expectations•2013

  Incluir item

• Homeless youth's experiences with shelter and community care services

  Open Access•Astrid M Altena, Mariëlle D Beijersbergen et al.•Children and Youth Services Review•2014

  Incluir item

• Why Health Care Process Performance Measures Can Have Different Relationships to Outcomes for Patients and Hospitals

  John W Finney, Keith Humphreys et al.•American Journal of Public Health•2011

  Incluir item

• Data Analysis Using Regression and Multilevel/Hierarchical Models

  Open Access•Andrew Gelman, Jennifer Hill•Data Analysis Using Regression…•2006

  Incluir item

• The Graphical Presentation of a Collection of Means

  Harvey Goldstein, M J R Healy•Journal of the Royal Statistical…•1995

  Incluir item

• League Tables and Their Limitations

  Harvey Goldstein, David J Spiegelhalter•Journal of the Royal Statistical…•1996

  Incluir item

• Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research

  Open Access•Gary King, Christopher J L Murray et al.•American Political Science Review•2003

  Incluir item

• Quality of care from the patients' perspective

  Open Access•Herman J Sixma, H Sixma et al.•Health Expectations•1998

  Incluir item

• A brief conceptual tutorial of multilevel analysis in social epidemiology

  Juan Merlo, Basile Chaix et al.•Journal of Epidemiology and…•2005

  Incluir item

• A brief conceptual tutorial of multilevel analysis in social epidemiology

  Juan Merlo, Basile Chaix et al.•Journal of Epidemiology and…•2006

  Incluir item

• Multilevel models and scientific progress in social epidemiology

  Jeffrey B Bingenheimer•Journal of Epidemiology and…•2005

  Incluir item

• Do Hospital Bed Reduction and Multiple System Reform Affect Patient Mortality

  Peter Davis, Roy Lay-Yee et al.•Medical Care•2007

  Incluir item

• Hospital Level of Care and Neonatal Mortality in Low- and High-Risk Deliveries

  Juan Merlo, Ulf-Göran Gerdtham et al.•Medical Care•2005

  Incluir item

• Factors Affecting Response Rates to the Consumer Assessment of Health Plans Study Survey

  Alan M Zaslavsky, Lawrence Zaborski et al.•Medical Care•2002

  Incluir item

• Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research

  Open Access•Gary King, Christopher J L Murray et al.•American Political Science Review•2004

  Incluir item