Accuracy of Risk-Adjusted Mortality Rate As a Measure of Hospital Quality of Care

OBJECTIVES: Reports on hospital quality performance are being produced with increasing frequency by state agencies, commercial data vendors, and health care purchasers. Risk-adjusted mortality rate is the most commonly used measure of quality in these reports. The purpose of this study was to determine whether risk-adjusted mortality rates are valid indicators of hospital quality performance. METHODS: Based on an analytical model of random measurement error, sensitivity and predictive error of mortality rate indicators of hospital performance were estimated. RESULTS: The following six parameters were shown to determine accuracy: (1) mortality risks of patients who receive good quality care and (2) of those who receive poor quality care, (3) proportion of patients (across all hospitals) who receive poor quality care, (4) proportion of hospitals considered to be "poor quality," (5) patients' relative risk of receiving poor quality care in "good quality" and in "poor quality" hospitals, and (6) number of patients treated per hospital. Using best available values for model parameters, analyses demonstrated that in nearly all situations, even with perfect risk adjustment, identifying poor quality hospitals on the basis of mortality rate performance is highly inaccurate. Of hospitals that delivered poor quality care, fewer than 12% were identified as high mortality rate outliers, and more than 60% of outliers were actually good quality hospitals. CONCLUSIONS: Under virtually all realistic assumptions for model parameter values, sensitivity was less than 20% and predictive error was greater than 50%. Reports that measure quality using risk-adjusted mortality rates misinform the public about hospital performance

Health care · Mortality rate · Operations management · Quality (philosophy) · Quality management · Statistics · Emergency Medicine · Healthcare Policy and Management · Medicine · Patient Satisfaction in Healthcare · Primary Care and Health Outcomes · Surgery

• Patient Safety Outcomes in Small Urban and Small Rural Hospitals

  Open Access•Smruti Vartak, Marcia M Ward et al.•The Journal of Rural Health•2010

  Añadir item

• Competition and Quality

  Open Access•Carol Propper, Stephen Burge et al.•The Economic Journal•2008

  Añadir item

• Why Rescue the Administrative Data Version of the “Failure to Rescue” Quality Indicator

  Kathryn M McDonald, Sheryl M Davies et al.•Medical Care•2007

  Añadir item

• Postoperative Mortality and Pulmonary Complication Rankings

  Ahsan M Arozullah, William G Henderson et al.•Medical Care•2003

  Añadir item

• Risk-Adjusted Mortality Rates as a Potential Outcome Indicator for Outpatient Quality Assessments

  Alfredo J Selim, Dan R Berlowitz et al.•Medical Care•2002

  Añadir item

• Performance of the ACG Case-Mix System in Two Canadian Provinces

  Robert J Reid, Leonard Macwilliam et al.•Medical Care•2001

  Añadir item

• The Impact of Under Coding of Cardiac Severity and Comorbid Diseases on the Accuracy of Hospital Report Cards

  Peter C Austin, Jack V Tu et al.•Medical Care•2005

  Añadir item

• A Decade of Mortality Reductions in Major Oncologic Surgery

  Peter A Learn, Peter B Bach•Medical Care•2010

  Añadir item

• The Hospital Standardized Mortality Ratio Fallacy

  Yvette R B M van Gestel, V E P P Lemmens et al.•Medical Care•2012

  Añadir item

• Effect of Definition of Mortality on Hospital Profiles

  Michael L Johnson, H Scott Gordon et al.•Medical Care•2002

  Añadir item

• Aplicação da mortalidade hospitalar após a realização de cirurgia de revascularização do miocárdio para monitoramento do cuidado hospitalar

  Open Access•José Carvalho De Noronha, Mayã Martins et al.•Cadernos de Saude Publica•2004

  Añadir item

• Validity of the risk adjustment approach to compare outcomes

  Open Access•Letícia Krauss Silva•Cadernos de Saude Publica•2003

  Añadir item

• Downsizing within a hospital

  Open Access•Claire Brown, Bengt Arnetz et al.•Social Science & Medicine•2003

  Añadir item

• Measuring the Quality of Medical Care

  DAVID D RUTSTEIN, William Berenberg et al.•New England Journal of Medicine•1976

  Añadir item

• Identifying Poor-Quality Hospitals

  Timothy P Hofer, Rodney A Hayward•Medical Care•1996

  Añadir item