Empirically Derived Composite Measures of Surgical Performance

BACKGROUND: Individual quality measures have significant limitations for assessing surgical performance. Despite growing interest in composite measures, empirically-based methods for combining multiple domains of surgical quality are not well established. OBJECTIVE: To develop and validate a composite measure of surgical performance that best describes variation in hospital mortality rates and forecasts future performance. RESEARCH DESIGN: Using the national Medicare claims database, we identified all patients undergoing aortic valve replacement in 2000 to 2001 (n = 53,120). To serve as input variables, we identified hospital-level predictors of mortality with aortic valve replacement, including hospital volume, complication rates, and mortality with other procedures. Hospital-specific predicted mortality rates were then determined using Bayesian-derived modeling techniques and assessed against subsequent hospital mortality (2002-2003). RESULTS: Our composite measure explained 78% of the variation in aortic valve replacement mortality rates (2000-2001). The most important input variables were hospital volume, mortality with aortic valve replacement, and mortality for other high-risk cardiac procedures. The composite measure forecasted 70% of future hospital-level variation in mortality rates (2002-2003), and was substantially better in this regard than individual measures. Hospitals scoring in the bottom quintile on the composite measure in 2000 to 2001 had 2-fold higher mortality rates in 2002 to 2003 than hospitals in the top quintile (adjusted odds ratio, 1.97; 95% CI, 1.73-2.23). CONCLUSIONS: Compared with individual surgical quality indicators, empirically derived composite measures are superior in explaining variation in hospital mortality rates and in forecasting future performance. Such measures could be useful for public reporting, value-based purchasing, or benchmarking for quality improvement purposes

Aortic valve replacement · Logistic regression · Mortality rate · Odds · Odds ratio · Stenosis · Valve replacement · Cardiac Valve Diseases and Treatments · Cardiac, Anesthesia and Surgical Outcomes · Emergency Medicine · Internal Medicine · Medicine · Sepsis Diagnosis and Treatment · Surgery

• Differences in Hospital Risk-standardized Mortality Rates for Acute Myocardial Infarction When Assessed Using Transferred and Nontransferred Patients

  Ian J Barbash, Hongwei Zhang et al.•Medical Care•2017

  Incluir item

• A Probability Metric for Identifying High-Performing Facilities

  Michael Shwartz, Erol A Peköz et al.•Medical Care•2014

  Incluir item

• Developing and Evaluating Composite Measures of Cancer Care Quality

  Cleo A Samuel, Kenneth van Surksum et al.•Medical Care•2015

  Incluir item

• Controlling Costs Without Compromising Quality

  Michael Pine, Donald E Fry et al.•Medical Care•2010

  Incluir item

• Risk-adjusted Payment and Performance Assessment for Primary Care

  Arlene S Ash, Randall P Ellis•Medical Care•2012

  Incluir item

• Dimensions of Plan Performance for Sick and Healthy Members on the Consumer Assessments of Health Plans Study 2.0 Survey

  Alan M Zaslavsky, Paul D Cleary•Medical Care•2002

  Incluir item

• Comparison of the Elixhauser and Charlson/Deyo Methods of Comorbidity Measurement in Administrative Data

  Danielle A Southern, Hude Quan et al.•Medical Care•2004

  Incluir item

• Use of Administrative Data to Find Substandard Care

  Saul N Weingart, Lisa I Iezzoni et al.•Medical Care•2000

  Incluir item

• Variations in the Utilization of Coronary Angiography for Elderly Patients with an Acute Myocardial Infarction

  Constantine Gatsonis, Constantine A Gatsonis et al.•Medical Care•1995

  Incluir item

• Identification of In-Hospital Complications From Claims Data

  Ann G Lawthers, Ellen P McCarthy et al.•Medical Care•2000

  Incluir item