Combining Multiple Indicators of Clinical Quality

OBJECTIVE: To compare different methods of combining quality indicators scores to produce composite scores that summarize the overall performance of health care providers. METHODS: Five methods for computing a composite quality score were compared: the "All-or-None," the "70% Standard," the "Overall Percentage," the "Indicator Average," and the "Patient Average." The first 2 "criterion-referenced" methods assess the degree to which a provider has reached a threshold for quality of care for each patient (100% or 70%). The remaining "absolute score" methods produce scores representing the proportion of required care successfully provided. Each method was applied to 2 quality indicator datasets, derived from audits of UK family practitioner records. Dataset A included quality indicator data for 1178 patients from 16 family practices covering 23 acute, chronic, and preventative conditions. Dataset B included data on 3285 patients from 60 family practices, covering 3 chronic conditions. RESULTS: The results varied considerably depending on the method of aggregation used, resulting in substantial differences in how providers scored. The results also varied considerably for the 2 datasets. There was more agreement between methods for dataset B, but for dataset A 6 of the 16 practices moved between the top and bottom quartiles depending upon the method used. CONCLUSIONS: Different methods of computing composite quality scores can lead to different conclusions being drawn about both relative and absolute quality among health care providers. Different methods are suited to different types of application. The main advantages and disadvantages of each method are described and discussed

Audit · Health care · Operations management · Quality (philosophy) · Quality management · Quality Score · Quartile · Statistics · Mathematics · Medicine · Patient Satisfaction in Healthcare · Primary Care and Health Outcomes

• Concordance of Hospital Ranks and Category Ratings Using the Current Technical Specification of US Hospital Star Ratings and Reasonable Alternative Specifications

  Open Access•Matthew Barclay, Mary Dixon-Woods et al.•JAMA Health Forum•2022

  Incluir item

• What is Good Quality of Health Care

  Open Access•Magne Nylenna, Øyvind Andresen Bjertnaes et al.•Professions and Professionalism•2015

  Incluir item

• Measuring Quality of Public Hospitals in Croatia Using a Multi-Criteria Approach

  Open Access•Nikola Kadoić, Diana Šimić et al.•International Journal of…•2021

  Incluir item

• Do low-income coronary artery bypass surgery patients have equal opportunity to access excellent quality of care and enjoy good outcome in Taiwan

  Open Access•Tsung-Hsien Yu, Tsung‐Hsien Yu et al.•International Journal for Equity…•2014

  Incluir item

• Quality of inpatient care in public and private hospitals in Sri Lanka

  Open Access•Ravindra P Rannan-Eliya, Ravindra P Rannan‐Eliya et al.•Health Policy and Planning•2015

  Incluir item

• The quality of care in outpatient primary care in public and private sectors in Malaysia

  Open Access•May Chien Chin, Sheamini Sivasampu et al.•Health Policy and Planning•2019

  Incluir item

• The quality of outpatient primary care in public and private sectors in Sri Lanka—how well do patient perceptions match reality and what are the implications

  Open Access•Ravindra P Rannan-Eliya, Ravindra P Rannan‐Eliya et al.•Health Policy and Planning•2015

  Incluir item

• Estimating a Composite Measure of Hospital Quality From the Hospital Compare Database

  Michael Shwartz, Justin Ren et al.•Medical Care•2008

  Incluir item

• Quality and Cost in Community Health Centers

  Kathleen Carey, Qing Luo et al.•Medical Care•2021

  Incluir item

• The Quality of Hospital Care for Medicaid and Private Pay Patients

  Joel S Weissman, Christine Vogeli et al.•Medical Care•2013

  Incluir item

• Quality of Care Provided to Individual Patients in US Hospitals

  Christine Vogeli, Raymond Kang et al.•Medical Care•2009

  Incluir item

• Precision of Individual and Composite Performance Scores

  Arna L van Doorn-Klomberg, Jozé C C Braspenning et al.•Medical Care•2013

  Incluir item

• A Probability Metric for Identifying High-Performing Facilities

  Michael Shwartz, Erol A Peköz et al.•Medical Care•2014

  Incluir item

• Developing robust composite measures of healthcare quality - Ranking intervals and dominance relations for Scottish Health Boards

  Open Access•Laura Schang, Yrjänä Hynninen et al.•Social Science & Medicine•2016

  Incluir item

• The Quality of Health Care Delivered to Adults in the United States

  ELIZABETH A MCGLYNN, Steven M Asch et al.•New England Journal of Medicine•2003

  Incluir item

• Estimating the Reliability of Aggregate-Level Variables Based on Individual-Level Characteristics

  Open Access•Robert M O’brien, Robert M O'Brien•Sociological Methods & Research•1990

  Incluir item

• How Robust Are Hospital Ranks Based on Composite Performance Measures

  Rowena Jacobs, Maria Goddard et al.•Medical Care•2005

  Incluir item