Measuring Performance Directly Using the Veterans Health Administration Electronic Medical Record

BACKGROUND: Electronic medical records systems (EMR) contain many directly analyzable data fields that may reduce the need for extensive chart review, thus allowing for performance measures to be assessed on a larger proportion of patients in care. OBJECTIVE: This study sought to determine the extent to which selected chart review-based clinical performance measures could be accurately replicated using readily available and directly analyzable EMR data. METHODS: A cross-sectional study using full chart review results from the Veterans Health Administration's External Peer Review Program (EPRP) was merged to EMR data. RESULTS: Over 80% of the data on these selected measures found in chart review was available in a directly analyzable form in the EMR. The extent of missing EMR data varied by site of care (P<0.01). Among patients on whom both sources of data were available, we found a high degree of correlation between the 2 sources in the measures assessed (correlations of 0.89-0.98) and in the concordance between the measures using performance cut points (kappa: 0.86-0.99). Furthermore, there was little evidence of bias; the differences in values were not clinically meaningful (difference of 0.9 mg/dL for low-density lipoprotein cholesterol, 1.2 mm Hg for systolic blood pressure, 0.3 mm Hg for diastolic, and no difference for HgbA1c). CONCLUSIONS: Directly analyzable data fields in the EMR can accurately reproduce selected EPRP measures on most patients. We found no evidence of systematic differences in performance values among these with and without directly analyzable data in the EMR

Chart · Checklist · Concordance · Concordance correlation coefficient · Electronic health record · Electronic medical record · Health care · Medical record · Statistics · Veterans Affairs · Computer Science · Electronic Health Records Systems · Emergency Medicine · Internal Medicine · Mathematics · Medical Coding and Health Information · Medicine · Primary Care and Health Outcomes · Psychology

• Agreement Between Hedis Performance Assessments in the VA and Medicare Advantage

  Open Access•Amal N Trivedi, Ira B Wilson et al.•INQUIRY The Journal of Health…•2016

  Añadir item

• Systematically assessing the quality of dental electronic health record data for an investigation into oral health care disparities

  Open Access•Krishna Kumar Kookal, Muhammad F Walji et al.•Journal of Public Health Dentistry•2024

  Añadir item

• In Data We Trust? Comparison of Electronic Versus Manual Abstraction of Antimicrobial Prescribing Quality Metrics for Hospitalized Veterans With Pneumonia

  Barbara Jones, Barbara E Jones et al.•Medical Care•2018

  Añadir item

• A Decade With the Chronic Care Model

  George L Jackson, Morris Weinberger•Medical Care•2009

  Añadir item

• Increased Documented Brief Alcohol Interventions With a Performance Measure and Electronic Decision Support

  Gwen T Lapham, Carol E Achtmeyer et al.•Medical Care•2012

  Añadir item

• Should We Add Clinical Variables to Administrative Data

  Trisha C Johnston, Trisha Johnston et al.•Medical Care•2007

  Añadir item

• Linkage of Laboratory Results to Medicare Fee-for-Service Claims

  Bradley G Hammill, Lesley H Curtis et al.•Medical Care•2015

  Añadir item

• Improving Hypertension Quality Measurement Using Electronic Health Records

  Stephen D Persell, Abel N Kho et al.•Medical Care•2009

  Añadir item

• Retooling of Paper-based Outcome Measures to Electronic Format

  Edward L Hannan, Stacey C Barrett et al.•Medical Care•2019

  Añadir item

• Agreement Between Electronic Medical Record-based and Self-administered Pain Numeric Rating Scale

  Joseph L Goulet, Cynthia Brandt et al.•Medical Care•2013

  Añadir item

• Evaluating the Impact of Integrated Care on Service Utilization in Serious Mental Illness

  Open Access•Heidi C Waters, Michael F Furukawa et al.•Community Mental Health Journal•2018

  Añadir item

• Adult obesity prevalence in primary care users

  Open Access•Alanna Rigobon, Alanna V Rigobon et al.•Canadian Journal of Public Health•2015

  Añadir item

• Systematic Review

  Open Access•Basit Chaudhry, Jerome Wang et al.•Annals of Internal Medicine•2006

  Añadir item

• Effect of the Transformation of the Veterans Affairs Health Care System on the Quality of Care

  Ashish K Jha, Jonathan B Perlin et al.•New England Journal of Medicine•2003

  Añadir item

• Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

  Domenic V Cicchetti•Psychological Assessment•1994

  Añadir item

• Reinventing VA Health Care

  KENNETH W KIZER, John G Demakis et al.•Medical Care•2000

  Añadir item

• Benchmarking Veterans Affairs Medical Centers in the Delivery of Preventive Health Services

  Bradley N Doebbeling, Thomas Vaughn et al.•Medical Care•2002

  Añadir item

• Benefit-Cost Analysis of Brief Physician Advice With Problem Drinkers in Primary Care Settings

  Michael F Fleming, Marlon P Mundt et al.•Medical Care•2000

  Añadir item

• The Veterans Affairs Healthcare System

  Amy C Justice, Joseph Erdos et al.•Medical Care•2006

  Añadir item

• Validity of Using an Electronic Medical Record for Assessing Quality of Care in an Outpatient Setting

  Andrea L Benin, Grace Vitkauskas et al.•Medical Care•2005

  Añadir item

• Case-Finding for Depression Among Medical Outpatients in the Veterans Health Administration

  Mahesh M Desai, Mayur M Desai et al.•Medical Care•2006

  Añadir item