A Signal Through the Noise

Do Professionalism Concerns Impact the Decision Making of Competence Committees

Bibliographic Data

ID21613293
AuthorsScott Odorizzi (0000-0002-5374-6389, University of Ottawa, corresponding author), Warren J Cheung (0000-0002-2730-8190, is assistant professor and staff physician, Department of Emergency Medicine, University of Ottawa, Ottawa, Ontario, Canada.), Jonathan Sherbino (0000-0003-0344-8057, is professor, Division of Emergency Medicine, Department of Medicine, and assistant dean, health professions education research, McMaster University, Hamilton, Ontario, Canada.), A C Lee (is conjoint associate professor, School of Medicine and Public Health, The University of Newcastle Australia, Callaghan, New South Wales, Australia, and psychometrician, Royal Australasian College of Physicians, Sydney, New South Wales, Australia.), A-Yeong Lee (0009-0002-6047-522X, Royal Australasian College of Physicians), Lisa Thurgur (0000-0003-3357-1371, is assistant professor and staff physician, Department of Emergency Medicine, and program director, Royal College Emergency Medicine Residency Program, University of Ottawa, Ottawa, Ontario, Canada.), Jason R Frank (0000-0002-6076-0146, is associate professor and staff physician, Department of Emergency Medicine, University of Ottawa, and director, Specialty Education, Strategy and Standards, Office of Specialty Education, Royal College of Physicians and Surgeons of Canada, Ottawa, Ontario, Canada.)
Year2020
Volume95
Issue6
Pages896-901
Publication date2020-06-01
Open AccessNo
TypeARTICLE
VenueAcademic Medicine (JOURNAL)
Journal identifiersISSN: 1040-2446 • E-ISSN: 1938-808X
PublisherOxford University Press (OUP) (PUBLISHER)
DOI10.1097/acm.0000000000003005
PMID31577582
OpenAlexW2978399833
LanguageEN
Citations received1
References cited18

PURPOSE: To characterize how professionalism concerns influence individual reviewers' decisions about resident progression using simulated competence committee (CC) reviews. METHOD: In April 2017, the authors conducted a survey of 25 Royal College of Physicians and Surgeons of Canada emergency medicine residency program directors and senior faculty who were likely to function as members of a CC (or equivalent) at their institution. Participants took a survey with 12 resident portfolios, each containing hypothetical formative and summative assessments. Six portfolios represented residents progressing as expected (PAE) and 6 represented residents not progressing as expected (NPAE). A professionalism variable (PV) was developed for each portfolio. Two counterbalanced surveys were developed in which 6 portfolios contained a PV and 6 portfolios did not (for each PV condition, 3 portfolios represented residents PAE and 3 represented residents NPAE). Participants were asked to make progression decisions based on each portfolio. RESULTS: Without PVs, the consistency of participants giving scores of 1 or 2 (i.e., little or no need for educational intervention) to residents PAE and to those NPAE was 92% and 10%, respectively. When a PV was added, the consistency decreased by 34% for residents PAE and increased by 4% for those NPAE (P = .01). CONCLUSIONS: When reviewing a simulated resident portfolio, individual reviewer scores for residents PAE were responsive to the addition of professionalism concerns. Considering this, educators using a CC should have a system to report, collect, and document professionalism issues

Medical education · Applied Psychology · Innovations in Medical Education · Medicine · Psychology · Simulation-Based Education in Healthcare · Social Psychology · Surgical Simulation and Training

Tools

Open DOISci-HubOpen Access