Written-Based Progress Testing

A Scoping Review

Bibliographic Data

ID21612669
AuthorsVincent Dion (0000-0003-3197-5073, V. Dionis an undergraduate medical education student, Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, Québec, Canada. He was a research assistant to the Paul Grand’Maison de la Société des médecins de l’Université de Sherbrooke research chair in medical education, Sherbrooke, Québec, Canada, at the time this work was completed.), Christina St‐onge (0000-0001-5313-0456, Université de Sherbrooke), Christina St-Onge (C. St-Ongeis professor, Department of Medicine, Faculty of Medicine and Health Sciences, Université de Sherbrooke, and the Paul Grand’Maison de la Société des médecins de l’Université de Sherbrooke research chair in medical education, Sherbrooke, Québec, Canada; ORCID), Ilona Bartman (I. Bartmanis medical education research associate, Medical Council of Canada, Ottawa, Ontario, Canada; ORCID:.), Claire Touchie (0000-0001-7926-9720, C. Touchieis professor of medicine, University of Ottawa, Ottawa, Ontario, Canada. She was chief medical education officer, Medical Council of Canada, Ottawa, Ontario, Canada, at the time this work was completed; ORCID:.), Debra Pugh (0000-0003-4076-9669, D. Pughis medical education advisor, Medical Council of Canada, and associate professor, Department of Medicine, University of Ottawa and The Ottawa Hospital, Ottawa, Ontario, Canada; ORCID:.)
Year2022
Volume97
Issue5
Pages747-757
Publication date2022-05-01
Open AccessNo
TypeARTICLE
VenueAcademic Medicine (JOURNAL)
Journal identifiersISSN: 1040-2446 • E-ISSN: 1938-808X
PublisherOxford University Press (OUP) (PUBLISHER)
DOI10.1097/acm.0000000000004507
PMID34753858
OpenAlexW3211638126
LanguageEN
Citations received3
References cited119

PURPOSE: Progress testing is an increasingly popular form of assessment in which a comprehensive test is administered to learners repeatedly over time. To inform potential users, this scoping review aimed to document barriers, facilitators, and potential outcomes of the use of written progress tests in higher education. METHOD: The authors followed Arksey and O'Malley's scoping review methodology to identify and summarize the literature on progress testing. They searched 6 databases (Academic Search Complete, CINAHL, ERIC, Education Source, MEDLINE, and PsycINFO) on 2 occasions (May 22, 2018, and April 21, 2020) and included articles written in English or French and pertaining to written progress tests in higher education. Two authors screened articles for the inclusion criteria (90% agreement), then data extraction was performed by pairs of authors. Using a snowball approach, the authors also screened additional articles identified from the included reference lists. They completed a thematic analysis through an iterative process. RESULTS: A total of 104 articles were included. The majority of progress tests used a multiple-choice and/or true-or-false question format (95, 91.3%) and were administered 4 times a year (38, 36.5%). The most documented source of validity evidence was internal consistency (38, 36.5%). Four major themes were identified: (1) barriers and challenges to the implementation of progress testing (e.g., need for additional resources); (2) established collaboration as a facilitator of progress testing implementation; (3) factors that increase the acceptance of progress testing (e.g., formative use); and (4) outcomes and consequences of progress test use (e.g., progress testing contributes to an increase in knowledge). CONCLUSIONS: Progress testing appears to have a positive impact on learning, and there is significant validity evidence to support its use. Although progress testing is resource- and time-intensive, strategies such as collaboration with other institutions may facilitate its use

CINAHL · Facilitator · Formative assessment · Mathematics education · Medical education · MEDLINE · Psychological intervention · PsycINFO · Educational Assessment and Pedagogy · Medicine · Nursing · Psychology · Psychometric Methodologies and Testing · Social Psychology · Student Assessment and Feedback

Tools

Open DOI