Evaluations of training programs to improve capacity in K

A systematic scoping review of methods applied and outcomes assessed

Datos Bibliográficos

ID22230652
AutoresSamantha Shewchuk (0000-0003-1416-9854, University of Delaware, autor de correspondencia), James Wallace (0000-0002-9094-1570), James A Wallace (0000-0003-1487-0122, University of Delaware), Mia Seibold (University of Delaware)
Año2023
Volumen10
Número1
Fecha de publicación2023-11-29
Peer ReviewedSí
Open AccessSí
TipoARTICLE
RevistaHumanities and Social Sciences Communications (JOURNAL)
Identificadores de la revistaISSN: 2662-9992 • E-ISSN: 2662-9992
EditorialSpringer Science and Business Media LLC (PUBLISHER)
DOI10.1057/s41599-023-02403-5
OpenAlexW4389131041
IdiomaEN
Citas recibidas2
Referencias citadas80

This paper examines how frequently K* training programs have been evaluated, synthesizes information on the methods and outcome indicators used, and identifies potential future approaches for evaluation. We conducted a systematic scoping review of publications evaluating K* training programs, including formal and informal training programs targeted toward knowledge brokers, researchers, policymakers, practitioners, and community members. Using broad inclusion criteria, eight electronic databases and Google Scholar were systematically searched using Boolean queries. After independent screening, scientometric and content analysis was conducted to map the literature and provide in-depth insights related to the methodological characteristics, outcomes assessed, and future evaluation approaches proposed by the authors of the included studies. The Kirkpatrick four-level training evaluation model was used to categorize training outcomes. Of the 824 unique resources identified, 47 were eligible for inclusion in the analysis. The number of published articles increased after 2014, with most conducted in the United States and Canada. Many training evaluations were designed to capture process and outcome variables. We found that surveys and interviews of trainees were the most used data collection techniques. Downstream organizational impacts that occurred because of the training were evaluated less frequently. Authors of the included studies cited limitations such as the use of simple evaluative designs, small cohorts/sample sizes, lack of long-term follow-up, and an absence of curriculum evaluation activities. This study found that many evaluations of K* training programs were weak, even though the number of training programs (and the evaluations thereof) have increased steadily since 2014. We found a limited number of studies on K* training outside of the field of health and few studies that assessed the long-term impacts of training. More evidence from well-designed K* training evaluations are needed and we encourage future evaluators and program staff to carefully consider their evaluation design and outcomes to pursue

Categorization · Curriculum · Knowledge management · Medical education · MEDLINE · Pedagogy · Political science · Sample size determination · Statistics · Systematic review · Computer Science · Health Policy Implementation Science · Health Sciences Research and Education · Medicine · Primary Care and Health Outcomes · Psychology · Artificial Intelligence