Assessing Implementation Fidelity of a School-Based Crisis Prevention Program with an Ex-Post-Facto Design
The Netwass FOI Assessment System
Bibliographic Data
| ID | 15708551 |
|---|---|
| Authors | Nora Fiedler (0000-0002-7076-0027, Freie Universität Berlin, corresponding author), Vincenz Leuschner (0000-0003-1923-8265, Berlin School of Economics and Law), Friederike Sommer (Berlin School of Economics and Law), Dewey Cornell (University of Virginia), Dewey G Cornell (0000-0002-3631-1527, University of Virginia), Herbert Scheithauer (0000-0002-5915-7593, Freie Universität Berlin, corresponding author) |
| Year | 2019 |
| Volume | 14 |
| Issue | 1-2 |
| Pages | 27-40 |
| Publication date | 2019-12-31 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | International Journal of Developmental Science (JOURNAL) |
| Journal identifiers | ISSN: 2191-7485 • E-ISSN: 2192-001X |
| Publisher | IOS Press (PUBLISHER • NL) |
| DOI | 10.3233/dev-200293 |
| OpenAlex | W3018773486 |
| Language | EN |
| References cited | 30 |
This research paper presents an operationalization procedure for measuring fidelity of implementation (FOI) of a school-based crisis prevention program. The implementation literature recommends that program developers specify core components of an intervention that are directly related to a program’s theory of change and need to be implemented with high FOI. This approach allows stakeholders some flexibility to adapt a program to individual circumstances yet helps assure that the intended outcomes are achieved. We trained 3,473 school staff in 98 German schools in the NETWorks Against School Shootings (NETWASS) program. Following the CORE cycle, we conceptualized 12 core components and operationalized relevant FOI dimensions of dosage, quality, adherence. and responsiveness. FOI was measured ex post facto, i.e after program implementation was completed, and separately for three distinct stages of implementation. Finally, we identified theoretical cut-offs for high fidelity on 15 measures using 91 items derived from an existing data set. Results indicate a high FOI across all schools for the dimensions of dosage and quality. Regarding responsiveness, high FOI was found for intervention compliance at t1 and program acceptance at the follow-up. Participant engagement during the trainings was measured separately and remained below our threshold. Adherence to 10 out of 12 core components was high. After training, school staff reported sufficient theoretical knowledge and were sensitized to recognize students in trouble, but actual case evaluation skills left room for improvement.The resulting FOI Assessment System requires validation by empirical research. Multi-level statistical modelling is necessary to test the hyothesized relationships between FOI per stage and outcomes, and obtain empirical validation of the hypothesized core components. Despite the methodological weaknesses of applying the CORE cycle ex post facto, it seems to be a feasible strategy to assess dimensions of FOI
De facto · Fidelity · Political science · Community Health and Development · Computer Science · Evaluation and Performance Assessment · Health Policy Implementation Science · Law · Psychology
Quality of School-Based Prevention Programs
A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research.
Program Integrity in Primary and Early Secondary Prevention
Maximizing the Implementation Quality of Evidence-Based Preventive Interventions in Schools
A review of research on fidelity of implementation
Implementation Matters
Fidelity Criteria
Bridging the Gap Between Prevention Research and Practice
Strategies for enhancing the adoption of school‐based prevention programs
How do implementation efforts relate to program adherence? examining the role of organizational, implementer, and program factors
Studying Rare Events Through Qualitative Case Studies
School Shootings as Organizational Deviance
| Citation velocity | historical |
|---|---|
| Highly cited | No |