A Protocol to Assess Contextual Factors During Program Impact Evaluation
A Case Study of a STEM Gender Equity Intervention in Higher Education
Datos Bibliográficos
| ID | 12470420 |
|---|---|
| Autores | Suzanne Nobrega (0000-0002-2354-0996, University of Massachusetts Lowell, Lowell, MA, USA, autor de correspondencia), Kasper Edwards (0000-0002-6328-1765, Technical University of Denmark, Lyngby, Denmark), Mazen El Ghaziri (0000-0003-1146-9982, University of Massachusetts Lowell, Lowell, MA, USA), Lauren Giacobbe (0000-0001-9183-0154, University of Massachusetts Lowell, Lowell, MA, USA), Serena Rice (0000-0003-4500-5430, University of Massachusetts Lowell, Lowell, MA, USA), Laura Punnett (0000-0001-9270-9946, University of Massachusetts Lowell, Lowell, MA, USA) |
| Año | 2023 |
| Volumen | 45 |
| Número | 4 |
| Páginas | 592-609 |
| Fecha de publicación | 2023-05-02 |
| Peer Reviewed | Sí |
| Open Access | Sí |
| Tipo | ARTICLE |
| Revista | American Journal of Evaluation (JOURNAL) |
| Identificadores de la revista | ISSN: 1098-2140 • E-ISSN: 1557-0878 |
| Editorial | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/10982140231152281 |
| PMID | 39664915 |
| OpenAlex | W4367845839 |
| Idioma | EN |
| Referencias citadas | 28 |
Program evaluations that lack experimental design often fail to produce evidence of impact because there is no available control group. Theory-based evaluations can generate evidence of a program's causal effects if evaluators collect evidence along the theorized causal chain and identify possible competing causes. However, few methods are available for assessing competing causes in the program environment. Effect Modifier Assessment (EMA) is a method previously used in smaller-scale studies to assess possible competing causes of observed changes following an intervention. In our case study of a university gender equity intervention, EMA generated useful evidence of competing causes to augment program evaluation. Top-down administrative culture, poor experiences with hiring and promotion, and workload were identified as impeding forces that might have reduced program benefits. The EMA addresses a methodological gap in theory-based evaluation and might be useful in a variety of program settings
Actuarial science · Business · Causal chain · Equity (law · Impact evaluation · Intervention (counseling · Political science · Program Design Language · Program evaluation · Promotion (chess · Protocol (science · Scale (ratio · Variety (cybernetics · Workload · Applied Psychology · Computer Science · Educational Assessment and Improvement · Evaluation and Performance Assessment · Medicine · Psychology · Public Policy and Administration Research
Theory‐based evaluation
An Introduction to Scientific Realist Evaluation
Developing a conceptual evaluation framework for gender equality interventions in research and innovation
Developing Initial Middle Range Theories in Realist Evaluation
Dissemination and Implementation Science Approaches for Occupational Safety and Health Research
Contribution Analysis Applied
Contribution Analysis
Addressing Attribution through Contribution Analysis
Challenging gendered microaggressions in the academy
Credible impact evaluation in complex contexts
Contribution analysis
Applying contribution analysis
Making contribution analysis work
Process Tracing and Contribution Analysis
Mobilizing bystanders to address microaggressions in the workplace
Feasibility of Virtual Focus Groups in Program Impact Evaluation
| Velocidad de citación | historical |
|---|---|
| Altamente citado | No |