The Role of Program Theory in Evaluation Research
A Consideration of the What Works Clearinghouse Standards in the Case of Mathematics Education
Bibliographic Data
| ID | 12470957 |
|---|---|
| Authors | Charles Munter (0000-0002-9887-3381, University of Pittsburgh, corresponding author), Paul Cobb (0000-0003-4014-2970, Vanderbilt University), Calli Shekell (University of Pittsburgh) |
| Year | 2015 |
| Volume | 37 |
| Issue | 1 |
| Pages | 7-26 |
| Publication date | 2015-03-13 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1098-2140 • E-ISSN: 1557-0878 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1098214015571122 |
| OpenAlex | W2045299882 |
| Language | EN |
| Citations received | 4 |
| References cited | 26 |
We examined the extent to which mathematics program evaluations that have been conducted according to methodologically rigorous standards have attended to the theories underlying the programs being evaluated. Our analysis focused on the 37 reports of K–12 mathematics program evaluations in the last two decades that have met standards for inclusion in What Works Clearinghouse syntheses. Each report was coded for the extent to which program theory was articulated and used in the evaluation, and for evaluator, study, and program characteristics. Our analyses revealed that very few evaluations attended to program theory, but that aspects of program theory use—as well as reported effect sizes—varied by study and evaluator characteristics
Epistemology · Evaluation methods · Management science · Mathematics education · Program Design Language · Program evaluation · Programming language · Psychometrics · Research program · Sociology · Statistics · Test theory · Theory of change · Community Health and Development · Computer Science · Educational Assessment and Improvement · Engineering · Evaluation and Performance Assessment · Mathematics · Psychology
Stichwortbeitrag Implementationsforschung
Does the duration of professional development programs influence effects on instruction? An analysis of 174 lessons during a national-scale program
How are the ‘losers’ of the school accountability system constructed in Chile, the USA and England
Theory-based Evaluation of Lesson Study Professional Development
The Handbook of Research Synthesis and Meta-Analysis
Theory-based impact evaluation
Constructing competence
Theory‐based evaluation
Program Integrity in Primary and Early Secondary Prevention
Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research
A conceptual framework for implementation fidelity
Orchestrating Productive Mathematical Discussions
Theory-Based Evaluation in Practice
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Fidelity Criteria
What Doesn’t Work
Perspectives on Evidence-Based Research in Education—What Works? Issues in Synthesizing Educational Program Evaluations
Act
The Multi-Goal, Theory-Driven Approach to Evaluation
Scientifically Debased Research on Learning, 1854-2006
| Unique citing works | 4 |
|---|---|
| Citations per year | 0,67 |
| Citation span | 2020 - 2025 (6) |
| Citation velocity | recent |
| Highly cited | No |
| Citation types | Neutral: 4 |