The Use and Validity of Standardized Achievement Tests for Evaluating New Curricular Interventions in Mathematics and Science
Bibliographic Data
| ID | 12470948 |
|---|---|
| Authors | Joshua Sussman (0000-0002-8223-178X, University of California, Berkeley, CA, USA, corresponding author), Mark Wilson (0000-0002-0425-5305, University of California, Berkeley), Mark R Wilson (0000-0002-9551-7445, University of California, Berkeley, CA, USA) |
| Year | 2018 |
| Volume | 40 |
| Issue | 2 |
| Pages | 190-213 |
| Publication date | 2018-05-07 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1098-2140 • E-ISSN: 1557-0878 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1098214018767313 |
| OpenAlex | W2802937874 |
| Language | EN |
| Citations received | 9 |
| References cited | 35 |
We investigated the use and validity of standardized achievement tests for summative evaluation of 78 educational intervention projects funded by the Institute of Education Sciences (IES) math and science education program. Investigators from 46 projects evaluated curricular interventions with standardized achievement tests as outcome measures. Twenty-five of the projects had potential validity problems related to a misalignment between the achievement test and the intervention. A closer analysis of 11 of those projects flagged as high risk for validity problems showed that only 6 projects attended to the validity of the test, and only 1 project provided adequate validity evidence. We conclude that there is widespread inappropriate use of achievement tests that threatens the validity of educational evaluations. To better support innovation, evaluators must dedicate more attention to the validity of the outcome measures they use
Academic achievement · Achievement test · External validity · Formative assessment · Intervention (counseling · Mathematics education · Medical education · Predictive validity · Program evaluation · Psychological intervention · Psychometrics · Standardized test · Statistics · Summative assessment · Test (biology · Test validity · Clinical Psychology · Educational Assessment and Improvement · Educational Assessment and Pedagogy · Evaluation and Performance Assessment · Mathematics · Medicine · Psychology · Social Psychology
Strengthening the Research Base That Informs STEM Instructional Improvement Efforts
Feeling Responsible Together
Universal Screening in Practice
Evaluation of Teacher Education Curricula and its relevance to licensure examination using Context, Input, Process and Product (Cipp) model
Catching up after Covid-19
From pocket to physics
School-based interventions for primary and secondary school students with intellectual disability
Las evaluaciones educacionales estandarizadas desde la experiencia de los actores
Developing Ambitious Mathematics Instruction Through Web-Based Coaching
Design sensitivity
Epistemologies in practice
Building an Assessment Argument to Design and Use Next Generation Science Assessments in Efficacy Studies of Curriculum Interventions
What Doesn’t Work
Learning from Attempts to Improve Schooling
The Consequences of Experimentalism in Formulating Recommendations for Policy and Practice in Mathematics Education
Measuring the Content of Instruction
Constructing Aligned Assessments Using Automated Test Construction
Designing to develop disciplinary dispositions
Validity of psychological assessment
An argument-based approach to validity
| Unique citing works | 9 |
|---|---|
| Citations per year | 1,29 |
| Citation span | 2019 - 2026 (8) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 9 |