Grades of Evidence
Variability in Quality of Findings in Effectiveness Studies of Complex Field Interventions
Bibliographic Data
| ID | 12470864 |
|---|---|
| Authors | Madhabi Chatterji (0000-0002-7202-1375, Teachers College, Columbia University,, corresponding author) |
| Year | 2007 |
| Volume | 28 |
| Issue | 3 |
| Pages | 239-255 |
| Publication date | 2007-08-24 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1098-2140 • E-ISSN: 1557-0878 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1098214007304884 |
| OpenAlex | W2063523274 |
| Language | EN |
| Citations received | 6 |
| References cited | 18 |
This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal “gold standard” for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as those found in education. It introduces instead the concept of grades of evidence, illustrating how the choice of research designs coupled with the rigor with which they can be executed under field conditions, affects evidence quality progressively. It argues that evidence from effectiveness research should be graded on different design dimensions, accounting for conceptualization and execution aspects of a study. Well-implemented, phased designs using multiple research methods carry the highest potential to yield the best grade of evidence on effects of complex, field interventions
Conceptualization · Economics · Engineering ethics · Epistemology · Evidence-based practice · Field (mathematics · Management science · Psychological intervention · Quality (philosophy · Research design · Social science · Sociology · Community Health and Development · Computer Science · Engineering · Evaluation and Performance Assessment · Health Policy Implementation Science · Psychology
The Choice and Evaluation of Sexual Harassment Interventions in Institutions of Higher Education
Challenges and Adjustments in a Multisite School-Based Randomized Field Trial
Beyond the RCT
Insight Into Evaluation Practice
Negotiating Measurement
Diagnosing bottlenecks in development-stage field experiments
| Unique citing works | 6 |
|---|---|
| Citations per year | 0,38 |
| Citation span | 2010 - 2024 (15) |
| Citation velocity | recent |
| Highly cited | No |
| Citation types | Neutral: 6 |