Challenging the gold standard consensus
Randomised controlled trials (RCTs) and their pitfalls in evidence-based education
Bibliographic Data
| ID | 12905949 |
|---|---|
| Authors | Jaime D Parra (0000-0003-1902-7660, Universidad del Norte, corresponding author), David B Edwards (0000-0003-3955-9525, University of Hawaiʻi at Mānoa) |
| Year | 2024 |
| Volume | 65 |
| Issue | 5 |
| Pages | 513-530 |
| Publication date | 2024-02-18 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Critical Studies in Education (JOURNAL) |
| Journal identifiers | ISSN: 1750-8487 • E-ISSN: 1750-8495 |
| Publisher | Taylor & Francis (PUBLISHER • GB) |
| DOI | 10.1080/17508487.2024.2314118 |
| OpenAlex | W4391917373 |
| Language | EN |
| Citations received | 13 |
| References cited | 66 |
This paper seeks to raise awareness among educational researchers and practitioners of some significant weaknesses and internal contradictions of randomised control trials (RCTs). Although critiques throughout the years from education scholars have pointed to the detrimental effects of this experimental approach on education practice and values, RCTs are considered the gold standard for assessing the impact of education policies and interventions. By drawing on the approach of immanent critique, we elucidate substantial argumentative gaps between the assumptions and applications – that is, between the theory and reality – of RCTs in empirical research. This kind of analytic exercise complements existing critiques from outside the experimental discourse based on moral and epistemic principles. The present paper, in contrast, contributes to the literature by highlighting internal limitations and contradictions that can be seen by probing the logic espoused by those who are proponents of RCTs. In fleshing out our argument, we seek to encourage more informed and critical engagement by educators, policymakers, and researchers, among other stakeholders, when they are confronted with proposals for education programmes and reforms supported by findings from RCTs
Gold standard (test · Randomized controlled trial · Sociology · Health and Medical Research Impacts · Medicine · Psychology · Internal Medicine
A Snowball’s Chance… Methodological Considerations and Possibilities of Recruiting General Practitioners to Qualitative Research Through Large-Scale Group Chat Networks
Reimagining Development
Afterword
Research in transformation
‘Acting it out really makes it stick in your brain’
EdTech implementation research in low‐ and middle‐income countries
Evidence-based research in education
Introduction to special issue
Edtech brokers and evidence governance
Utopia, hope and desire in education futures
Potentials and pitfalls of design-based research on lesson study
Which children, whose childhoods? How the Covid-19 pandemic has amplified epistemic power struggles in early childhood education
Digital personalised learning to improve literacy and numeracy outcomes
Enlightened Common Sense
The Case Against Statistical Significance Testing
Instruments, Randomization, and Learning about Development
The Power and Pitfalls of Experiments in Development Economics
Worms
Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies
Interpreting public policy dilemmas
World Bank Influence on Policy Formation in Education
The World Bank’s Saber
Mostly Harmless Econometrics
Why “What Works” Won’t Work
The Experimental Approach to Development Economics
Randomized Controlled Experiments to End Poverty
RCTs for better policy? The case of public systems in developing countries
The rise of “behavioral man”
The suspect statistics of best practices
Nobel Rebels in Disguise — Assessing the Rise and Rule of the Randomistas
What works, for whom, and in what circumstances? Towards a critical realist understanding of learning in international and comparative education
The history and problems in the making of education policy at the World Bank 1960–2000
Have RCTs brought back the “Empirical” into Economics
Finding our balance? Revisiting the randomization revolution in development economics ten years further on
The implications of a fundamental contradiction in advocating randomized trials for policy
The misdirection of public policy
A broken paradigm? What education needs to learn from evidence-based medicine
The Myth of the Normal Curve a Theoretical Critique and Examination of its Role in Teaching and Research
People, personal projects and the challenging of social structures
The new randomised controlled trials (RCT) movement in public policy
Evidence-Based Education Policies
The Role of Context in Educational RCT Findings
Rigorous Large-Scale Educational RCTs Are Often Uninformative
Bridging the Gap Between Research and Practice
A Realist Theory of Science
Tantalus on the Road to Asymptopia
Understanding and misunderstanding randomized controlled trials
Global Education Policy, Impact Evaluations, and Alternatives
The Value of Qualitative Inquiry for Public Policy
| Unique citing works | 13 |
|---|---|
| Citations per year | 6,5 |
| Citation span | 2024 - 2026 (3) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 12 |