Pular para o conteúdo principal

ETHNOS_APP

Início • Busca • Periódicos • Lista 0

A Framework for Learning From Null Results

Dados Bibliográficos

ID9735567
AutoresRobin Jacob (0000-0002-9938-5718, University of Michigan, autor correspondente), Robin T Jacob (University of Michigan, Ann Arbor, MI), Fred Doolittle (MDRC, New York, NY), James Kemple (New York University, New York, NY), James J Kemple (New York University), Marie-Andree Somers (MDRC, New York, NY)
Ano2019
Volume48
Fascículo9
Páginas580-589
Data de publicação2019-12-01
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoEducational Researcher (JOURNAL)
Identificadores do periódicoISSN: 0013-189X • E-ISSN: 1935-102X
EditoraAmerican Educational Research Association (AERA) (PUBLISHER)
DOI10.3102/0013189x19891955
OpenAlexW2995058077
IdiomaEN
Citações recebidas24
Referências citadas41

A substantial number of randomized trials of educational interventions that have been conducted over the past two decades have produced null results, with either no impact or an unreliable estimate of impact on student achievement or other outcomes of interest. The investment of time and money spent implementing such trials warrants more useful information than simply “this didn’t work.” In this article, we propose a framework for defining null results and interpreting them and then propose a method for systematically examining a set of potential reasons for a study’s findings. The article builds on prior work on the topic and synthesizes it into a common framework designed to help the field improve both the design and interpretation of randomized trials

Data mining · Econometrics · Field (mathematics · Interpretation (philosophy · Mathematics education · Null (SQL · Null hypothesis · Psychological intervention · Randomized experiment · Set (abstract data type · Statistics · Advanced Causal Inference Techniques · Behavioral and Psychological Studies · Computer Science · Mathematics · Psychology · School Choice and Performance

  • The Effects of Early Childhood Science Educational Interventions on Children’s Science Achievement

    Kathleen A Lynch, Kathleen Lynch et al.•The Elementary School Journal•2026

  • Self-Regulated Learning of Brazilian Students in a Teacher Education Program in Piaui

    Open Access•Ângela Regina Dos Reis Arcoverde, Evely Boruchovitch et al.•Frontiers in Education•2020

  • The effects and predictive power of the diagnostic assessment and achievement of college skills intervention on academic success indicators

    Open Access•Jason Bryer, Heidi Andrade et al.•Educational Technology Research…•2025

  • Exploring Barriers to Early Childhood Teachers’ Implementation of a Supplemental Academic Language Curriculum

    Open Access•Tricia A Zucker, Erin Jacbos et al.•Early Education and Development•2021

  • Effects of an ego-depletion intervention upon online learning

    Open Access•Jeffrey A Greene, Rebekah F Duke et al.•Computers & Education•2022

  • Evaluating the Efficacy of an Intelligent Tutoring System That Integrates Affective Supports Into Math Learning

    Open Access•Mingyu Feng, Natalie Brezack et al.•Journal of Computer Assisted…•2025

  • Does the treatment integrity of a literacy instruction program foster student reading comprehension? A field experiment

    Open Access•Sébastien Dellisse, Xavier Dumay et al.•European Journal of Psychology of…•2021

  • The impacts of a high school healthy marriage and relationship education program

    Open Access•Brian Goesling, Julia Alamillo•Family Relations•2023

  • A Nationwide Study on the Academic Achievement of Homeschool Students and Parents’ Reasons for Homeschooling

    Open Access•Brian D Ray, Braden Hoelzle•Peabody Journal of Education•2026

  • Toward a Science of Failure Analysis

    Open Access•Claire Allen-Platt, Clara-Christina Gerstner et al.•Review of Research in Education•2021

  • Research Worth Using

    Open Access•Norma Ming, Lauren B Goldenberg•Review of Research in Education•2021

  • Restorative Practices

    Open Access•Fiona M Hollands, Stephen M Leach et al.•Journal of School Psychology•2022

  • Real-world universal SEL and academic outcomes

    Open Access•Susan Crandall Hart, James C DiPerna et al.•The Journal of Educational Research•2025

  • Has a U.S. Developmental Education Reform for Academically Underprepared Students Affected College Enrollment

    Open Access•Pei Hu, Christine G Mokher et al.•SAGE Open•2023

  • Challenges and Adjustments in a Multisite School-Based Randomized Field Trial

    Open Access•Debbie L Hahs‐vaughn, Christine Depies Destefano et al.•American Journal of Evaluation•2024

  • Boosting peer influence for the climate? – Intervening friendship networks with serious games to promote food knowledge and reduce meat consumption

    Open Access•Anja Köbrich León, Janosch Schobin•Ecological Economics•2026

  • Human–Animal Interactions and the Promotion of Social and Emotional Competencies

    Melvin Chin-Hao Chan, Kimberly A Schonert-Reichl et al.•Anthrozoös•2022

  • Using Implementation Fidelity to Aid in Interpreting Program Impacts

    Open Access•Heather Hill, Anna Erickson•Educational Researcher•2019

  • Commentary on the Null Results Special Issue

    Open Access•Carolyn J Hill•Educational Researcher•2019

  • Using pupils’ grade obtained in national examinations as an outcome measure in evaluations

    Ben Smith, Stephen P Morris et al.•Research Papers in Education•2023

  • Learning from failure

    Open Access•Mike Coldwell, Nick Moore•British Educational Research…•2024

  • Expecting and Learning From Null Results

    Open Access•Jeffrey C Valentine, Jeffrey Valentine•Educational Researcher•2019

  • The Application of Behavioral Economics to Teacher Professional Development

    Open Access•Kathleen Lynch, Kathleen S Lynch•Educational Researcher•2024

  • My School District Isn't Segregated

    Open Access•Marissa E Thompson, Trejo•Sociology of Education•2024

  • Experimental Estimates of Education Production Functions

    Alan B Krueger•The Quarterly Journal of Economics•1999

  • Professional Development for Science Teachers

    Open Access•Suzanne M Wilson•Science•2013

  • Effective programs for struggling readers

    Open Access•Robert E Slavin, Cynthia Lake et al.•Educational Research Review•2011

  • Empirical Benchmarks for Interpreting Effect Sizes in Research

    Open Access•Carolyn J Hill, Howard S Bloom et al.•Child Development Perspectives•2008

  • The Potential for School-Based Interventions That Target Executive Function to Improve Academic Achievement

    Open Access•Robin Jacob, Julia Parkinson•Review of Educational Research•2015

  • Contradicted and Initially Stronger Effects in Highly Cited Clinical Research

    John P A Ioannidis•JAMA•2005

  • Publication bias in the social sciences

    Open Access•Annie Franco, N Malhotra et al.•Science•2014

  • The ASA Statement on p -Values

    Ronald L Wasserstein, Ron Wasserstein et al.•The American Statistician•2016

  • The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education

    Open Access•Robert Slavin, Dewi Smith•Educational Evaluation and Policy…•2009

  • Getting to Scale with Good Educational Practice

    Richard F Elmore, Richard Elmore•Harvard Educational Review•1996

  • Mind-Set Interventions Are a Scalable Treatment for Academic Underachievement

    Open Access•David Paunesku, Gary M Walton et al.•Psychological Science•2015

  • The Primary Factors that Characterize Effective Interventions with Juvenile Offenders

    Mark W Lipsey•Victims & Offenders•2009

  • CSRP’s Impact on Low-Income Preschoolers’ Preacademic Skills

    Open Access•C Cybele Raver, Stephanie M Jones et al.•Child Development•2011

  • Promoting an open research culture

    Open Access•Brian A Nosek, George Alter et al.•Science•2015

  • Equivalence Tests

    Open Access•Daniël Lakens•Social Psychological and…•2017

  • Publication Bias against Null Results

    Open Access•Raymond Hubbard, J Scott Armstrong•Psychological Reports•1997

  • The Triumph of Hope Over Experience in the Search for “What Works”

    Open Access•David R Olson•Educational Researcher•2004

  • Facts Are More Important Than Novelty

    Open Access•Matthew C Makel, Jonathan A Plucker•Educational Researcher•2014

  • Grade Assignments and the Teacher Pipeline

    Open Access•David Blazar•Educational Researcher•2015

  • Evidence-Based Practices in a Changing World

    Open Access•Christopher J Lemons, Douglas Fuchs et al.•Educational Researcher•2014

  • Teacher Study Group

    Open Access•Russell Gersten, Joseph Dimino et al.•American Educational Research…•2010

  • The file drawer problem and tolerance for null results

    Robert Rosenthal•Psychological Bulletin•1979

Obras citantes distintas24
Citações por ano3,43
Intervalo de citações2019 - 2026 (8)
Velocidade de citaçãocurrent
Altamente citadoNão
Tipos de citaçãoNeutras: 24
Ethnos_APP • Projeto Open Source • Licença MIT • Frontend v2.0.0 • Privacidade e Cookies • Documentação da API: api.ethnos.app/docs • Código da API: GitHub • DOI: 10.5281/zenodo.17049435 • Código do Frontend: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae