Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Both Questionable and Open Research Practices Are Prevalent in Education Research

Bibliographic Data

ID9733444
AuthorsMatthew C Makel (0000-0002-3837-0088, Johns Hopkins University, Baltimore, Md, corresponding author), Jaret Hodges (0000-0002-4427-5247, University of North Texas, Denton, TX), Bryan G Cook (0000-0001-9294-0873, University of Virginia, Charlottesville, Va), Jonathan A Plucker (0000-0002-5327-0851, Johns Hopkins University, Baltimore, Md)
Year2021
Volume50
Issue8
Pages493-504
Publication date2021-11-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational Researcher (JOURNAL)
Journal identifiersISSN: 0013-189X • E-ISSN: 1935-102X
PublisherAmerican Educational Research Association (AERA) (PUBLISHER)
DOI10.3102/0013189x211001356
OpenAlexW3134417698
LanguageEN
Citations received18
References cited44

Concerns about the conduct of research are pervasive in many fields, including education. In this preregistered study, we replicated and extended previous studies from other fields by asking education researchers about 10 questionable research practices and five open research practices. We asked them to estimate the prevalence of the practices in the field, to self-report their own use of such practices, and to estimate the appropriateness of these behaviors in education research. We made predictions under four umbrella categories: comparison to psychology, geographic location, career stage, and quantitative orientation. Broadly, our results suggest that both questionable and open research practices are used by many education researchers. This baseline information will be useful as education researchers seek to understand existing social norms and grapple with whether and how to improve research practices

Best practice · Educational research · Field (mathematics · Pedagogy · Political science · Public relations · Sociology · Applied Psychology · Educational Assessment and Improvement · Meta-analysis and systematic reviews · Online Learning and Analytics · Psychology

  • Questionable and Open Research Practices

    Open Access•Bert N Bakker, Kokil Jaidka et al.•Journal of Communication•2021

  • Open Science and Single-Case Design Research

    Open Access•Bryan G Cook, Austin H Johnson et al.•Remedial and Special Education•2022

  • Teaching Mathematics with Technology

    Open Access•Christopher R Rakes, Michele L Stites et al.•Education Sciences•2022

  • Questionable Research Practices and Open Science in Quantitative Criminology

    Open Access•Jason Chin, Justin T Pickett et al.•Journal of Quantitative Criminology•2023

  • A How-to Guide for Open-Science Practices in Special Education Research

    Open Access•Bryan G Cook, Jesse Irvan Fleming et al.•Remedial and Special Education•2022

  • Special Education Researchers’ Knowledge, Attitudes, and Reported Use of Open Practices

    Open Access•Jesse Irvan Fleming, Sarah Emily Wilson et al.•Remedial and Special Education•2025

  • Introduction to the Special Series

    Open Access•Bryan G Cook, William J Therrien•Remedial and Special Education•2026

  • Perceptions of Single-Case Experimental Design Researchers About Questionable and Improved Research Practices

    Open Access•Jason C Travers, Art Dowdy et al.•Remedial and Special Education•2025

  • A Registered Report on Selective Reporting in Single-Case Experimental Research

    Open Access•Jason C Travers, Matt Tincani et al.•Remedial and Special Education•2026

  • Exploring randomised controlled trials in education

    Open Access•Eadaoin J Slattery, Aidan Clerkin et al.•Irish Educational Studies•2025

  • The Accessibility of Published Research in Aera Journals, 2010–2022

    Open Access•Joshua M Rosenberg, George Veletsianos et al.•Teachers College Record The Voice…•2025

  • Education researchers’ beliefs and barriers towards data sharing

    Open Access•Jessica A R Logan, Allyson L Hayward et al.•Quality & Quantity•2025

  • A metascience investigation of inclusive, open, and reproducible science practices in research posters at the 2021 SRCD biennial meeting

    Open Access•Matthew H Kim, Kristen Buford et al.•Child Development•2024

  • Replicable quantitative psychological and educational research

    Open Access•Ian Cantley•Educational Philosophy and Theory•2022

  • Preregistration of Randomized Controlled Trials

    Open Access•Bryan G Cook, Vivian C Wong et al.•Research on Social Work Practice•2022

  • Open science for sustainable tourism

    Open Access•Xavier Font, Matthew Cannon et al.•Journal of Sustainable Tourism•2023

  • Investigating questionable research practices among Iranian applied linguists

    Open Access•Mohamad Reza Farangi, Hassan Nejadghanbar•System•2024

  • Why social norms matter in science

    Open Access•Vincent Oberhauser, Antonia Velicu et al.•Social Science Research•2026

  • Estimating the Difference Between Published and Unpublished Effect Sizes

    Open Access•Joshua R Polanin, Emily E Tanner-Smith et al.•Review of Educational Research•2016

  • Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling

    Open Access•Leslie K John, G Loewenstein et al.•Psychological Science•2012

  • Misconduct Policies, Academic Culture and Career Stage, Not Gender or Pressures to Publish, Affect Scientific Integrity

    Open Access•Daniele Fanelli, Rodrigo Costas et al.•PLoS ONE•2015

  • Implications of the Credibility Revolution for Productivity, Creativity, and Progress

    Open Access•Simine Vazire•Perspectives on Psychological…•2018

  • Open science challenges, benefits and tips in early career and beyond

    Open Access•Christopher Allen, David M A Mehler•PLOS Biology•2019

  • Raise standards for preclinical cancer research

    Open Access•C Glenn Begley, Lee M Ellis•Nature•2012

  • Getting to Scale with Good Educational Practice

    Richard F Elmore, Richard Elmore•Harvard Educational Review•1996

  • Is the Replicability Crisis Overblown? Three Arguments Examined

    Open Access•Harold Pashler, Christine R Harris•Perspectives on Psychological…•2012

  • Badges to Acknowledge Open Practices

    Open Access•Mallory C Kidwell, Ljiljana B Lazarevic et al.•PLOS Biology•2016

  • Promoting an open research culture

    Open Access•Brian A Nosek, George Alter et al.•Science•2015

  • Negative results are disappearing from most disciplines and countries

    Open Access•Daniele Fanelli•Scientometrics•2012

  • Calculating and reporting effect sizes to facilitate cumulative science

    Open Access•Daniël Lakens•Frontiers in Psychology•2013

  • Estimating the reproducibility of psychological science

    Open Access•Open Science Collaboration•Science•2015

  • False-Positive Psychology

    Open Access•Joseph P Simmons, L D Nelson et al.•Psychological Science•2011

  • Equivalence Tests

    Open Access•Daniël Lakens•Social Psychological and…•2017

  • Questionable Research Practices Revisited

    Open Access•Klaus Fiedler, Norbert Schwarz•Social Psychological and…•2016

  • Harking

    Open Access•Norbert L Kerr•Personality and Social Psychology…•1998

  • Many Labs 2

    Open Access•Richard A Klein, Mino Vianello et al.•Advances in Methods and Practices…•2018

  • Outcome-Reporting Bias in Education Research

    Open Access•Therese Pigott, Therese D Pigott et al.•Educational Researcher•2013

  • Facts Are More Important Than Novelty

    Open Access•Matthew C Makel, Jonathan A Plucker•Educational Researcher•2014

  • Rigorous Large-Scale Educational RCTs Are Often Uninformative

    Open Access•Hugues Lortie-Forgues, Hugues Lortie‐Forgues et al.•Educational Researcher•2019

  • Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015

    Open Access•Colin F Camerer, Anna Dreber et al.•Nature Human Behaviour•2018

  • The file drawer problem and tolerance for null results

    Robert Rosenthal•Psychological Bulletin•1979

  • Being Honest About Dishonesty

    Open Access•Rony Halevy, Shaul Shalvi et al.•Human Communication Research•2014

Unique citing works18
Citations per year3,6
Citation span2021 - 2026 (6)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 18

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae