Both Questionable and Open Research Practices Are Prevalent in Education Research
Bibliographic Data
| ID | 9733444 |
|---|---|
| Authors | Matthew C Makel (0000-0002-3837-0088, Johns Hopkins University, Baltimore, Md, corresponding author), Jaret Hodges (0000-0002-4427-5247, University of North Texas, Denton, TX), Bryan G Cook (0000-0001-9294-0873, University of Virginia, Charlottesville, Va), Jonathan A Plucker (0000-0002-5327-0851, Johns Hopkins University, Baltimore, Md) |
| Year | 2021 |
| Volume | 50 |
| Issue | 8 |
| Pages | 493-504 |
| Publication date | 2021-11-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational Researcher (JOURNAL) |
| Journal identifiers | ISSN: 0013-189X • E-ISSN: 1935-102X |
| Publisher | American Educational Research Association (AERA) (PUBLISHER) |
| DOI | 10.3102/0013189x211001356 |
| OpenAlex | W3134417698 |
| Language | EN |
| Citations received | 18 |
| References cited | 44 |
Concerns about the conduct of research are pervasive in many fields, including education. In this preregistered study, we replicated and extended previous studies from other fields by asking education researchers about 10 questionable research practices and five open research practices. We asked them to estimate the prevalence of the practices in the field, to self-report their own use of such practices, and to estimate the appropriateness of these behaviors in education research. We made predictions under four umbrella categories: comparison to psychology, geographic location, career stage, and quantitative orientation. Broadly, our results suggest that both questionable and open research practices are used by many education researchers. This baseline information will be useful as education researchers seek to understand existing social norms and grapple with whether and how to improve research practices
Best practice · Educational research · Field (mathematics · Pedagogy · Political science · Public relations · Sociology · Applied Psychology · Educational Assessment and Improvement · Meta-analysis and systematic reviews · Online Learning and Analytics · Psychology
Questionable and Open Research Practices
Open Science and Single-Case Design Research
Teaching Mathematics with Technology
Questionable Research Practices and Open Science in Quantitative Criminology
A How-to Guide for Open-Science Practices in Special Education Research
Special Education Researchers’ Knowledge, Attitudes, and Reported Use of Open Practices
Introduction to the Special Series
Perceptions of Single-Case Experimental Design Researchers About Questionable and Improved Research Practices
A Registered Report on Selective Reporting in Single-Case Experimental Research
Exploring randomised controlled trials in education
The Accessibility of Published Research in Aera Journals, 2010–2022
Education researchers’ beliefs and barriers towards data sharing
A metascience investigation of inclusive, open, and reproducible science practices in research posters at the 2021 SRCD biennial meeting
Replicable quantitative psychological and educational research
Preregistration of Randomized Controlled Trials
Open science for sustainable tourism
Investigating questionable research practices among Iranian applied linguists
Why social norms matter in science
Estimating the Difference Between Published and Unpublished Effect Sizes
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
Misconduct Policies, Academic Culture and Career Stage, Not Gender or Pressures to Publish, Affect Scientific Integrity
Implications of the Credibility Revolution for Productivity, Creativity, and Progress
Open science challenges, benefits and tips in early career and beyond
Raise standards for preclinical cancer research
Getting to Scale with Good Educational Practice
Is the Replicability Crisis Overblown? Three Arguments Examined
Badges to Acknowledge Open Practices
Promoting an open research culture
Negative results are disappearing from most disciplines and countries
Calculating and reporting effect sizes to facilitate cumulative science
Estimating the reproducibility of psychological science
False-Positive Psychology
Equivalence Tests
Questionable Research Practices Revisited
Harking
Many Labs 2
Outcome-Reporting Bias in Education Research
Facts Are More Important Than Novelty
Rigorous Large-Scale Educational RCTs Are Often Uninformative
Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015
The file drawer problem and tolerance for null results
Being Honest About Dishonesty
| Unique citing works | 18 |
|---|---|
| Citations per year | 3,6 |
| Citation span | 2021 - 2026 (6) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 18 |