Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Retracted Article

High replicability of newly discovered social-behavioural findings is achievable

Bibliographic Data

ID7931455
AuthorsJohn Protzko (0000-0001-5710-8635, Central Connecticut State University, corresponding author), Jon A Krosnick (0000-0003-0336-1613, Stanford University), Jon Krosnick, L D Nelson (0000-0003-1148-4461, University of California, Berkeley), Leif Nelson, Brian A Nosek (0000-0001-6797-5476, Center for Open Science), Jordan Axt (0000-0003-3944-8331, McGill University), Matt Berent, Nicholas Buttrick (0000-0002-1165-8938, University of Wisconsin–Madison), Matthew Debell (0000-0002-1126-1586, Stanford University), Charles R Ebersole (0000-0002-8607-2579, University of Virginia), Lundmark (0000-0003-4096-988X, University of Gothenburg), Bo Macinnis (Stanford University), Michael O’donnell (0000-0002-8953-3609, Georgetown University), Hannah Perfecto (0000-0002-1121-3437, Washington University in St. Louis), James E Pustejovsky (0000-0003-0591-9465, University of Wisconsin–Madison), Scott S Roeder (University of South Carolina), Jan Walleczek (0009-0006-9362-2352), Jonathan W Schooler (0000-0002-4929-3372, University of California, Santa Barbara)
Year2023
Volume8
Issue2
Pages311-319
Publication date2023-11-09
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueNature Human Behaviour (JOURNAL)
Journal identifiersISSN: 2397-3374 • E-ISSN: 2397-3374
PublisherSpringer Science and Business Media LLC (PUBLISHER)
DOI10.1038/s41562-023-01749-9
PMID37945809
OpenAlexW4388523091
LanguageEN
Citations received8
References cited45

Failures to replicate evidence of new discoveries have forced scientists to ask whether this unreliability is due to suboptimal implementation of methods or whether presumptively optimal methods are not, in fact, optimal. This paper reports an investigation by four coordinated laboratories of the prospective replicability of 16 novel experimental findings using rigour-enhancing practices: confirmatory tests, large sample sizes, preregistration and methodological transparency. In contrast to past systematic replication efforts that reported replication rates averaging 50%, replication attempts here produced the expected effects with significance testing ( P

Biology · Behavioral Health and Interventions · Mental Health Research Topics · Meta-analysis and systematic reviews · Psychology

  • The Artificial Social Agent Questionnaire (Asaq) — Development and evaluation of a validated instrument for capturing human interaction experiences with artificial social agents

    Open Access•Siska Fitrianie, Merijn Bruijnes et al.•International Journal of…•2025

  • Single paper meta‐analysis is unavoidable

    Open Access•Blakeley B Mcshane, Ulf Böckenholt•Journal of Consumer Psychology•2025

  • Metachangemaking

    Brandon Reynante, John Wilcox et al.•Journal of Moral Education•2025

  • On the Continued Need for Replication in Media and Communication Research

    Open Access•Nicholas David Bowman•Media and Communication•2024

  • Open Access, Scholarly Communication, and Open Science in Psychology

    Open Access•Laura Bowering Mullen•SAGE Open•2024

  • Beyond Eyeball Tests

    Open Access•Jais Adam‐troian, Jocelyn J Bélanger•Aggressive Behavior•2024

  • Preregistration and predictivism

    Open Access•Hong Hui Choi•Synthese•2024

  • Claims about scientific rigour require rigour

    Open Access•Joe Bak-Coleman, Berna Devezer•Nature Human Behaviour•2024

  • The Alleged Crisis and the Illusion of Exact Replication

    Open Access•Wolfgang Stroebe, Fritz Strack•Perspectives on Psychological…•2014

  • What is replication?

    Open Access•Brian A Nosek, Timothy M Errington•PLOS Biology•2020

  • Contextual sensitivity in scientific reproducibility

    Open Access•Jay Joseph Van Bavel, Peter Mende‐Siedlecki et al.•Proceedings of the National…•2016

  • An Agenda for Purely Confirmatory Research

    Open Access•Eric-Jan Wagenmakers, Ruud Wetzels et al.•Perspectives on Psychological…•2012

  • Raise standards for preclinical cancer research

    Open Access•C Glenn Begley, Lee M Ellis•Nature•2012

  • Fixed effects and variance components estimation in three-level meta-analysis

    Open Access•Spyros Konstantopoulos•Research Synthesis Methods•2011

  • Evaluating replicability of laboratory experiments in economics

    Open Access•Colin F Camerer, Anna Dreber et al.•Science•2016

  • Comment on “Estimating the reproducibility of psychological science”

    Open Access•Daniel T Gilbert, Gary King et al.•Science•2016

  • Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences

    Open Access•Stefan Schmidt•Review of General Psychology•2009

  • Small-Sample Adjustments for Tests of Moderators and Model Fit Using Robust Variance Estimation in Meta-Regression

    Open Access•Elise Tipton, Elizabeth Tipton et al.•Journal of Educational and…•2015

  • Estimating the reproducibility of psychological science

    Open Access•Open Science Collaboration•Science•2015

  • False-Positive Psychology

    Open Access•Joseph P Simmons, L D Nelson et al.•Psychological Science•2011

  • Conducting Meta-Analyses in R with the metafor Package

    Open Access•Wolfgang Viechtbauer•Journal of Statistical Software•2010

  • One Hundred Years of Social Psychology Quantitatively Described

    Open Access•F Richard, F D Richard et al.•Review of General Psychology•2003

  • Many Labs 2

    Open Access•Richard A Klein, Mino Vianello et al.•Advances in Methods and Practices…•2018

  • Moderation of classic social psychological effects by demographics in the U.S. adult population

    Open Access•David S Yeager, Jon A Krosnick et al.•Journal of Personality and Social…•2019

  • The pipeline project

    Open Access•Martin Schweinsberg, Nikhil Madan et al.•Journal of Experimental Social…•2016

  • Many Labs 3

    Open Access•Charles R Ebersole, Olivia E Atherton et al.•Journal of Experimental Social…•2016

  • Comparing meta-analyses and preregistered multiple-laboratory replication projects

    Open Access•Amanda Kvarven, Eirik Strømland et al.•Nature Human Behaviour•2019

  • Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015

    Open Access•Colin F Camerer, Anna Dreber et al.•Nature Human Behaviour•2018

  • Consequences of prejudice against the null hypothesis

    Anthony G Greenwald•Psychological Bulletin•1975

  • The file drawer problem and tolerance for null results

    Robert Rosenthal•Psychological Bulletin•1979

Unique citing works8
Citations per year4
Citation span2024 - 2025 (2)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 7

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae