Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Registered Reports

A Method to Increase the Credibility of Published Results

Bibliographic Data

ID5338775
AuthorsBrian A Nosek (0000-0001-6797-5476, Center for Open Science), Daniël Lakens (0000-0002-0247-239X, Eindhoven University of Technology)
Year2014
Volume45
Issue3
Pages137-141
Publication date2014-05-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSocial Psychology (JOURNAL)
Journal identifiersISSN: 1864-9335 • E-ISSN: 2151-2590
PublisherHogrefe Verlag (PUBLISHER • DE)
DOI10.1027/1864-9335/a000192
OpenAlexW2113085067
LanguageEN
Citations received147
References cited39

Ignoring replications and negative results is bad for science. This special issue presents a novel publishing format - Registered Reports - as a partial solution. Peer review occurs prior to data collection, design and analysis plans are preregistered, and results are reported regardless of outcome. Fourteen Registered Reports of replications of important published results in social psychology are reported with strong confirmatory tests. Further, the articles demonstrate open science practices such as open data, open materials, and disclosure of research process, conflicts of interest, and contributions. The credibility of published science will increase with cultural shifts that accept replications and negative results as viable research outcomes, and when transparency and reproducibility are part of standard research practice

Credibility · Economics · Incentive · MEDLINE · Open Science · Political science · Publication bias · Publishing · Replication · Replication (statistics · Statistics · Decision-Making and Behavioral Economics · Explainable Artificial Intelligence (XAI · Meta-analysis and systematic reviews · Psychology · Law · Social Psychology

  • Everything hacked? What is the evidential value of the experimental public administration literature?

    Open Access•Dominik Vogel, Chengxin Xu•Journal of Behavioral Public…•2021

  • The landscape of open science in behavioral addiction research

    Open Access•Charlotte Eben, Beáta Bőthe et al.•Journal of Behavioral Addictions•2023

  • Self-regulation in childhood as a predictor of future outcomes

    Davina A Robson, Mark S Allen et al.•Psychological Bulletin•2020

  • Perceived crisis and reforms

    Paul De Boeck, Moongee Jeon et al.•Psychological Bulletin•2018

  • Does social psychology persist over half a century? A direct replication of Cialdini et al.’s (1975) classic door-in-the-face technique

    Oliver Genschow, Mareike Westfal et al.•Journal of Personality and Social…•2021

  • Best research practices in psychology

    E J Finkel, Paul W Eastwick et al.•Journal of Personality and Social…•2015

  • The Production of Knowledge

    Open Access•Colin Elman, John Gerring et al.•Production of Knowledge•2020

  • Sailing From the Seas of Chaos Into the Corridor of Stability

    Open Access•Daniël Lakens, Ellen R K Evers•Perspectives on Psychological…•2014

  • Sequential hypothesis testing with Bayes factors

    Felix Schönbrodt, Eric-Jan Wagenmakers et al.•Psychological Methods•2017

  • Psychology, Science, and Knowledge Construction

    Patrick E Shrout, Joseph L Rodgers•Annual Review of Psychology•2018

  • The preregistration revolution

    Open Access•Brian A Nosek, Charles R Ebersole et al.•Proceedings of the National…•2018

  • Choosing Prediction Over Explanation in Psychology

    Open Access•Tal Yarkoni, Jacob Westfall•Perspectives on Psychological…•2017

  • Transparency, Reproducibility, and the Credibility of Economics Research

    Open Access•Garret Christensen, Edward Miguel•Journal of Economic Literature•2018

  • Misinformation in and about science

    Open Access•Jevin D West, Carl T Bergstrom•Proceedings of the National…•2021

  • Integrating explanation and prediction in computational social science

    Open Access•Jake M Hofman, Duncan J Watts et al.•Nature•2021

  • On Replication in Communication Science

    Open Access•Bree Mcewan, Christopher J Carpenter et al.•Communication Studies•2018

  • How Many Participants Do We Have to Include in Properly Powered Experiments? A Tutorial of Power Analysis with Reference Tables

    Open Access•Marc Brysbaert•Journal of Cognition•2019

  • The natural selection of bad science

    Open Access•P E Smaldino, Richard Mcelreath•Royal Society Open Science•2016

  • Meta-analyses are no substitute for registered replications

    Open Access•Michiel Van Elk, Dora Matzke et al.•Frontiers in Psychology•2015

  • Exploratory Research

    Open Access•Richard Swedberg•Production of Knowledge•2020

  • Estimating the reproducibility of psychological science

    Open Access•Open Science Collaboration•Science•2015

  • Recent developments in experimental public administration

    Open Access•Rins Hylkema, Stephan Grimmelikhuijsen•International Public Management…•2026

  • Dehumanization of women and men in elective abortion

    Open Access•Qirui Tian, Maria Giuseppina Pacilli et al.•Asian Journal Of Social Psychology•2023

  • The affiliative consequences of same-race and cross-race mimicry

    Elizabeth A Majka, Michael White et al.•The Journal of Social Psychology•2020

  • Promoting the Benefits and Clarifying Misconceptions about Preregistration, Preprints, and Open Science for the Cognitive Science of Religion

    Colleen Kavanagh, Rohan Kapitány•Journal for the Cognitive Science…•2021

  • Past Its Prime? A Methodological Overview and Critique of Religious Priming Research in Social Psychology

    Shoko Watanabe, Sean M Laurent•Journal for the Cognitive Science…•2021

  • Truth and Advocacy

    Open Access•Phoebe C Ellsworth•Perspectives on Psychological…•2021

  • Is Psychological Science Self-Correcting? Citations Before and After Successful and Failed Replications

    Open Access•Paul T Von Hippel•Perspectives on Psychological…•2022

  • To Be Fair

    Open Access•Caspar Van Lissa, Aaron Peikert et al.•Perspectives on Psychological…•2026

  • The Practical Alternative to the p Value Is the Correctly Used p Value

    Open Access•Daniël Lakens•Perspectives on Psychological…•2021

  • Small Effects

    Open Access•Friedrich M Götz, Samuel D Gosling et al.•Perspectives on Psychological…•2022

  • The benefits of preregistration for hypothesis-driven bilingualism research

    Open Access•Daniela Mertzen, Silvia Lago et al.•Bilingualism Language and Cognition•2021

  • Determinants of creative thinking

    Open Access•Ut Na Sio, Kenneth Kotovsky et al.•Thinking & Reasoning•2022

  • Re-evaluating the relationship between pathogen avoidance and preferences for facial symmetry and sexual dimorphism

    Open Access•Joshua M Tybur, Lei Fan et al.•Evolution and Human Behavior•2022

  • Worked-out examples of the adequacy of Bayesian optional stopping

    Open Access•Jorge Tendeiro, Henk A L Kiers et al.•Psychonomic Bulletin & Review•2022

  • The science of leadership

    Open Access•Dov Eden•The Leadership Quarterly•2021

  • Open science practices in the false memory literature

    Open Access•Sera Wiechert, Phaedra Leistra et al.•Memory•2024

  • The crisis of peer review

    Open Access•Helena Horta, Jisun Jung•Higher Education Quarterly•2024

  • Emotions in conceptual spaces

    Marek Sikorski, Ohan Hominis•Philosophical Psychology•2025

  • Exploratory hypothesis tests can be more compelling than confirmatory hypothesis tests

    Open Access•M Rubin, Chris Donkin•Philosophical Psychology•2024

  • Why We Disagree About the Success of Replications

    Open Access•Johanna Sarisoy•Journal for General Philosophy of…•2025

  • Hostile Media Perception on Twitter

    Eric Cooks, Anneliese C Bolland•Journal of Broadcasting &…•2021

  • Discrepant findings on the relation between episodic memory and retrieval practice

    Open Access•Gene A Brewer, Alison Robey et al.•Journal of Memory and Language•2021

  • Share the code, not just the data

    Open Access•Anna Laurinavichyute, Himanshu Yadav et al.•Journal of Memory and Language•2022

  • Updates from the journal

    Open Access•Tilo Strobach, Alejandro J Estudillo•Psychological Research•2025

  • Introduction to the Special Issue of the Scientific Study of Laughter

    Open Access•Sally D Farley•Journal of Nonverbal Behavior•2022

  • Crossing the Red Line? Empirical Evidence and Useful Recommendations on Questionable Research Practices among Business Scholars

    Open Access•Hengky Latan, Charbel José Chiappetta Jabbour et al.•Journal of Business Ethics•2023

  • A Replication and Extension of Three Studies Investigating Escalation of Commitment and Regret Aversion

    Open Access•Nandita Dhanda, Ignazio Ziano et al.•Personality and Social Psychology…•2025

  • The Impact of Incidental Emotion on Prosocial Behavior

    Open Access•Yijin He, Yulin Tan et al.•Personality and Social Psychology…•2025

  • The Montessori Method Under Scrutiny

    Open Access•Samuel P León, Anastasiya A Lipnevich et al.•Review of Educational Research•2026

  • Video Improves Learning in Higher Education

    Open Access•Michael Noetel, Shantell Griffith et al.•Review of Educational Research•2021

  • Test anxiety in primary school children

    Open Access•Davina A Robson, Stuart J Johnstone et al.•Journal of School Psychology•2023

  • Teaching on video as an instructional strategy to reduce confirmation bias—a pre-registered study

    Open Access•Suzan van Brussel, Miranda Timmermans et al.•Instructional Science•2021

  • Comparing instructional strategies to support student teachers’ learning to prepare an open-minded citizenship education lesson

    Open Access•Suzan van Brussel, Miranda Timmermans et al.•Instructional Science•2023

  • Improving careers science

    Open Access•Cort W Rudolph•Journal of Vocational Behavior•2021

  • Prevalence of Registered Reports in experimental psychology journals

    Open Access•Dennis M Gorman, David E Hubbard•Quantitative Science Studies•2025

  • Foregone Opportunities and Choosing Not to Act

    Open Access•Jieying Chen, Long Sang Hui et al.•Social Psychological and…•2021

  • Bolstering Policy Support for Disadvantaged Groups Through Humanization

    Open Access•Andrej Findor, Matej Hruška et al.•Social Psychological and…•2024

  • Underreporting in Psychology Experiments

    Open Access•Annie Franco, N Malhotra et al.•Social Psychological and…•2016

  • The Ego’s Bodyguard

    Open Access•Christoph Heine, Stefan C Schmukle et al.•Social Psychological and…•2026

  • Registered reports for Consciousness and Cognition

    Open Access•Gregory Francis, Talis Bachmann•Consciousness and Cognition•2018

  • The role of free will beliefs in social behavior

    Open Access•Tom St Quinton, David Trafimow et al.•Consciousness and Cognition•2023

  • Open science and public trust in science

    Open Access•Tom Rosman, Michael Bosnjak et al.•Public Understanding of Science•2022

  • Benefits of open and high-powered research outweigh costs

    Etienne P Lebel, L Campbell et al.•Journal of Personality and Social…•2017

  • Mind and body in students' and teachers' engagement

    Open Access•Reinhard Pekrun•British Journal of Educational…•2023

  • Registered Reports as a Method to Increase Credibility of Science – Experimental Study Among Psychological Students

    Open Access•P Sorokowski, Agata Groyecka-Bernard et al.•Journal of Education Culture and…•2019

  • The Interplay between Subjectivity, Statistical Practice, and Psychological Science

    Open Access•Jeffrey N Rouder, Roy D Morey et al.•Collabra•2016

  • A New Replication Norm for Psychology

    Open Access•Etienne P Lebel•Collabra•2015

  • Drivers and social effects of the decision to turn on one’s camera during videoconferencing in groups

    Open Access•Christine Anderl•Cyberpsychology Journal of…•2023

  • Improving rigor and reproducibility in nonhuman primate research

    Open Access•Eliza Bliss‐moreau, Rama Rao Amara et al.•American Journal of Primatology•2021

  • The Open Science of Religion Project @ the IJPR

    Michiel Van Elk, Jordan P Labouff et al.•International Journal for the…•2026

  • Simulate this! An Introduction to Agent-Based Models and their Power to Improve your Research Practice

    Open Access•Julia Eberlen, Geeske Scholz et al.•International Review of Social…•2017

  • Month‐olds Fail to Use Recent Experience to Infer the Syntactic Category of Novel Words

    Open Access•Naomi Havron, Mireille Babineau et al.•Developmental Science•2020

  • Relationship science and the credibility revolution

    Open Access•W J Chopik, Christopher R Chartier et al.•Personal Relationships•2020

  • A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research

    Open Access•Lara Vankelecom, Ole Schacht et al.•Psychologica Belgica•2025

  • Preregistration in infant research—A primer

    Open Access•Naomi Havron, Christina Bergmann et al.•Infancy•2020

  • Registered Reports With Developmental and Secondary Data

    Open Access•Moin Syed, M Brent Donnellan•Emerging Adulthood•2020

  • Is there prejudice from thin air? Replicating the effect of emotion on automatic intergroup attitudes

    Open Access•Jie Dang, Zeynep E Ekim et al.•BMC Psychology•2020

  • On the reproducibility of meta-analyses

    Open Access•Daniël Lakens, Joe Hilgard et al.•BMC Psychology•2016

  • Reshaping the publication process

    Open Access•Charlotte R Pennington, Derek Heim•Addiction Research & Theory•2021

  • The effect of response option order on self-rated health

    Open Access•Dana Garbarski, Nora Cate Schaeffer et al.•Quality of Life Research•2016

  • Replication in Second Language Research

    Open Access•Emma Marsden, Kara Morgan‐short et al.•Language Learning•2018

  • Many Labs 2

    Open Access•Richard A Klein, Mino Vianello et al.•Advances in Methods and Practices…•2018

  • Improving the replicability and generalizability of inferences in quantitative communication research

    J A Long•Annals of the International…•2021

  • How communication scholars see open scholarship

    Open Access•Nicholas David Bowman, Eike M Rinke et al.•Annals of the International…•2022

  • Blinded by the Light

    Ivar Vermeulen, C J Beukeboom et al.•Communication Methods and Measures•2015

  • Looking Back and Looking Forward

    Christian Unkelbach•Social Psychology•2015

  • Be Daring and Cause Trouble

    Adam K Fetterman•Social Psychology•2024

  • Commentary and Rejoinder on

    Simone Schnall, David J Johnson et al.•Social Psychology•2014

  • Survey instructions bias perceptions of environmental health risks

    Open Access•Shane Timmon, Alexandros Papadopoulos et al.•Journal of Risk Research•2024

  • Researcher Degrees of Freedom in the Psychology of Religion

    Sarah Jane Charles, James E Bartlett et al.•International Journal for the…•2019

  • Habit Reversal to Decrease Filled Pauses in Public Speaking

    Open Access•Christoph Bördlein, Anja Sander•Research on Social Work Practice•2019

  • Is Algorithmic Accessibility Sufficient? The Pivotal Role of Accessibility and Accountability in Shaping Trust in Automated Decision‐Making

    Open Access•Limei Gu, Zongfeng Sun•Governance•2025

  • The call for an increased role of replication, extension, and mixed‐methods study designs in organizational research

    Open Access•Thomas A Wright, Dennis Sweeney et al.•Journal of Organizational Behavior•2015

  • A Systematic Scoping Review of the Choice Architecture Movement

    Open Access•Barnabas Szaszi, Anna Pálinkás et al.•Journal of Behavioral Decision…•2017

  • Bridging Feminist Psychology and Open Science

    Open Access•Jes L Matsick, Mary Kruk et al.•Psychology of Women Quarterly•2021

  • Choosing between prediction and explanation in geological engineering

    Amichai Mitelman, Beverly Yang et al.•Interdisciplinary Science Reviews•2023

  • Between Gift-Giving and Accumulation

    Open Access•Wolfgang Kaltenbrunner•Minerva•2025

  • "Reprint of "Methodological and reporting quality in laboratory studies of human eating behavior

    Open Access•Eric Robinson, Kirsten E Bevelander et al.•Appetite•2018

  • Methodological and reporting quality in laboratory studies of human eating behavior

    Open Access•Eric Robinson, Kirsten E Bevelander et al.•Appetite•2018

  • An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

    Open Access•Open Science Collaboration•Perspectives on Psychological…•2012

  • Sailing From the Seas of Chaos Into the Corridor of Stability

    Open Access•Daniël Lakens, Ellen R K Evers•Perspectives on Psychological…•2014

  • Promoting Transparency in Social Science Research

    Open Access•Edward Miguel, Colin F Camerer et al.•Science•2014

  • “Positive” Results Increase Down the Hierarchy of the Sciences

    Open Access•Daniele Fanelli, Enrico Scalas•PLoS ONE•2010

  • A 21 Word Solution

    Open Access•Joseph P Simmons, Leif D Nelson et al.•SSRN Electronic Journal•2012

  • An Agenda for Purely Confirmatory Research

    Open Access•Eric-Jan Wagenmakers, Ruud Wetzels et al.•Perspectives on Psychological…•2012

  • Replications in Psychology Research

    Open Access•Matthew C Makel, Jonathan A Plucker et al.•Perspectives on Psychological…•2012

  • Power failure

    Open Access•Katherine S Button, John P A Ioannidis et al.•Nature Reviews Neuroscience•2013

  • Registered Reports

    Open Access•Christopher D Chambers•Cortex•2013

  • Scientific Utopia

    Open Access•Brian A Nosek, Jeffrey R Spies et al.•Perspectives on Psychological…•2012

  • Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences

    Open Access•Stefan Schmidt•Review of General Psychology•2009

  • False-Positive Psychology

    Open Access•Joseph P Simmons, L D Nelson et al.•Psychological Science•2011

  • Harking

    Open Access•Norbert L Kerr•Personality and Social Psychology…•1998

  • At what sample size do correlations stabilize

    Open Access•Felix Schönbrodt, Felix D Schönbrodt et al.•Journal of Research in Personality•2013

  • Investigating Variation in Replicability

    Open Access•Richard A Klein, Kate A Ratliff et al.•Social Psychology•2014

  • Breakthrough or One-Hit Wonder

    Open Access•Ivar Vermeulen, Anika Batenburg et al.•Social Psychology•2014

  • Replication of Experiments Evaluating Impact of Psychological Distance on Moral Judgment

    Open Access•Iris Žeželj, Iris L Žeželj et al.•Social Psychology•2014

  • Does Recalling Moral Behavior Change the Perception of Brightness

    Open Access•Mark J Brandt, Hans I Jzerman et al.•Social Psychology•2014

  • Replication of the Superstition and Performance Study by

    Open Access•Robert J Calin-Jageman, Tracy L Caldwell•Social Psychology•2014

  • Replication of "Experiencing Physical Warmth Promotes Interpersonal Warmth" by

    Open Access•Dermot Lynott, Katherine S Corker et al.•Social Psychology•2014

  • Forming Impressions of Personality

    Open Access•Sanne Naut, Sanne Nauts et al.•Social Psychology•2014

  • Sex Differences in Distress From Infidelity in Early Adulthood and in Later Life

    Open Access•Hans I Jzerman, Hans Ijzerman et al.•Social Psychology•2014

  • A Replication Attempt of Stereotype Susceptibility

    Open Access•Carolyn E Gibson, Joy Losee et al.•Social Psychology•2014

  • What Does It Take to Activate Stereotypes? Simple Primes Don't Seem Enough

    Open Access•Florian Müller, Klaus Rothermund•Social Psychology•2014

  • A Secondary Replication Attempt of Stereotype Susceptibility

    Open Access•Alice Moon, Scott S Roeder•Social Psychology•2014

  • Revisiting the Romeo and Juliet Effect

    Open Access•H Colleen Sinclair, Kristina B Hood et al.•Social Psychology•2014

  • Does Cleanliness Influence Moral Judgments

    Open Access•David J Johnson, Freda Cheung et al.•Social Psychology•2014

  • Three Attempts to Replicate the Moral Licensing Effect

    Open Access•Irene Blanken, Niels Van De Ven et al.•Social Psychology•2014

  • Revisiting Schachter's Research on Rejection, Deviance, and Communication (1951)

    Open Access•Eric D Wesselmann, Kimberly D Williams et al.•Social Psychology•2014

  • Consequences of prejudice against the null hypothesis

    Anthony G Greenwald•Psychological Bulletin•1975

Unique citing works147
Citations per year12,25
Citation span2014 - 2026 (13)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 141

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae