Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences

Bibliographic Data

ID23324964
AuthorsStefan Schmidt (0000-0002-1804-0671, Department of Environmental Health Sciences, University Medical Center Freiburg, corresponding author)
Year2009
Volume13
Issue2
Pages90-100
Publication date2009-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueReview of General Psychology (JOURNAL)
Journal identifiersISSN: 1089-2680 • E-ISSN: 1939-1552
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1037/a0015108
OpenAlexW2021458971
LanguageEN
Citations received196
References cited30

Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different meanings to this concept and the relevant procedures, but hardly any systematic literature. This paper analyzes the concept of replication from a theoretical point of view. It demonstrates that the theoretical demands are scarcely met in everyday work within the social sciences. Some demands are just not feasible, whereas others are constricted by restrictions relating to publication. A new classification scheme based on a functional approach that distinguishes between different types of replication is proposed. Next, it will be argued that replication addresses the important connection between existing and new knowledge. To do so it has to be applied explicitly and systematically. The paper ends with a description of procedures how this could be done and a set of recommendations how to handle the concept of replication in the future to exploit its potential to the full.

Cognitive science · Computer security · Data science · Epistemology · Exploit · Point (geometry) · Replication (statistics) · Set (abstract data type) · Bayesian Modeling and Causal Inference · Computer Science · Mathematics · Mental Health Research Topics · Philosophy and History of Science · Psychology

  • Wie zuverlässig ist das Peer-Review-Verfahren? Eine Untersuchung der Interrater-Reliabilität von Gutachter*innen auf DGPuK-Tagungen

    Open Access•Thomas Koch, Stefan Geiß•Studies in Communication and Media•2019

  • Advancing the Cognitive Science of Religion through Replication and Open Science

    Suzanne Hoogeveen, Michiel Van Elk•Journal for the Cognitive Science…•2021

  • Psychologists’ psychologies of psychologists in a time of crisis

    Jill G Morawski•History of Psychology•2020

  • Job crafting among managers. The mediation role of autonomy at work

    Open Access•Mateusz Minda, Karolina Mudło‐Głagolska et al.•Polish Psychological Bulletin•2020

  • Assessing heterogeneity and power in replications of psychological experiments

    Open Access•Jacob Schauer, Larry V Hedges•Psychological Bulletin•2020

  • Crowdsourcing hypothesis tests

    Justin F Landy, Miaolei Jia et al.•Psychological Bulletin•2020

  • Help to perpetuate traditional gender roles

    Nurit Shnabel, Yoav Bar-Anan et al.•Journal of Personality and Social…•2016

  • Direct and conceptual replications of the taxometric analysis of type a behavior

    Michael P Wilmot, Nick Haslam et al.•Journal of Personality and Social…•2018

  • Falsifiability is not optional

    Etienne P Lebel, Derek Berger et al.•Journal of Personality and Social…•2017

  • Best research practices in psychology

    E J Finkel, Paul W Eastwick et al.•Journal of Personality and Social…•2015

  • Opportunistic biases

    Jamie Decoster, Erin Sparks et al.•American Psychologist•2015

  • Conformity and Competence Frustration

    Open Access•William T Burkitt•Psychological Reports•2025

  • Philosophy of Astrophysics

    Open Access•Nora Mills Boyd, Siska De Baerdemaeker et al.•Philosophy of Astrophysics•2023

  • Information Systems Foundations

    Dennis N Hart, Shirley Gregor•Information Systems Foundations•2012

  • Examination of real-time fluctuations in suicidal ideation and its risk factors

    Evan M Kleiman, Brianna J Turner et al.•Journal of Abnormal Psychology•2017

  • An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

    Open Access•Open Science Collaboration•Perspectives on Psychological…•2012

  • How School Leadership Influences Student Learning

    Open Access•Kenneth Leithwood, Jingping Sun et al.•Educational Administration…•2020

  • What causes health inequality? A systematic review on the relative importance of social causation and health selection

    Open Access•Hannes Kröger, Eduwin Pakpahan et al.•European Journal of Public Health•2015

  • Psychology's Renaissance

    L D Nelson, Joseph P Simmons et al.•Annual Review of Psychology•2018

  • Replication, falsification, and the crisis of confidence in social psychology

    Open Access•Brian D Earp, David Trafimow•Frontiers in Psychology•2015

  • The Alleged Crisis and the Illusion of Exact Replication

    Open Access•Wolfgang Stroebe, Fritz Strack•Perspectives on Psychological…•2014

  • Making replication mainstream

    Open Access•Rolf A Zwaan, Alexander Etz et al.•Behavioral and Brain Sciences•2018

  • What is replication?

    Open Access•Brian A Nosek, Timothy M Errington•PLOS Biology•2020

  • Replicability, Robustness, and Reproducibility in Psychological Science

    Brian A Nosek, Tom E Hardwicke et al.•Annual Review of Psychology•2022

  • Replications in Psychology Research

    Open Access•Matthew C Makel, Jonathan A Plucker et al.•Perspectives on Psychological…•2012

  • A Social Context Model of Envy and Social Undermining

    Michelle K Duffy, Kristin L Scott et al.•Academy of Management Journal•2012

  • The natural selection of bad science

    Open Access•P E Smaldino, Richard Mcelreath•Royal Society Open Science•2016

  • Scientific Utopia

    Open Access•Brian A Nosek, Jeffrey R Spies et al.•Perspectives on Psychological…•2012

  • Top 10 Replicated Findings From Behavioral Genetics

    Open Access•Robert Plomin, John C Defries et al.•Perspectives on Psychological…•2016

  • Negative results are disappearing from most disciplines and countries

    Open Access•Daniele Fanelli•Scientometrics•2012

  • A Large Scale Test of the Effect of Social Class on Prosocial Behavior

    Open Access•Martin Korndörfer, Boris Egloff et al.•PLoS ONE•2015

  • Estimating the reproducibility of psychological science

    Open Access•Open Science Collaboration•Science•2015

  • Stereotype Threat Reduces the Positivity of Older Adults’ Recall

    Open Access•Sarah J Barber, Jordan Seliger et al.•The Journals of Gerontology…•2018

  • The Effects of Invoking Stereotype Excuses on Perceivers’ Character Trait Inferences and Performance Attributions

    Jade S Jenkins, John J Skowronski•Social Psychology•2016

  • Replication and the Manufacture of Scientific Inferences

    Fernando Martel Garcia•International Studies Perspectives•2016

  • Massacre, Earthquake, Flood

    Julia J Rucklidge, M Usman Afzali et al.•International Perspectives in…•2021

  • Investigating Variation in Replicability

    Open Access•Richard A Klein, Kate A Ratliff et al.•Social Psychology•2014

  • Subjective Outcome Evaluation of a Positive Youth Development Program in Mainland China

    Open Access•D T L Shek, Yiting Tang et al.•International Journal of…•2025

  • Dimensionality of the Chinese CES-D

    Open Access•Diya Dou, D T L Shek et al.•International Journal of…•2021

  • On the failure to replicate past findings regarding positive affirmations and self-esteem

    Open Access•Maureen Flynn, Maureen K Flynn et al.•Journal of Contextual Behavioral…•2020

  • A Neglected Topic in Neuroscience

    Open Access•Isabelle Horster, Kathrin Nickel et al.•Frontiers in Psychiatry•2020

  • Values matter in approach behaviors

    Open Access•Maureen Flynn, Maureen K Flynn et al.•Journal of Contextual Behavioral…•2021

  • Subjective Outcome Evaluation of Instructional Videos in Leadership Education

    Open Access•Xiang Li, D T L Shek et al.•International Journal of…•2022

  • Framing Unauthorized Immigrants

    Open Access•Reidar Ommundsen, Knud S Larsen et al.•Psychological Reports•2014

  • After a pair of self-control-intensive tasks, sucrose swishing improves subsequent working memory performance

    Open Access•Evan C Carter, Michael E Mccullough•BMC Psychology•2013

  • The Evaluation of Harm and Purity Transgressions in Africans

    Open Access•Adeyemi Adetula, Patrick S Forscher et al.•Advances in Methods and Practices…•2026

  • Promoting critical thinking in Vietnamese EFL classrooms

    Open Access•Phuong Bao Tran Nguyen, Thi Thanh Long Nguyen•Thinking Skills and Creativity•2026

  • Socioeconomic inequalities in inflammation in childhood and adolescence

    Open Access•Kavindi Gamage, Susanna Pätsi et al.•Social Science & Medicine•2026

  • The Complexity of Comparative Judgments in Assessing Argumentative Writing

    Open Access•Marijn Gijsen, Tine Van Daal et al.•Frontiers in Education•2021

  • The scientific impotence excuse in education – Disentangling potency and pertinence assessments of educational research

    Open Access•Holger Futterleib, Eva Thomm et al.•Frontiers in Education•2022

  • PROTEUS - promoting success in university

    Open Access•Joana Carneiro Pinto, Susana Costa-Ramalho et al.•Frontiers in Education•2025

  • O Status Científico Da Constelação Familiar

    Open Access•Gustavo Fretta, Sara da Silva Böger et al.•Psicologia e Saúde em Debate•2025

  • Shifting Republican views on climate change through targeted advertising

    Open Access•Matthew H Goldberg, Abel Gustafson et al.•Nature Climate Change•2021

  • Plant Cognition—A Methodological Primer

    Open Access•Miguel Segundo-Ortin, Miguel Segundo‐Ortin et al.•Philosophy Compass•2025

  • Saving Science Through Replication Studies

    Open Access•John E Edlund, Kelly Cuccolo et al.•Perspectives on Psychological…•2022

  • The Role of Replication Studies in Theory Building

    Open Access•Elizabeth E Irvine•Perspectives on Psychological…•2021

  • Heterogeneity of Research Results

    Open Access•Audrey Helen Linden, Alexandre Passant et al.•Perspectives on Psychological…•2021

  • Weak theories and robustness

    Open Access•Adam J R Tallman•Linguistic Typology•2025

  • Replication and methodological robustness in quantitative typology

    Open Access•Laura Becker, Matías Guzmán Naranjo•Linguistic Typology•2025

  • Kinds of Replicability

    Open Access•Vera Matarese•Axiomathes•2022

  • How do psychology researchers interpret the results of multiple replication studies

    Open Access•Olmo R Van Den Akker, Jelte M Wicherts et al.•Psychonomic Bulletin & Review•2023

  • Automatic imitation of speech is enhanced for non-native sounds

    Open Access•Hannah Wilt, Yuchunzi Wu et al.•Psychonomic Bulletin & Review•2024

  • Machine teachers and human-AI collaboration

    Jihyun Kim, Patric R Spence et al.•Interactive Learning Environments•2026

  • Chief executive officers' appearance predicts company performance, or does it? A replication study and extension focusing on CEO successions

    Open Access•Christian Hopp, Daniel Wentzel et al.•The Leadership Quarterly•2023

  • A conceptual replication of ambidextrous leadership theory

    Open Access•Florian E Klonek, Fabiola H Gerpott et al.•The Leadership Quarterly•2023

  • Is there such a thing as leadership skill? – A replication and extension of the relationship between high school leadership positions and later-life earnings

    Open Access•Christian Hopp, Gernot Pruschak•The Leadership Quarterly•2023

  • The romance of leadership

    Open Access•Michelle Hammond, Michelle M Hammond et al.•The Leadership Quarterly•2023

  • The science of leadership

    Open Access•Dov Eden•The Leadership Quarterly•2021

  • Collaborative research and use of Q methodology to understand technology infusion in teacher preparation

    Open Access•Jon Clausen, Arlene C Borthwick et al.•Educational Technology Research…•2021

  • Open science practices in the false memory literature

    Open Access•Sera Wiechert, Phaedra Leistra et al.•Memory•2024

  • Do We Have a Trust Problem? Exploring Undergraduate Student Views on the Tentativeness and Trustworthiness of Science

    Open Access•William W Cobern, Betty AJ Adams et al.•Science & Education•2022

  • Scientific Truth in a Post-Truth Era

    Open Access•Cornel Hagiopol, Polliana M Leru•Science & Education•2025

  • Why We Disagree About the Success of Replications

    Open Access•Johanna Sarisoy•Journal for General Philosophy of…•2025

  • Conducting replication in translation and interpreting studies

    Open Access•Chao Han, Yueqing Wang•Target International Journal of…•2025

  • Why do employees choose defensive silence

    Lauren Millender, Lauren G Millender et al.•Communication Research Reports•2023

  • Journal Editor and Associate Editor Perspectives on Research Reproducibility and Open Science

    Open Access•Daniel M Maggin•Remedial and Special Education•2022

  • Princip závazku a konzistence chování

    Open Access•Alexandra Menting•AUC PHILOSOPHICA ET HISTORICA•2025

  • Ignorance isn’t bliss

    Carla M Strickland-Hughes, Megan Carmichael et al.•Educational Gerontology•2025

  • Comparing early-stage L2 processing of derived and inflected words

    Open Access•Zhaohong Wu, Melinda Fricke•Studies in Second Language…•2025

  • Are Replication Studies Infrequent Because of Negative Attitudes

    Open Access•Kristy Mcmanus•Studies in Second Language…•2022

  • Replication studies in second language acquisition research

    Open Access•Kristy Mcmanus•Studies in Second Language…•2024

  • An Experimental Field Study on the Effects of Coaching

    Open Access•Andrea Fontes, Silvia Dello Russo•Applied Psychology•2021

  • Relational Processes as Predictors of Relationship Satisfaction Trajectories Across the Transition to Parenthood

    Open Access•Hagar Ter Kuile, Tanja Van Der Lippe et al.•Family Relations•2021

  • Explicating Exact versus Conceptual Replication

    Open Access•Robert Hudson•Erkenntnis•2023

  • Support for Social Change Among Members of Advantaged Groups

    Open Access•Lisa Katharina Frisch, Simone Sebben et al.•Personality and Social Psychology…•2023

  • Changing Police Officers’ Attitudes in Sexual Offense Cases

    Open Access•Patrick Tidmarsh, Gemma Hamilton et al.•Criminal Justice and Behavior•2020

  • When the Stakes are Low

    Open Access•Robert Madrigal, Colleen Bee et al.•Communication Research•2023

  • Which Visuals Really Matter? Effects of (Counter) Stereotypical Visual Information on Candidate Evaluations

    Open Access•Jennifer Bast, Corinna Oschatz•Communication Research•2025

  • Reproducible Analyses in Education Research

    Open Access•Brandon Lebeau, Scott Ellison et al.•Review of Research in Education•2021

  • Replication studies in international business

    Open Access•Luis Alfonso Dau, Grazia D Santangelo et al.•Journal of International Business…•2022

  • Replication Studies in Tesol

    Open Access•Kristy Mcmanus•TESOL Quarterly•2026

  • Towards more credible conceptual replications under heteroscedasticity and unbalanced designs

    Open Access•Pedro Mateu, Brooks Applegate et al.•Quality & Quantity•2024

  • The influence of gratitude on depressive symptoms among Chinese college students during the Covid‐19 pandemic

    Open Access•Yun Luo, Yuting Deng et al.•Psychology in the Schools•2023

  • Using a naive Bayesian approach to identify academic risk based on multiple sources

    Open Access•Carly Oddleifson, Stephen Kilgus et al.•Journal of School Psychology•2025

  • The effect of a student–teacher–scientist partnership program on high school students' science achievement and attitudes about scientists

    Open Access•Joseph A Taylor, Catrina T Adams et al.•Journal of Research in Science…•2022

  • Investigating students’ perceived authenticity of learning activities in an out-of-school lab for social sciences

    Open Access•Valentina Nachtigall, Nikol Rummel•Instructional Science•2021

  • Teaching on video as an instructional strategy to reduce confirmation bias—a pre-registered study

    Open Access•Suzan van Brussel, Miranda Timmermans et al.•Instructional Science•2021

  • A new concept of replication

    Vera Matarese•Inquiry•2023

  • A Framework for Moving Beyond Computational Reproducibility

    Open Access•Peter Kedron, Sarah Bardin et al.•Geographical Analysis•2024

  • A Replication Agenda for Composition Studies

    John Raucci•College Composition and…•2021

  • Design and analysis

    Geoffrey Keppel•Design and analysis•1982

  • A dictionary of the social sciences

    Julius Gould•A dictionary of the social sciences•1964

  • Dictionary of the Social Sciences

    Craig J Calhoun•Dictionary of the social sciences•2002

  • Harking

    Open Access•Norbert L Kerr•Personality and Social Psychology…•1998

  • Open exchange and epistemic progress

    Michael J Mahoney•American Psychologist•1985

  • The ability to detect unseen staring

    Open Access•John Colwell, Sadi Schröder et al.•British Journal of Psychology•2000

  • Do We Really Need More Replications

    Open Access•Karl Hunt•Psychological Reports•1975

  • The logic of generalization

    Open Access•William R Shadish•American Journal of Community…•1995

  • ESP and Psychokinesis

    Ronald N Giere, Stephen E Braude•The Philosophical Review•1982

  • Patterns of evaluation in science

    Open Access•Harriet Zuckerman, Robert Κ Merton et al.•Minerva•1971

  • That's Interesting

    Open Access•Murray S Davis•Philosophy of the Social Sciences•1971

  • Publication Manual of the American Psychological Association

    Open Access•Rui Yao•Family and Consumer Sciences…•2011

  • Can animals detect when their owners are returning home? An experimental test of the 'psychic pet' phenomenon

    Open Access•Richard Wiseman, Matthew Smith et al.•British Journal of Psychology•1998

  • Convergent and discriminant validation by the multitrait-multimethod matrix

    Donald T Campbell, Donald W Fiske•Psychological Bulletin•1959

  • Statistical significance in psychological research

    David T Lykken•Psychological Bulletin•1968

  • Does psi exist? Replicable evidence for an anomalous process of information transfer

    Daryl J Bem, Charles Honorton•Psychological Bulletin•1994

  • Consequences of prejudice against the null hypothesis

    Anthony G Greenwald•Psychological Bulletin•1975

  • In and about the World

    Edward W Constant, Edward W Constant Ii et al.•Technology and Culture•1998

  • Leviathan and the Air-Pump

    Steven Shapin, Simon Schaffer•Leviathan and the Air-Pump•2011

Unique citing works196
Citations per year14
Citation span2012 - 2026 (15)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 185

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae