Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Best research practices in psychology

Illustrating epistemological and pragmatic considerations with the case of relationship science

Bibliographic Data

ID6203322
AuthorsE J Finkel (0000-0002-0213-5318, Northwestern University), Paul W Eastwick (0000-0001-8512-8721, The University of Texas at Austin), H T Reis (0000-0002-3542-6074, University of Rochester)
Year2015
Volume108
Issue2
Pages275-297
Publication date2015-02-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueJournal of Personality and Social Psychology (JOURNAL)
Journal identifiersISSN: 0022-3514 • E-ISSN: 1939-1315
PublisherAmerican Psychological Association (APA) (PUBLISHER)
DOI10.1037/pspi0000007
PMID25603376
OpenAlexW2129175722
LanguageEN
Citations received69
References cited67

In recent years, a robust movement has emerged within psychology to increase the evidentiary value of our science. This movement, which has analogs throughout the empirical sciences, is broad and diverse, but its primary emphasis has been on the reduction of statistical false positives. The present article addresses epistemological and pragmatic issues that we, as a field, must consider as we seek to maximize the scientific value of this movement. Regarding epistemology, this article contrasts the false-positives-reduction (FPR) approach with an alternative, the error balance (EB) approach, which argues that any serious consideration of optimal scientific practice must contend simultaneously with both false-positive and false-negative errors. Regarding pragmatics, the movement has devoted a great deal of attention to issues that frequently arise in laboratory experiments and one-shot survey studies, but it has devoted less attention to issues that frequently arise in intensive and/or longitudinal studies. We illustrate these epistemological and pragmatic considerations with the case of relationship science, one of the many research domains that frequently employ intensive and/or longitudinal methods. Specifically, we examine 6 research prescriptions that can help to reduce false-positive rates: preregistration, prepublication sharing of materials, postpublication sharing of data, close replication, avoiding piecemeal publication, and increasing sample size. For each, we offer concrete guidance not only regarding how researchers can improve their research practices and balance the risk of false-positive and false-negative errors, but also how the movement can capitalize upon insights from research practices within relationship science to make the movement stronger and more inclusive

Cognitive psychology · Epistemology · False positive paradox · False positives and false negatives · Political science · Relevance (law) · Scientific progress · Value (mathematics) · Artificial Intelligence · Behavioral Health and Interventions · Computer Science · Law · Mental Health Research Topics · Meta-analysis and systematic reviews · Psychology · Social Psychology

  • Mixed and conflicted

    Giulia Zoppolat, Ruddy Faure et al.•Emotion•2022

  • Feelings in words

    Tabea Meier, Jacquelyn Stephens et al.•Emotion•2023

  • Crowdsourcing hypothesis tests

    Justin F Landy, Miaolei Jia et al.•Psychological Bulletin•2020

  • Perceived crisis and reforms

    Paul De Boeck, Moongee Jeon et al.•Psychological Bulletin•2018

  • Solidarity through shared disadvantage

    Clarissa I Cortland, Clarissa Cortland et al.•Journal of Personality and Social…•2017

  • Falsifiability is not optional

    Etienne P Lebel, Derek Berger et al.•Journal of Personality and Social…•2017

  • Acquiring group bias

    Allison L Skinner, Kristina R Olson et al.•Journal of Personality and Social…•2020

  • Benefits of open and high-powered research outweigh costs

    Etienne P Lebel, L Campbell et al.•Journal of Personality and Social…•2017

  • Family environment and self-esteem development

    Open Access•Samantha Krau, Uli Orth et al.•Journal of Personality and Social…•2020

  • Replicability and other features of a high-quality science

    E J Finkel, Paul W Eastwick et al.•Journal of Personality and Social…•2017

  • The Production of Knowledge

    Open Access•Colin Elman, John Gerring et al.•Production of Knowledge•2020

  • Examination of real-time fluctuations in suicidal ideation and its risk factors

    Evan M Kleiman, Brianna J Turner et al.•Journal of Abnormal Psychology•2017

  • Power Analysis for Parameter Estimation in Structural Equation Modeling

    Open Access•Y Andre Wang, Mijke Rhemtulla•Advances in Methods and Practices…•2021

  • Psychology, Science, and Knowledge Construction

    Patrick E Shrout, Joseph L Rodgers•Annual Review of Psychology•2018

  • Making replication mainstream

    Open Access•Rolf A Zwaan, Alexander Etz et al.•Behavioral and Brain Sciences•2018

  • A Trauma-Informed Approach to Sexual Violence Research Ethics and Open Science

    Open Access•Rebecca Campbell, Rachael Goodman‐william et al.•Journal of Interpersonal Violence•2019

  • Power to Detect What? Considerations for Planning and Evaluating Sample Size

    Open Access•Roger Giner-Sorolla, Roger Giner‐sorolla et al.•Personality and Social Psychology…•2024

  • Exploratory Research

    Open Access•Richard Swedberg•Production of Knowledge•2020

  • Replication initiatives will not salvage the trustworthiness of psychology

    Open Access•James C Coyne•BMC Psychology•2016

  • Open science practices in the false memory literature

    Open Access•Sera Wiechert, Phaedra Leistra et al.•Memory•2024

  • Social media observation of ex-partners is associated with greater breakup distress, negative affect, and jealousy

    Open Access•Tara C Marshall•Computers in Human Behavior•2026

  • Is Touch in Romantic Relationships Universally Beneficial for Psychological Well-Being? The Role of Attachment Avoidance

    Open Access•Anik Debrot, Jennifer E Stellar et al.•Personality and Social Psychology…•2021

  • Gray (Literature) Matters

    Open Access•Athena H Cairo, Jeffrey Green et al.•Personality and Social Psychology…•2020

  • Just Not That Into You

    Open Access•Mirna Đurić, Francesca Righetti et al.•Personality and Social Psychology…•2026

  • Does Sex Today Relieve Stress Tomorrow? Examining Lagged Associations Between Partnered Sexual Activity and Stress Among Newlywed Couples

    Open Access•Sierra D Peters, Devon S Glicken et al.•Archives of Sexual Behavior•2026

  • A Systematic Study of Ambivalence and Well-Being in Romantic Relationships

    Open Access•Giulia Zoppolat, Francesca Righetti et al.•Social Psychological and…•2024

  • On Feeling Warm and Being Warm

    Open Access•Adam K Fetterman, Benjamin M Wilkowski et al.•Social Psychological and…•2018

  • Do Easterners and Westerners Differ in Visual Cognition? A Preregistered Examination of Three Visual Cognition Tasks

    Open Access•Nicole Hakim, Daniel J Simons et al.•Social Psychological and…•2017

  • Sexual Afterglow

    Open Access•Olivia W Breedin, Andrea L Meltzer et al.•Social Psychological and…•2025

  • When and for Whom Implicit Partner Evaluations Predict Forgiveness

    Open Access•Ruddy Faure, Francesca Righetti et al.•Social Psychological and…•2021

  • Implicit Ambivalence

    Open Access•Ruddy Faure, James K Mcnulty et al.•Social Psychological and…•2022

  • Does Public Knowledge of Climate Change Really Matter in Australia

    B Tranter•Environmental Communication•2020

  • Understanding Sexual Assault Survivors’ Perspectives on Archiving Qualitative Data

    Open Access•Rebecca Campbell, Rachael Goodman‐william et al.•Psychology of Women Quarterly•2022

  • Putting Popper to work

    Open Access•Maarten Derksen•Theory & Psychology•2019

  • Influence of Agreeableness on Responsiveness

    Open Access•Jenna L Kilian, J Gere et al.•Journal of Personality•2025

  • Relationship science and the credibility revolution

    Open Access•W J Chopik, Christopher R Chartier et al.•Personal Relationships•2020

  • Reflections on a registered report replicating a body of dyadic cross‐sectional research

    Open Access•Zachary G Baker, Ersie‐anastasia Gentzis et al.•Personal Relationships•2020

  • Do people know how they impact their Partner’s goal pursuit? Accuracy, bias, and associations with relationship outcomes

    Open Access•Emily Connard, Emily R Connard et al.•Journal of Social and Personal…•2026

  • Hard-working in general but lazy at home? Generalized Big Five traits and relationship-specific traits in romantic couples over time

    Open Access•Janina Larissa Bühler, Cornelia Wrzus et al.•Journal of Research in Personality•2021

  • Perceptions of daily sacrifice motives

    Open Access•Jessica E Labuda, J Gere•Journal of Research in Personality•2021

  • Relationship quality and accuracy of detecting a romantic partner's fear of being single

    Open Access•Stephanie S Spielmann, J Gere et al.•Journal of Research in Personality•2020

  • Who is having more and better sex? The Big Five as predictors of sex in marriage

    Open Access•Andrea L Meltzer, James K Mcnulty•Journal of Research in Personality•2016

  • A dyadic personality perspective on the Michelangelo phenomenon

    Open Access•Janina Larissa Bühler, Catrin Finkenauer et al.•Journal of Research in Personality•2020

  • The benefits of studying immigration for social psychology

    Open Access•M Verkuyten•European Journal of Social…•2018

  • When one's partner wants out

    Open Access•Kenneth Tan, Laura V Machia et al.•European Journal of Social…•2023

  • Grolar bears, social class, and policy relevance

    Open Access•Susan T Fiske•European Journal of Social…•2015

  • The Intergroup Time Bias and Its Implications for Medical Healthcare

    Open Access•Emerson Do Bú, Renata Pimentel Da Silva et al.•Journal of Social Issues•2025

  • Effects of living arrangements on well‐being, perceived conflict, and intergroup attitudes for local and international students

    Open Access•Ya Hui Michelle See, Walter Patrick Wade•Journal of Social Issues•2022

  • Addressing replicability concerns via adversarial collaboration

    Open Access•Norbert L Kerr, Xiang Ao et al.•Journal of Experimental Social…•2018

  • The empirical benefits of conceptual rigor

    Open Access•Mark Schaller•Journal of Experimental Social…•2015

  • Into the wild

    Open Access•Jon K Maner•Journal of Experimental Social…•2016

  • Introduction to the Special Issue on Methodological Rigor and Replicability

    Open Access•Charles Stangor, Edward P Lemay•Journal of Experimental Social…•2016

  • Attachment avoidance and amends-making

    Open Access•Sarah C E Stanton, L Campbell•Journal of Experimental Social…•2016

  • Competitive reputation manipulation

    Open Access•Tania Reynolds, Roy F Baumeister et al.•Journal of Experimental Social…•2018

  • Promise, peril, and perspective

    Open Access•H T Reis, Karisa Y Lee•Journal of Experimental Social…•2016

  • Kiss and Makeup? Examining the Co-occurrence of Conflict and Sex

    Open Access•Jessica A Maxwell, Andrea L Meltzer•Archives of Sexual Behavior•2020

  • Newlywed Couples’ Own and Partner Sexual Disgust Sensitivities Interact to Predict Their Marital Satisfaction Through Their Sexual Satisfaction

    Open Access•Sierra D Peters, Andrea L Meltzer•Archives of Sexual Behavior•2021

  • A Credibility Revolution for Relationship Science

    Open Access•Samantha Joel, Paul W Eastwick et al.•Social and Personality Psychology…•2025

  • The synergistic effect of prosociality and physical attractiveness on mate desirability

    Open Access•Daniel Ehlebracht, Olga Stavrova et al.•British Journal of Psychology•2018

  • On the Interpersonal Function of Metaphor Use

    Adam K Fetterman, Nicholas D Evans et al.•Social Psychology•2021

  • The role of metaphor in communication and thought

    Open Access•Paul H Thibodeau, Teenie Matlock et al.•Language and Linguistics Compass•2019

  • Relationship difficulties and "technoference" during the Covid-19 pandemic

    Open Access•Giulia Zoppolat, Francesca Righetti et al.•Journal of Social and Personal…•2022

  • Associations between language style matching and relationship commitment and satisfaction

    Open Access•Sabrina J Bierstetel, Allison K Farrell et al.•Journal of Social and Personal…•2020

  • Power struggles

    Open Access•Sean P Lane, Erin P Hennes•Journal of Social and Personal…•2018

  • Who is sexually faithful? Own and partner personality traits as predictors of infidelity

    Open Access•Emma E Altgelt, Mariana Almaraz Reyes et al.•Journal of Social and Personal…•2018

  • Approach and avoidance motives for touch are predicted by attachment and predict daily relationship well-being

    Open Access•Brett K Jakubiak, Anik Debrot et al.•Journal of Social and Personal…•2021

  • The Emergence of Statistical Objectivity

    Open Access•Jeremy Freese, David Peterson•Sociological Theory•2018

  • Cultural Genomics

    Open Access•C Chen, Robert K Moyzis•Journal of Cross-Cultural…•2018

  • Replication in Social Science

    Jeremy Freese, David Peterson•Annual Review of Sociology•2017

  • Design and analysis

    Geoffrey Keppel•Design and analysis•1982

  • Psychological Factors in Marital Happiness

    Lewis Madison Terman•Psychological Factors in Marital…

  • The Rules of the Game Called Psychological Science

    Open Access•Marjan Bakker, Annette van Dijk et al.•Perspectives on Psychological…•2012

  • An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

    Open Access•Open Science Collaboration•Perspectives on Psychological…•2012

  • Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling

    Open Access•Leslie K John, G Loewenstein et al.•Psychological Science•2012

  • Why Most Discovered True Associations Are Inflated

    John P A Ioannidis•Epidemiology•2008

  • Psychological Science Can Improve Diagnostic Decisions

    Open Access•John A Swets, Robyn M Dawes et al.•Psychological Science in the…•2000

  • Promoting Transparency in Social Science Research

    Open Access•Edward Miguel, Colin F Camerer et al.•Science•2014

  • Publication Bias in Psychology

    Open Access•Anton Kühberger, Astrid Fritz et al.•PLoS ONE•2014

  • The Value of Direct Replication

    Open Access•Daniel J Simons•Perspectives on Psychological…•2014

  • The ironic effect of significant results on the credibility of multiple-study articles.

    Ulrich Schimmack•Psychological Methods•2012

  • The Alleged Crisis and the Illusion of Exact Replication

    Open Access•Wolfgang Stroebe, Fritz Strack•Perspectives on Psychological…•2014

  • Estimating Statistical Power and Required Sample Sizes for Organizational Research Using Multilevel Modeling

    Open Access•Charles A Scherbaum, Jennifer M Ferreter et al.•Organizational Research Methods•2009

  • P-curve

    Uri Simonsohn, L D Nelson et al.•Journal of Experimental…•2014

  • Washing Away Your Sins

    Open Access•Chen-Bo Zhong, Chen‐Bo Zhong et al.•Science•2006

  • A Vast Graveyard of Undead Theories

    Open Access•Christopher J Ferguson, Moritz Heene•Perspectives on Psychological…•2012

  • An Agenda for Purely Confirmatory Research

    Open Access•Eric-Jan Wagenmakers, Ruud Wetzels et al.•Perspectives on Psychological…•2012

  • Recommendations for Increasing Replicability in Psychology

    Open Access•Jens B Asendorpf, Mycah Conner et al.•European Journal of Personality•2013

  • A decision-making theory of visual detection.

    Wilson P Tanner, John A Swets•Psychological Review•1954

  • The N-Pact Factor

    Open Access•R Chris Fraley, Simine Vazire et al.•PLoS ONE•2014

  • Power failure

    Open Access•Katherine S Button, John P A Ioannidis et al.•Nature Reviews Neuroscience•2013

  • Reshaping Institutions

    Katherine Casey, Rachel Glennerster et al.•The Quarterly Journal of Economics•2012

  • Is the Replicability Crisis Overblown? Three Arguments Examined

    Open Access•Harold Pashler, Christine R Harris•Perspectives on Psychological…•2012

  • Improving the Dependability of Research in Personality and Social Psychology

    Open Access•David C Funder, Joseph M Levine et al.•Personality and Social Psychology…•2014

  • Scientific Utopia

    Open Access•Brian A Nosek, Jeffrey R Spies et al.•Perspectives on Psychological…•2012

  • Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences

    Open Access•Stefan Schmidt•Review of General Psychology•2009

  • The Measurement of Perceived Relationship Quality Components

    Open Access•Garth J O Fletcher, Jeffry A Simpson et al.•Personality and Social Psychology…•2000

  • Negative results are disappearing from most disciplines and countries

    Open Access•Daniele Fanelli•Scientometrics•2012

  • False-Positive Psychology

    Open Access•Joseph P Simmons, L D Nelson et al.•Psychological Science•2011

  • The Logic of Scientific Discovery

    Karl R Popper, Karl Popper et al.•Physics Today•1959

  • “But the data is already public”

    Open Access•Michael Zimmer•Ethics and Information Technology•2010

  • Harking

    Open Access•Norbert L Kerr•Personality and Social Psychology…•1998

  • Perceived, not actual, similarity predicts initial attraction in a live romantic context

    Open Access•Natasha D Tidwell, Natasha Tidwell et al.•Personal Relationships•2013

  • The statistical power of abnormal-social psychological research

    Jacob Cohen•Journal of Abnormal & Social…•1962

  • The predictive validity of ideal partner preferences

    Paul W Eastwick, Laura B Luchies et al.•Psychological Bulletin•2014

  • At what sample size do correlations stabilize

    Open Access•Felix Schönbrodt, Felix D Schönbrodt et al.•Journal of Research in Personality•2013

  • Dissonance and self-perception

    Open Access•Russell H Fazio, Mark P Zanna et al.•Journal of Experimental Social…•1977

  • The Replication Recipe

    Open Access•Mark J Brandt, Hans I Jzerman et al.•Journal of Experimental Social…•2013

  • Statistical procedures and the justification of knowledge in psychological science

    Ralph L Rosnow, Robert Rosenthal•American Psychologist•1989

  • The poor availability of psychological research data for reanalysis

    Jelte M Wicherts, Denny Borsboom et al.•American Psychologist•2006

  • The two disciplines of scientific psychology

    Lee J Cronbach•American Psychologist•1957

  • Beyond pleasure and pain

    E Tory Higgins•American Psychologist•1997

  • The greening of relationship science

    Ellen Berscheid•American Psychologist•1999

  • How are we doing in soft psychology

    Robert Rosenthal•American Psychologist•1990

  • Antifragile

    Open Access•John P A Ioannidis, Nassim Nicholas Taleb et al.•Antifragile•2012

  • Fishing, Commitment, and Communication

    Open Access•Michael Humphreys, Macartan Humphreys et al.•Political Analysis•2013

  • Using I3 theory to clarify when dispositional aggressiveness predicts intimate partner violence perpetration

    E J Finkel, C Nathan Dewall et al.•Journal of Personality and Social…•2012

  • Attachment, Caregiving, and Altruism

    Mario Mikulincer, P R Shaver et al.•Journal of Personality and Social…•2005

  • Is a meta-analysis a foundation, or just another brick? Comment on Meltzer, McNulty, Jackson, and Karney (2014)

    Paul W Eastwick, Lisa A Neff et al.•Journal of Personality and Social…•2014

  • Feeling the future

    Daryl J Bem•Journal of Personality and Social…•2011

  • Attachment and the experience and expression of emotions in romantic relationships

    Jeffry A Simpson, W Andrew Collins et al.•Journal of Personality and Social…•2007

  • So far away from one's partner, yet so close to romantic alternatives

    C Nathan Dewall, Nathaniel M Lambert et al.•Journal of Personality and Social…•2011

  • Correcting the past

    Jeff Galak, Robyn A Leboeuf et al.•Journal of Personality and Social…•2012

  • Optimistic expectations in early marriage

    Lisa A Neff, Andrew L Geers•Journal of Personality and Social…•2013

  • Publication Manual of the American Psychological Association

    Open Access•Rui Yao•Family and Consumer Sciences…•2011

  • Science Deserves Better

    Open Access•Allan Dafoe•PS Political Science & Politics•2014

  • Self-reports

    Norbert Schwarz•American Psychologist•1999

  • The Family as a Unity of Interacting Personalities

    Open Access•Ernest W Burge, Ernest W Burgess•The Family•1926

  • Registered Reports

    Open Access•Brian A Nosek, Daniël Lakens•Social Psychology•2014

  • Convergent and discriminant validation by the multitrait-multimethod matrix

    Donald T Campbell, Donald W Fiske•Psychological Bulletin•1959

  • Statistical significance in psychological research

    David T Lykken•Psychological Bulletin•1968

  • The relationship context of human behavior and development

    H T Reis, W Andrew Collins et al.•Psychological Bulletin•2000

  • A power primer

    Jacob Cohen•Psychological Bulletin•1992

  • Do studies of statistical power have an effect on the power of studies

    Peter Sedlmeier, Gerd Gigerenzer•Psychological Bulletin•1989

  • Consequences of prejudice against the null hypothesis

    Anthony G Greenwald•Psychological Bulletin•1975

  • The file drawer problem and tolerance for null results

    Robert Rosenthal•Psychological Bulletin•1979

Unique citing works69
Citations per year6,27
Citation span2015 - 2026 (12)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 59

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae