Best research practices in psychology
Illustrating epistemological and pragmatic considerations with the case of relationship science
Bibliographic Data
| ID | 6203322 |
|---|---|
| Authors | E J Finkel (0000-0002-0213-5318, Northwestern University), Paul W Eastwick (0000-0001-8512-8721, The University of Texas at Austin), H T Reis (0000-0002-3542-6074, University of Rochester) |
| Year | 2015 |
| Volume | 108 |
| Issue | 2 |
| Pages | 275-297 |
| Publication date | 2015-02-01 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Journal of Personality and Social Psychology (JOURNAL) |
| Journal identifiers | ISSN: 0022-3514 • E-ISSN: 1939-1315 |
| Publisher | American Psychological Association (APA) (PUBLISHER) |
| DOI | 10.1037/pspi0000007 |
| PMID | 25603376 |
| OpenAlex | W2129175722 |
| Language | EN |
| Citations received | 69 |
| References cited | 67 |
In recent years, a robust movement has emerged within psychology to increase the evidentiary value of our science. This movement, which has analogs throughout the empirical sciences, is broad and diverse, but its primary emphasis has been on the reduction of statistical false positives. The present article addresses epistemological and pragmatic issues that we, as a field, must consider as we seek to maximize the scientific value of this movement. Regarding epistemology, this article contrasts the false-positives-reduction (FPR) approach with an alternative, the error balance (EB) approach, which argues that any serious consideration of optimal scientific practice must contend simultaneously with both false-positive and false-negative errors. Regarding pragmatics, the movement has devoted a great deal of attention to issues that frequently arise in laboratory experiments and one-shot survey studies, but it has devoted less attention to issues that frequently arise in intensive and/or longitudinal studies. We illustrate these epistemological and pragmatic considerations with the case of relationship science, one of the many research domains that frequently employ intensive and/or longitudinal methods. Specifically, we examine 6 research prescriptions that can help to reduce false-positive rates: preregistration, prepublication sharing of materials, postpublication sharing of data, close replication, avoiding piecemeal publication, and increasing sample size. For each, we offer concrete guidance not only regarding how researchers can improve their research practices and balance the risk of false-positive and false-negative errors, but also how the movement can capitalize upon insights from research practices within relationship science to make the movement stronger and more inclusive
Cognitive psychology · Epistemology · False positive paradox · False positives and false negatives · Political science · Relevance (law) · Scientific progress · Value (mathematics) · Artificial Intelligence · Behavioral Health and Interventions · Computer Science · Law · Mental Health Research Topics · Meta-analysis and systematic reviews · Psychology · Social Psychology
Mixed and conflicted
Feelings in words
Crowdsourcing hypothesis tests
Perceived crisis and reforms
Solidarity through shared disadvantage
Falsifiability is not optional
Acquiring group bias
Benefits of open and high-powered research outweigh costs
Family environment and self-esteem development
Replicability and other features of a high-quality science
The Production of Knowledge
Examination of real-time fluctuations in suicidal ideation and its risk factors
Power Analysis for Parameter Estimation in Structural Equation Modeling
Psychology, Science, and Knowledge Construction
Making replication mainstream
A Trauma-Informed Approach to Sexual Violence Research Ethics and Open Science
Power to Detect What? Considerations for Planning and Evaluating Sample Size
Exploratory Research
Replication initiatives will not salvage the trustworthiness of psychology
Open science practices in the false memory literature
Social media observation of ex-partners is associated with greater breakup distress, negative affect, and jealousy
Is Touch in Romantic Relationships Universally Beneficial for Psychological Well-Being? The Role of Attachment Avoidance
Gray (Literature) Matters
Just Not That Into You
Does Sex Today Relieve Stress Tomorrow? Examining Lagged Associations Between Partnered Sexual Activity and Stress Among Newlywed Couples
A Systematic Study of Ambivalence and Well-Being in Romantic Relationships
On Feeling Warm and Being Warm
Do Easterners and Westerners Differ in Visual Cognition? A Preregistered Examination of Three Visual Cognition Tasks
Sexual Afterglow
When and for Whom Implicit Partner Evaluations Predict Forgiveness
Implicit Ambivalence
Does Public Knowledge of Climate Change Really Matter in Australia
Understanding Sexual Assault Survivors’ Perspectives on Archiving Qualitative Data
Putting Popper to work
Influence of Agreeableness on Responsiveness
Relationship science and the credibility revolution
Reflections on a registered report replicating a body of dyadic cross‐sectional research
Do people know how they impact their Partner’s goal pursuit? Accuracy, bias, and associations with relationship outcomes
Hard-working in general but lazy at home? Generalized Big Five traits and relationship-specific traits in romantic couples over time
Perceptions of daily sacrifice motives
Relationship quality and accuracy of detecting a romantic partner's fear of being single
Who is having more and better sex? The Big Five as predictors of sex in marriage
A dyadic personality perspective on the Michelangelo phenomenon
The benefits of studying immigration for social psychology
When one's partner wants out
Grolar bears, social class, and policy relevance
The Intergroup Time Bias and Its Implications for Medical Healthcare
Effects of living arrangements on well‐being, perceived conflict, and intergroup attitudes for local and international students
Addressing replicability concerns via adversarial collaboration
The empirical benefits of conceptual rigor
Into the wild
Introduction to the Special Issue on Methodological Rigor and Replicability
Attachment avoidance and amends-making
Competitive reputation manipulation
Promise, peril, and perspective
Kiss and Makeup? Examining the Co-occurrence of Conflict and Sex
Newlywed Couples’ Own and Partner Sexual Disgust Sensitivities Interact to Predict Their Marital Satisfaction Through Their Sexual Satisfaction
A Credibility Revolution for Relationship Science
The synergistic effect of prosociality and physical attractiveness on mate desirability
On the Interpersonal Function of Metaphor Use
The role of metaphor in communication and thought
Relationship difficulties and "technoference" during the Covid-19 pandemic
Associations between language style matching and relationship commitment and satisfaction
Power struggles
Who is sexually faithful? Own and partner personality traits as predictors of infidelity
Approach and avoidance motives for touch are predicted by attachment and predict daily relationship well-being
The Emergence of Statistical Objectivity
Cultural Genomics
Replication in Social Science
Design and analysis
Psychological Factors in Marital Happiness
The Rules of the Game Called Psychological Science
An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
Why Most Discovered True Associations Are Inflated
Psychological Science Can Improve Diagnostic Decisions
Promoting Transparency in Social Science Research
Publication Bias in Psychology
The Value of Direct Replication
The ironic effect of significant results on the credibility of multiple-study articles.
The Alleged Crisis and the Illusion of Exact Replication
Estimating Statistical Power and Required Sample Sizes for Organizational Research Using Multilevel Modeling
P-curve
Washing Away Your Sins
A Vast Graveyard of Undead Theories
An Agenda for Purely Confirmatory Research
Recommendations for Increasing Replicability in Psychology
A decision-making theory of visual detection.
The N-Pact Factor
Power failure
Reshaping Institutions
Is the Replicability Crisis Overblown? Three Arguments Examined
Improving the Dependability of Research in Personality and Social Psychology
Scientific Utopia
Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
The Measurement of Perceived Relationship Quality Components
Negative results are disappearing from most disciplines and countries
False-Positive Psychology
The Logic of Scientific Discovery
“But the data is already public”
Harking
Perceived, not actual, similarity predicts initial attraction in a live romantic context
The statistical power of abnormal-social psychological research
The predictive validity of ideal partner preferences
At what sample size do correlations stabilize
Dissonance and self-perception
The Replication Recipe
Statistical procedures and the justification of knowledge in psychological science
The poor availability of psychological research data for reanalysis
The two disciplines of scientific psychology
Beyond pleasure and pain
The greening of relationship science
How are we doing in soft psychology
Antifragile
Fishing, Commitment, and Communication
Using I3 theory to clarify when dispositional aggressiveness predicts intimate partner violence perpetration
Attachment, Caregiving, and Altruism
Is a meta-analysis a foundation, or just another brick? Comment on Meltzer, McNulty, Jackson, and Karney (2014)
Feeling the future
Attachment and the experience and expression of emotions in romantic relationships
So far away from one's partner, yet so close to romantic alternatives
Correcting the past
Optimistic expectations in early marriage
Publication Manual of the American Psychological Association
Science Deserves Better
Self-reports
The Family as a Unity of Interacting Personalities
Registered Reports
Convergent and discriminant validation by the multitrait-multimethod matrix
Statistical significance in psychological research
The relationship context of human behavior and development
A power primer
Do studies of statistical power have an effect on the power of studies
Consequences of prejudice against the null hypothesis
The file drawer problem and tolerance for null results
| Unique citing works | 69 |
|---|---|
| Citations per year | 6,27 |
| Citation span | 2015 - 2026 (12) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 59 |