P ‐Curve analysis of the Taylor Aggression Paradigm

Estimating evidentiary value and statistical power across 50 years of research

Bibliographic Data

ID11106975
AuthorsSamuel J West (0000-0002-6439-9159, Department of Psychology Virginia Commonwealth University Richmond Virginia USA, corresponding author), Courtland S Hyatt (0000-0002-8245-959X, Department of Psychology University of Georgia Athens Georgia USA), Joshua D Miller (0000-0002-2171-856X, Department of Psychology University of Georgia Athens Georgia USA), David S Chester (0000-0002-9383-7138, Department of Psychology Virginia Commonwealth University Richmond Virginia USA)
Year2021
Volume47
Issue2
Pages183-193
Publication date2021-03-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueAggressive Behavior (JOURNAL)
Journal identifiersISSN: 0096-140X • E-ISSN: 1098-2337
PublisherWiley (PUBLISHER • GB)
DOI10.1002/ab.21937
PMID33206431
OpenAlexW3103774982
LanguageEN
Citations received1
References cited60

The overall reliability or evidentiary value of any body of literature is established in part by ruling out publication bias for any observed effects. Questionable research practices have potentially undermined the evidentiary value of commonly used research paradigms in psychological science. Subsequently, the evidentiary value of these common methodologies remains uncertain. To quantify the severity of these issues in the literature, we selected the Taylor Aggression Paradigm (TAP) as a case study and submitted 170 hypothesis tests spanning over 50 years of research to a preregistered p ‐curve analysis. The TAP literature ( N = 24,685) demonstrated significant evidentiary value but yielded a small average effect size ( d = 0.29) and inadequate power (38%). The main effects demonstrated greater evidentiary value, power, and effect sizes than interactions. Studies that tested the effects of measured traits did not differ in evidentiary value or power to those that tested the effects of experimentally manipulated states. Exploratory analyses revealed that evidentiary value, statistical power, and effect sizes have improved over time. We provide recommendations for researchers who seek to maximize the evidentiary value of their psychological measures

Aggression · Econometrics · Economics · Medical emergency · Meta-analysis · Poison control · Power (physics · Reliability (semiconductor · Statistics · Value (mathematics · Behavioral Health and Interventions · Cultural Differences and Values · Mathematics · Medicine · Psychology · Social and Intergroup Psychology · Social Psychology

Tools

Open DOI