Commentaries and Rejoinder on
Bibliographic Data
While direct replications such as the “Many Labs” project are extremely valuable in testing the reliability of published findings across laboratories, they reflect the common reliance in psychology on single vignettes or stimuli, which limits the scope of the conclusions that can be reached. New experimental tools and statistical techniques make it easier to routinely sample stimuli, and to appropriately treat them as random factors. We encourage researchers to get into the habit of including multiple versions of the content (e.g., stimuli or vignettes) in their designs, to increase confidence in cross-stimulus generalization and to yield more realistic estimates of effect size. We call on editors to be aware of the challenges inherent in such stimulus sampling, to expect and tolerate unexplained variability in observed effect size between stimuli, and to encourage stimulus sampling instead of the deceptively cleaner picture offered by the current reliance on single stimuli
Cognitive psychology · Sample size determination · Statistics · Stimulus (psychology · Behavioral Health and Interventions · Decision-Making and Behavioral Economics · Mathematics · Mental Health Research Topics · Psychology · Applied Psychology · Social Psychology
Making replication mainstream
The natural selection of bad science
A Large Scale Test of the Effect of Social Class on Prosocial Behavior
Contextual sensitivity in scientific reproducibility
Past Its Prime? A Methodological Overview and Critique of Religious Priming Research in Social Psychology
The Role of Replication Studies in Theory Building
What Can Cognitive Load and Processing Fluency Tell Us About Difficult Processing
Losing More than Money
The effect of effects on effectiveness
Get together, feel together, act together
Healthier than thou? “Practicing what you preach” backfires by increasing anticipated devaluation
Streetscapes at Scale
Remarkably reproducible psychological (memory) phenomena in the classroom
Sometimes It’s Personal
Disgust as embodied loss aversion
Identifying “types” of ideologies and intergroup biases
Many Labs 2
Improving Visual Behavior Research in Communication Science
Looking Back and Looking Forward
Overfulfilling the Norm
Degree of group consensus shapes perceived power structures and decision-process evaluations of groups
Using Artificial Intelligence to Generate Visual Vignettes in Factorial Survey Experiments
Be careful what you wish for
What type of Type I error? Contrasting the Neyman–Pearson and Fisherian approaches in the context of exact and direct replications
Are most published social psychological findings false
Observe, hypothesize, test, repeat
Investigating Variation in Replicability
Ideation with Generative AI-in Consumer Research and Beyond
Increasing Replicability
The relationship between political ideology and judgements of bias in distributional outcomes
| Unique citing works | 30 |
|---|---|
| Citations per year | 2,5 |
| Citation span | 2014 - 2025 (12) |
| Citation velocity | recent |
| Highly cited | No |
| Citation types | Neutral: 30 |