Do Effect Sizes in Psychology Laboratory Experiments Mean Anything in Reality

Bibliographic Data

ID22327459
AuthorsRoy F Baumeister (0000-0003-1413-3296, The University of Queensland, corresponding author), Roy Baumeister
Year2020
Volume17
Issue4
Pages803-811
Publication date2020-12-30
Open AccessYes
TypeARTICLE
VenueПсихология. Журнал Высшей школы экономики (JOURNAL)
Journal identifiersISSN: 1813-8918 • E-ISSN: 2541-9226
PublisherNational Research University, Higher School of Economics (HSE) (PUBLISHER)
DOI10.17323/1813-8918-2020-4-803-811
OpenAlexW3133184452
LanguageEN
Citations received2
References cited4

The artificial environment of a psychological laboratory experiment offers an excellent method for testing whether a causal relationship exists, — but it is mostly useless for predicting the size and power of such effects in normal life. In comparison with effects out in the world, laboratory effects are often artificially large, because the laboratory situation is set up precisely to capture this effect, with extraneous factors screened out. Equally problematic, laboratory effects are often artificially small, given practical and ethical constraints that make laboratory situations watered-down echoes of what happens in life. Furthermore, in many cases the very notion of a true effect size (as if it were constant across different manipulations and dependent variables) is absurd. These problems are illustrated with examples from the author’s own research programs. It is also revealing that experimental effect sizes, though often quite precisely calculated and proudly integrated into meta-analyses, have attracted almost zero attention in terms of substantive theory about human mental processes and behavior. At best, effect sizes from laboratory experiments provide information that could help other researchers to design their experiments, — but that means effect sizes are shop talk, not information about reality. It is recommended that researchers shift toward a more realistic appreciation of how little can be learned about human mind and behavior from effect sizes in laboratory studies

Cognition · Cognitive psychology · Confirmation bias · Experimental psychology · Computer Science · Decision-Making and Behavioral Economics · Mental Health Research Topics · Psychology · Psychology of Moral and Emotional Judgment · Social Psychology

Tools

Open DOIOpen Access