Beyond Experiments
Bibliographic Data
| ID | 21786007 |
|---|---|
| Authors | Ed Diener (0000-0002-7418-4282, University of St.Gallen), Robert Northcott (0000-0001-8791-8364, Birkbeck, University of London), Michael J Zyphur (0000-0003-3237-7892, The University of Melbourne, corresponding author), Stephen G West (Arizona State University) |
| Year | 2022 |
| Volume | 17 |
| Issue | 4 |
| Pages | 1101-1119 |
| Publication date | 2022-07-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Perspectives on Psychological Science (JOURNAL) |
| Journal identifiers | ISSN: 1745-6916 • E-ISSN: 1745-6924 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/17456916211037670 |
| PMID | 35201911 |
| OpenAlex | W4213439910 |
| Language | EN |
| Citations received | 31 |
| References cited | 111 |
It is often claimed that only experiments can support strong causal inferences and therefore they should be privileged in the behavioral sciences. We disagree. Overvaluing experiments results in their overuse both by researchers and decision makers and in an underappreciation of their shortcomings. Neglect of other methods often follows. Experiments can suggest whether X causes Y in a specific experimental setting; however, they often fail to elucidate either the mechanisms responsible for an effect or the strength of an effect in everyday natural settings. In this article, we consider two overarching issues. First, experiments have important limitations. We highlight problems with external, construct, statistical-conclusion, and internal validity; replicability; and conceptual issues associated with simple X causes Y thinking. Second, quasi-experimental and nonexperimental methods are absolutely essential. As well as themselves estimating causal effects, these other methods can provide information and understanding that goes beyond that provided by experiments. A research program progresses best when experiments are not treated as privileged but instead are combined with these other methods
Causal inference · Cognitive psychology · Econometrics · Epistemology · External validity · Internal validity · Neglect · Behavioral Health and Interventions · Computer Science · Decision-Making and Behavioral Economics · Experimental Behavioral Economics Studies · Psychology · Social Psychology
The dynamics of prayer in daily life and implications for well-being
A three-dimensional taxonomy of achievement emotions
Reciprocal Associations between Depressive Symptoms, Life Satisfaction, and Eudaimonic Well-Being in Older Adults over a 16-Year Period
Structural Equation Modeling in Organizational Research
The Ecological Assessment of Responses to Speaking-up tool—development and reliability testing of a method for coding safety listening behavior in naturalistic conversations
Prolonged physical isolation, agonistic behaviour, and human resilience in pandemic times
Realizing the full potential of behavioural science for climate change mitigation
Social Psychology’s Empty-Self Metaphor and the Replication Crisis
A New Way to Think About Internal and External Validity
Is Religion Special
Mindsets of poverty
A Relevant Antecedent of Flow Experience
The Onset of the Covid-19 Pandemic Made People Feel Threatened, but Had a Limited Impact on Political Attitudes in the United States
Secrecy in Everyday Life
Cheating among elementary school children
Minimal Social Interactions and Life Satisfaction
Feeling grateful to God and change in chronic health problems
Frame plurality and ‘or/rationality’
Growth mindsets of people can promote interracial contact intentions among White Americans via positive expectations and reduced anxiety
A Recipe for Disaster?”
Refusing to forgive can have psychological benefits
Generalising Social Behaviour and Theory of Social Behaviour
Equilibrium Causal Models
Generalizing Causal Effects to a Target Population Without Individual-Level Data from the Target Population
Psychological Entitlement and Relative Deprivation Have Reciprocal Cross-lagged Associations for Both Structurally Advantaged and Disadvantaged Groups
Effects of Experiential Learning on Students’ Transfer Skills
Increased consumption despite fewer occasions
Can a simple plan change a complex behavior? Implementation intentions in the context of water drinking
How Can Psychologists Walk the Walk to Promote Racial Justice? Situating Racial Justice Intervention Research Within the Translational Research Framework
Considering the Impact of Online Participant Setting
Does culture improve affective well-being in everyday life? An experimental sampling approach
Social science and social policy
Discovering Complexity
Evidence-Based Policy
Causal Inference for Statistics, Social, and Biomedical Sciences
Causality
Introduction to Statistical Mediation Analysis
A Manifesto on Psychology as Idiographic Science
Historical Ontology
External validity of randomised controlled trials
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Better Late Than Nothing
Designing Difference in Difference Studies
The generalizability crisis
Sample-Size Planning for More Accurate Statistical Power
College Sophomores in the Laboratory Redux
The Alleged Crisis and the Illusion of Exact Replication
Mechanisms and the Evidence Hierarchy
Instruments, Randomization, and Learning about Development
From Data to Causes I
Taking Account of Time Lags in Causal Models
Misunderstandings Between Experimentalists and Observationalists about Causal Inference
Detecting Causality in Complex Ecosystems
Channeling Fisher
Estimating the reproducibility of psychological science
Most people are not Weird
Mediation Analysis
Biographies of scientific objects
Quo Vadis, Methodology? The Key Role of Manipulation Checks for Validity Control and Quality of Science
Construct Validation of Experimental Manipulations in Social Psychology
The Taboo Against Explicit Causal Inference in Nonexperimental Psychology
Mostly Harmless Econometrics
Nonparametric Tests for Treatment Effect Heterogeneity
The Role of Time in the Quest for Understanding Psychological Mechanisms
Useful Dimensions of Haptic Perception
Twenty-six assumptions that have to be met if single random assignment experiments are to warrant “gold standard” status
Alternatives to the Randomized Controlled Trial
The C-Word
The Replication Recipe
In defense of external invalidity
The two disciplines of scientific psychology
Journal article reporting standards for quantitative research in psychology
Causal Concepts in Biology
Why There's No Cause to Randomize
Philosophical investigations
Establishing a causal chain
Self-reports
College sophomores in the laboratory
Social Psychology and Science
Understanding and misunderstanding randomized controlled trials
What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World
The manipulation of affect
Assessing the Case for Social Experiments
Dilemmatics
| Unique citing works | 31 |
|---|---|
| Citations per year | 7,75 |
| Citation span | 2022 - 2026 (5) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 29 |