Elements of External Validity
Framework, Design, and Analysis
Bibliographic Data
| ID | 3203489 |
|---|---|
| Authors | Naoki Egami (0000-0002-5491-2174, Columbia University, corresponding author), Elwood Hartman (0000-0003-4824-5405, University of California, Berkeley, corresponding author) |
| Year | 2023 |
| Volume | 117 |
| Issue | 3 |
| Pages | 1070-1088 |
| Publication date | 2023-08-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Political Science Review (JOURNAL) |
| Journal identifiers | ISSN: 0003-0554 • E-ISSN: 1537-5943 |
| Publisher | Cambridge University Press (CUP) (PUBLISHER) |
| DOI | 10.1017/s0003055422000880 |
| OpenAlex | W4303969279 |
| Language | EN |
| Citations received | 45 |
| References cited | 30 |
The external validity of causal findings is a focus of long-standing debates in the social sciences. Although the issue has been extensively studied at the conceptual level, in practice few empirical studies include an explicit analysis that is directed toward externally valid inferences. In this article, we make three contributions to improve empirical approaches for external validity. First, we propose a formal framework that encompasses four dimensions of external validity: $ X $-, $ T $-, $ Y $-, and C-validity (populations, treatments, outcomes, and contexts). The proposed framework synthesizes diverse external validity concerns. We then distinguish two goals of generalization. To conduct effect-generalization-generalizing the magnitude of causal effects-we introduce three estimators of the target population causal effects. For sign-generalization-generalizing the direction of causal effects-we propose a novel multiple-testing procedure under weaker assumptions. We illustrate our methods through field, survey, and lab experiments as well as observational studies
Causal inference · Causal model · Econometrics · Empirical research · Estimator · External validity · Generalization · Internal validity · Observational study · Population · Sociology · Statistics · Advanced Causal Inference Techniques · Computer Science · Mathematics · Psychology · Social Psychology · Statistical Methods and Bayesian Inference · Statistical Methods and Inference
Designing multi‐site studies for external validity
Social Cues
Do updates of group-level and individual-level information of ethnic minority applicants mitigate statistical discrimination in hiring?
Vignette Experiments Can Replicate Actual Behavioral Intent and Partly Actual Behavior
Intergroup Threat and Tolerance Towards Venezuelan Immigrants in Chile / Tolerancia y amenaza intergrupal hacia inmigrantes venezolanos en Chile
Getting on the grid
Neighborhood Desirability and Decision-Making in Online, Multiracial, Metropolitan America
Growing together or apart? Regional inequality and preferences for inter-territorial redistribution
Credible resistance or political ploy? How government status and consistency shape citizen perceptions of parliamentarians’ democratic defence
Preferential abstention in conjoint experiments
Temporal validity as meta-science
An Experimental Test of the Effects of Fear in a Coordination Game
Keep It Abstract, Keep It Equal
Do policy packages that mitigate uncertainty over long-term policy benefits increase support for costly climate action
Three facets of causal inference
Quantifying theory in politics
Bringing External Validity into Sociological Research
How Migrating Overseas Shapes Political Preferences
Elite Partisan Disagreement and Military Victory
Heterogeneous Treatment Effects and Causal Mechanisms
How do people react to policy reform? Group cues and persuasion in criminal justice
Voters rally around the incumbent in the aftermath of terrorist attacks
On the Internet, No One Knows You’re an Activist
Is a Picture Worth 280 Characters
Introducing the Visual Conjoint, with an Application to Candidate Evaluation on Social Media
Ubiquitous but heterogeneous
Which frame fits? Policy learning with framing for climate change policy attitudes
Defending democracy
Stepping Up the Political Ladder
Does Priming Democratic Vulnerability Make Citizens Punish Undemocratic Behavior
Can Authoritarians’ Electoral Success Abroad Change Citizens’ Satisfaction with Democracy
Generalizing toward Nonrespondents
Sign-Congruence, External Validity, and Replication
On motives and means
Race, shaming, and international human rights
External Validity and Meta‐Analysis
Bridging the gulf
Making fair comparisons in political theory
How Does Shaming Human Rights Violators Abroad Shape Attitudes at Home
Legislators' Emotional Engagement with Women's Issues
Anti-Asian Hate Crimes and American Reputation
Understanding preferences for descriptive political representation among citizens with immigrant background
Evidence of Caste-Class Discrimination from a Conjoint Analysis of Law Enforcement Officers
The Generalizability of IR Experiments beyond the United States
Recent Developments in Causal Inference and Machine Learning
Population-Based Survey Experiments
Durably reducing transphobia
Misunderstandings Between Experimentalists and Observationalists about Causal Inference
Generalizability of heterogeneous treatment effect estimates across samples
Estimation of Regression Coefficients When Some Regressors are not Always Observed
Identification of Causal Effects Using Instrumental Variables
Estimating causal effects of treatments in randomized and nonrandomized studies.
Experimental Political Science and the Study of Causality
From Local to Global
The contact hypothesis re-evaluated
The Generalizability of Survey Experiments
Worth Weighting? How to Think About and Use Weights in Survey Experiments
External Validity
How Getting the Facts Right Can Fuel Partisan‐Motivated Reasoning
Understanding and misunderstanding randomized controlled trials
The Psychology of State Repression
| Unique citing works | 45 |
|---|---|
| Citations per year | 15 |
| Citation span | 2023 - 2026 (4) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 44 |