Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Control, Exogeneity, and Directness

Understanding and Designing Quasi- and Natural Experiments

Bibliographic Data

ID6414828
AuthorsDahlia K Remler (0000-0002-9661-2460, Baruch College), Gregg G Van Ryzin (0000-0003-4107-5319, Rutgers, the State University of New Jersey)
Year2024
Volume46
Issue1
Pages62-89
Publication date2024-09-12
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueAmerican Journal of Evaluation (JOURNAL)
Journal identifiersISSN: 1098-2140 • E-ISSN: 1557-0878
PublisherSAGE Publishing (PUBLISHER • US)
DOI10.1177/10982140241265708
OpenAlexW4402546169
LanguageEN
Citations received3
References cited70

This article reviews the origins and use of the terms quasi-experiment and natural experiment. It demonstrates how the terms conflate whether variation in the independent variable of interest falls short of random with whether researchers find, rather than intervene to create, that variation. Using the lens of assignment—the process driving variation in the independent variable—we distinguish three dimensions: control of assignment by the researcher, rather than by a policy process or naturally occurring event; exogeneity of the assignment process; and directness of the link between assignment and the independent variable. These dimensions generate a typology of causal study designs that we illustrate with examples from the social and health sciences. Our framework can assist researchers and practitioners from diverse disciplines to better understand and communicate with one another and, importantly, to recognize opportunities in real-world settings to find or create variation that can be leveraged for valid impact estimates

Argument (complex analysis · Conflation · Control (management · Econometrics · Economics · Endogeneity · Epistemology · Machine learning · Management science · Natural (archaeology · Natural experiment · Process (computing · Random assignment · Sociology · Statistics · Typology · Variable (mathematics · Variation (astronomy · Advanced Causal Inference Techniques · Computer Science · Economic and Environmental Valuation · Health Systems, Economic Evaluations, Quality of Life · Mathematics · Artificial Intelligence

  • Mapping the Temporal Evolution of Causal Effects in Public Administration and Policy Research

    Open Access•L Jason Anastasopoulos, Inkyu Kang•Journal of Public Administration…•2026

  • Recent developments in experimental public administration

    Open Access•Rins Hylkema, Stephan Grimmelikhuijsen•International Public Management…•2026

  • Long-run impacts of performance feedback

    Sounman Hong, Suho Ji et al.•International Public Management…•2026

  • Causal Inference

    Open Access•Scott Cunningham•Causal Inference•2021

  • Causal Inference for Statistics, Social, and Biomedical Sciences

    Guido W Imbens, Donald B Rubin•Causal Inference in Statistics,…•2015

  • Counterfactuals and Causal Inference

    Open Access•Stephen L Morgan, C Winship•Counterfactuals and Causal…•2014

  • Early Coverage, Access, Utilization, and Health Effects Associated With the Affordable Care Act Medicaid Expansions

    Open Access•Laura R Wherry, Laura Wherry et al.•Annals of Internal Medicine•2016

  • Single-Case Intervention Research Design Standards

    Open Access•Thomas R Kratochwill, John H Hitchcock et al.•Remedial and Special Education•2013

  • Designing Difference in Difference Studies

    Open Access•Coady Wing, Katie Simon et al.•Annual Review of Public Health•2018

  • Vouchers for Private Schooling in Colombia

    Joshua D Angrist, Joshua Angrist et al.•American Economic Review•2002

  • The Impact of Nearly Universal Insurance Coverage on Health Care Utilization

    David Card, Carlos Dobkin et al.•American Economic Review•2008

  • Natural “Natural Experiments” in Economics

    Mark R Rosenzweig, Kenneth I Wolpin•Journal of Economic Literature•2000

  • The Oregon Experiment — Effects of Medicaid on Clinical Outcomes

    Katherine Baicker, Sarah Taubman et al.•New England Journal of Medicine•2013

  • Does More Intensive Treatment of Acute Myocardial Infarction in the Elderly Reduce Mortality?

    Mark Mcclellan•JAMA•1994

  • Problems with Instrumental Variables Estimation when the Correlation between the Instruments and the Endogenous Explanatory Variable is Weak

    John Bound, David A Jaeger et al.•Journal of the American…•1995

  • Single-case experimental designs

    Justin D Smith•Psychological Methods•2012

  • Promotion of Breastfeeding Intervention Trial (PROBIT)

    Michael S Kramer, B Chalmers et al.•JAMA•2001

  • Efficacy and Safety of the mRNA-1273 Sars-CoV-2 Vaccine

    Open Access•Lindsey R Baden, Hana M El Sahly et al.•New England Journal of Medicine•2021

  • Beyond prediction

    Open Access•Susan Athey•Science•2017

  • Causal Inference Using Potential Outcomes

    Donald B Rubin•Journal of the American…•2005

  • The Oregon Health Insurance Experiment

    Amy Finkelstein, Sarah Taubman et al.•The Quarterly Journal of Economics•2012

  • The combined effects of healthy lifestyle behaviors on all cause mortality

    Open Access•Martin Loef, Harald Walach•Preventive Medicine•2012

  • Estimating causal effects of treatments in randomized and nonrandomized studies.

    Donald B Rubin•Journal of Educational Psychology•1974

  • Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score

    Paul R Rosenbaum, Donald B Rubin•The American Statistician•1985

  • Experimental Political Science and the Study of Causality

    Open Access•Rebecca B Morton, Kenneth C Williams•Experimental Political Science…•2010

  • Mostly Harmless Econometrics

    Jorn‐steffen Pischke, Jörn-Steffen Pischke et al.•Mostly Harmless Econometrics•2009

  • Natural Experiments in the Social Sciences

    Open Access•Thad Dunning•Natural Experiments in the Social…•2012

  • Natural and Quasi-Experiments in Economics

    Breed D Meyer•Journal of Business and Economic…•1995

  • Introduction to the "JBES" Symposium on Program and Policy Evaluation

    Joshua D Angrist•Journal of Business and Economic…•1995

  • Nonparametric Estimation of Average Treatment Effects Under Exogeneity

    Guido W Imbens•The Review of Economics and…•2004

  • Instrumental Variables and the Search for Identification

    Open Access•Joshua D Angrist, Alan B Krueger•The Journal of Economic…•2001

  • Why are mediation effects so small

    Glenn D Walters•International Journal of Social…•2018

  • Evaluating Methods for Estimating Program Effects

    Open Access•Charles S Reichardt•American Journal of Evaluation•2011

  • Contemporary Thinking About Causation in Evaluation

    Open Access•Thomas D Cook, Michael Scriven et al.•American Journal of Evaluation•2009

  • Implications of the Changing Conversation About Causality for Evaluators

    Open Access•Emily Gates, Lisa Dyson•American Journal of Evaluation•2016

  • Early Impacts of the Affordable Care Act on Health Insurance Coverage in Medicaid Expansion and Non‐Expansion States

    Open Access•Charles Courtemanche, James Marton et al.•Journal of Policy Analysis and…•2016

  • Three conditions under which experiments and observational studies produce comparable causal estimates

    Open Access•Thomas D Cook, William R Shadish et al.•Journal of Policy Analysis and…•2008

  • Does Stimulating Physical Activity Affect School Performance

    Open Access•Bart H H Golsteyn, Bart Golsteyn et al.•Journal of Policy Analysis and…•2019

  • Effects of ACA Medicaid Expansions on Health Insurance Coverage and Labor Supply

    Open Access•Robert Kaestner, Bowen Garrett et al.•Journal of Policy Analysis and…•2017

  • Evaluation

    Michael Quinn Patton, Peter H Rossi et al.•Contemporary Sociology A Journal…•1981

  • The C-Word

    Miguel A Hernán•American Journal of Public Health•2018

  • The practice of social research

    Earl R Babbie•The practice of social research•2010

  • Does Compulsory School Attendance Affect Schooling and Earnings

    Joshua D Angrist, Alan B Krueger•The Quarterly Journal of Economics•1991

  • The Impact of Legal Counsel on Outcomes for Poor Tenants in New York City's Housing Court

    Open Access•Carroll Seron, Gregg Van Ryzin et al.•Law & Society Review•2001

  • The Impact of the Mariel Boatlift on the Miami Labor Market

    David Card•Industrial and Labor Relations…•1990

  • Caught in the Draft

    Open Access•Robert S Erikson, Laura Stoker•American Political Science Review•2011

  • The Natural Experiment, Ecology and Culture

    Morris Freilich•Southwestern Journal of…•1963

Unique citing works3
Citations per year3
Citation span2026 - 2026 (1)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 2
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae