Strengthening the Experimenter’s Toolbox
Statistical Estimation of Internal Validity
Bibliographic Data
| ID | 6231023 |
|---|---|
| Authors | Luke Keele (0000-0002-3859-2713, Pennsylvania State University), Corrine M Mcconnaughy (0000-0001-5893-869X, The Ohio State University), Corrine Mcconnaughy, Ismail K White (The Ohio State University), Ismail White |
| Year | 2012 |
| Volume | 56 |
| Issue | 2 |
| Pages | 484-499 |
| Publication date | 2012-04-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Political Science (JOURNAL) |
| Journal identifiers | ISSN: 0092-5853 • E-ISSN: 1540-5907 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1111/j.1540-5907.2011.00576.x |
| OpenAlex | W2143335126 |
| Language | EN |
| Citations received | 34 |
| References cited | 20 |
Experiments have become an increasingly common tool for political science researchers over the last decade, particularly laboratory experiments performed on small convenience samples. We argue that the standard normal theory statistical paradigm used in political science fails to meet the needs of these experimenters and outline an alternative approach to statistical inference based on randomization of the treatment. The randomization inference approach not only provides direct estimation of the experimenter’s quantity of interest—the certainty of the causal inference about the observed units—but also helps to deal with other challenges of small samples. We offer an introduction to the logic of randomization inference, a brief overview of its technical details, and guidance for political science experimenters about making analytic choices within the randomization inference framework. Finally, we reanalyze data from two political science experiments using randomization tests to illustrate the inferential differences that choosing a randomization inference approach can make
Bayesian inference · Bayesian probability · Causal inference · Data science · Econometrics · Fiducial inference · Frequentist inference · Inference · Machine learning · Randomization · Randomized controlled trial · Statistical inference · Statistical theory · Statistics · Toolbox · Advanced Causal Inference Techniques · Artificial Intelligence · Computer Science · Electoral Systems and Political Participation · Mathematics · Qualitative Comparative Analysis Research
Conditional Randomization Tests for the Specification of Interference Structure
Body-Worn Cameras and Transparency
Do federal and state audits increase compliance with a grant program to improve municipal infrastructure (Audit study)
Attempting to reduce traffic stop racial disparities
Do State Legislative Staffer Networks Influence Roll-call Voting? Evidence from Shared Personal Staffers in Arizona, Indiana, and New Mexico
Scaling Data from Multiple Sources
Mobilization, Participatory Planning Institutions, and Elite Capture
Federal and state audits do not increase compliance with a grant program to improve municipal infrastructure
Double standards? How historical and political aspiration levels guide managerial performance information use
Electoral Proximity and the Political Involvement of Bureaucrats
Honor and War
Are We in the Same Boat or Not? The Opposite Effects of Absolute and Relative Income Shifts on Redistributive Preferences
Voter Reactions to Incumbent Opportunism
Nonparametric Combination (NPC)
Black Candidates and Black Turnout
Alphabetically Ordered Ballots and the Composition of American Legislatures
Estrategia para la inferencia causal y planificación de estudios observacionales en las ciencias sociales
Whose Upward Mobility
Explaining support for redistribution
Kingmakers or Cheerleaders? Party Power and the Causal Effects of Endorsements
The Statistics of Causal Inference
Reasoning about Interference Between Units
Robust Estimation with Nonrandom Measurement Error and Weak Instruments
Examining Legislative Cue‐Taking in the US Senate
Priming political trust
Party Brands and Partisanship
Campaign Contributions Facilitate Access to Congressional Officials
Using Qualitative Information to Improve Causal Inference
Measuring the Vice-Presidential Home State Advantage With Synthetic Controls
Mitigating Mormonism
International recognition and support for violence among nonpartisans
Do Provincial Governors Control National Legislators? Quasi-Experimental Evidence of Argentine Federalism
Selling Out
The Generalizability of IR Experiments beyond the United States
Data Analysis Using Regression and Multilevel/Hierarchical Models
Observational Studies
Covariance Adjustment in Randomized Experiments and Observational Studies
Agnostic notes on regression adjustments to experimental data
Covariate Balance in Simple, Stratified and Clustered Comparative Studies
On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9
On regression adjustments to experimental data
Beyond the Self
The Insignificance of Null Hypothesis Significance Testing
Media Framing of a Civil Liberties Conflict and Its Effect on Tolerance
| Unique citing works | 34 |
|---|---|
| Citations per year | 2,62 |
| Citation span | 2013 - 2026 (14) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 34 |