Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Navigating Potential Pitfalls in Difference-in-Differences Designs

Reconciling Conflicting Findings on Mass Shootings’ Effect on Electoral Outcomes

Bibliographic Data

ID7251010
AuthorsHans J G Hassell (0000-0002-6679-4849, Florida State University, corresponding author), John B Holbein (0000-0001-5099-3395, University of Virginia, corresponding author)
Year2024
Volume119
Issue1
Pages240-260
Publication date2024-04-12
Open AccessYes
TypeARTICLE
VenueAmerican Political Science Review (JOURNAL)
Journal identifiersISSN: 0003-0554 • E-ISSN: 1537-5943
PublisherCambridge University Press (CUP) (PUBLISHER)
DOI10.1017/s0003055424000108
OpenAlexW4394765059
LanguageEN
Citations received17
References cited57

Work on the electoral effects of gun violence in the U.S. relying on difference-in-differences designs has produced findings ranging from null to substantively large effects. However, as difference-in-difference designs, on which this research relies, have exploded in popularity, scholars have documented several methodological issues including potential violations of parallel-trends and unaccounted for treatment effect heterogeneity. These pitfalls (and their solutions) have not been fully explored in political science. We apply these advancements to the unresolved debate on gun violence’s effects on U.S. electoral outcomes. We show that studies finding a large positive effect of gun violence on Democratic vote shares are a product of a failure to properly specify difference-in-differences models when underlying assumptions are unlikely to hold. Once these biases are corrected, shootings show little evidence of sparking large electoral change. Our work clarifies an unresolved debate and provides a cautionary guide for scholars currently employing difference-in-differences designs

Democracy · Difference in differences · Econometrics · Economics · Political economy · Political science · Politics · Popularity · Positive economics · Product (mathematics · Significant difference · Statistics · Electoral Systems and Political Participation · Gun Ownership and Violence Research · Healthcare Policy and Management · Law · Mathematics · Psychology · Social Psychology

  • The business case for demographic diversity in strategic leadership teams

    Open Access•Jost Sieweke, Tanja Hentschel et al.•The Leadership Quarterly•2025

  • How Partisan Policy Threat Mobilizes Gun Owners

    Open Access•Chris Cassella, Michael E Shepherd•Political Behavior•2026

  • Do Women Legislators Legislate Differently Than Men on Gun‐Related Policy? A Suggestive Yes

    Open Access•Patrick Cunha Silva, G Agustin Markarian et al.•Legislative Studies Quarterly•2026

  • Do Losing Candidates Harbor Illiberal Attitudes

    Open Access•Michael Barber, Hans J G Hassell et al.•Political Behavior•2026

  • Beyond Outbidding

    Open Access•Mark Berlin, Ilayda B Onder•Journal of Conflict Resolution•2026

  • Changing the Scope of Conflict? Voter Registration and George Floyd’s Murder

    Open Access•Hans J G Hassell, John B Holbein•British Journal of Political…•2026

  • Did development bring peace? Unintended consequences of Jokowi’s administration in Papua region’s extractive zones

    Open Access•Yessi Rahmawati, Ryuto Minami et al.•The Extractive Industries and…•2026

  • The Diffusion of State Firearm Regulations

    Open Access•Nicholas Hemauer•State Politics & Policy Quarterly•2026

  • Using AI to Assess Demographic Balance of Syllabi and Bibliographies

    Open Access•Sarah Musgrave, Jane Lawrence Sumner•PS Political Science & Politics•2026

  • Protecting Children With More Guns

    Open Access•Seungjoon Yoo•Social Science Quarterly•2026

  • Empowered by Information

    Zoe Xincheng Ge•The Journal of Politics•2026

  • The Impact of Natural Disasters on the Ongoing Civil War

    Open Access•Weiyi Zhao, Wangyin Zhao•Journal of Conflict Resolution•2025

  • Claimability in International Relations

    Open Access•Kyosuke Kikuta•American Political Science Review•2026

  • Exposure to Mass Shootings and Voting Directly on Gun Policy

    Open Access•G Agustin Markarian, Benjamin J Newman•American Political Science Review•2024

  • Do green parties in government benefit from natural catastrophes? How wildfires are linked to voting

    Open Access•Anton Kronborg, Frederik Hedegaard et al.•Electoral Studies•2024

  • Do Criminalization Policies Impact Local Homelessness

    Open Access•Hannah Lebovits, Andrew Sullivan•Policy Studies Journal•2025

  • Traceability and Mass Policy Feedback Effects

    Open Access•Brian T Hamel•American Political Science Review•2025

  • Synthetic Difference-in-Differences

    Dmitry Arkhangelsky, Susan Athey et al.•American Economic Review•2021

  • What’s trending in difference-in-differences? A synthesis of the recent econometrics literature

    Open Access•Jonathan Roth, Pedro H C Sant’Anna et al.•Journal of Econometrics•2023

  • Designing Difference in Difference Studies

    Open Access•Coady Wing, Katie Simon et al.•Annual Review of Public Health•2018

  • When Should You Adjust Standard Errors for Clustering?

    Open Access•Alberto Abadie, Susan Athey et al.•The Quarterly Journal of Economics•2022

  • How much should we trust staggered difference-in-differences estimates?

    Open Access•Andrew C Baker, David F Larcker et al.•Journal of Financial Economics•2022

  • Pretest with Caution

    Jonathan Roth•American Economic Review: Insights•2022

  • Covariate Balance in Simple, Stratified and Clustered Comparative Studies

    Ben B Hansen, J Bowers•Statistical Science•2008

  • Pre-Event Trends in the Panel Event-Study Design

    Simon Freyaldenhoven, Christian Hansen et al.•American Economic Review•2019

  • Implementing the panel event study

    Open Access•Damian Clarke, Kathya Tapia-Schythe et al.•The Stata Journal: Promoting…•2021

  • Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects

    Clément de Chaisemartin, Xavier D’Haultfœuille•American Economic Review•2020

  • A Practitioner’s Guide to Cluster-Robust Inference

    A Colin Cameron, Douglas L Miller•The Journal of Human Resources•2015

  • Difference-in-differences with variation in treatment timing

    Open Access•Andrew Goodman-Bacon•Journal of Econometrics•2021

  • Difference-in-Differences with multiple time periods

    Open Access•Brantly Callaway, Pedro H C Sant’Anna•Journal of Econometrics•2021

  • Estimating dynamic treatment effects in event studies with heterogeneous treatment effects

    Open Access•Liyang Sun, Sarah Abraham•Journal of Econometrics•2021

  • On event studies and distributed‐lags in two‐way fixed effects models

    Open Access•Kurt Schmidheiny, Sebastian Siegloch•Journal of Applied Econometrics•2023

  • Revisiting Event-Study Designs

    Open Access•Kirill Borusyak, Xavier Jaravel et al.•The Review of Economic Studies•2024

  • The Promise and Pitfalls of Differences-in-Differences

    Ariella Kahn-Lang, Kevin Lang•Journal of Business and Economic…•2020

  • How Do Right-to-Carry Laws Affect Crime Rates? Coping with Ambiguity Using Bounded-Variation Assumptions

    Open Access•Charles F Manski, John V Pepper•The Review of Economics and…•2018

  • Disarmed

    Open Access•Brian Anse Patrick•The Journal of Popular Culture•2007

  • A Bracketing Relationship between Difference-in-Differences and Lagged-Dependent-Variable Adjustment

    Open Access•Peng Ding, Fan Li•Political Analysis•2019

  • Mobilize for Our Lives? School Shootings and Democratic Accountability in U.S. Elections

    Open Access•Hans J G Hassell, John B Holbein et al.•American Political Science Review•2020

  • Obstacles to Estimating Voter ID Laws’ Effect on Turnout

    Justin Grimmer, E Hersh et al.•The Journal of Politics•2018

  • Presidential Voting and the Local Economy

    Andrew Healy, Gabriel S Lenz•The Journal of Politics•2017

  • Critical Events and Attitude Change

    Open Access•Jon C Rogowski, Patrick D Tucker et al.•Political Science Research and…•2019

  • Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment

    Open Access•Kevin Arceneaux, Alan S Gerber et al.•Political Analysis•2006

  • Of Nickell Bias and its Cures

    Open Access•Niels Beck, Nathaniel L Beck et al.•Political Analysis•2014

  • How Much Is Minnesota Like Wisconsin? Assumptions and Counterfactuals in Causal Inference with Observational Data

    Open Access•Luke Keele, William Minozzi•Political Analysis•2013

  • The Statistics of Causal Inference

    Open Access•Luke Keele•Political Analysis•2015

  • Testing the Accuracy of Regression Discontinuity Analysis Using Experimental Benchmarks

    Open Access•Donald P Green, Terence Y Leong et al.•Political Analysis•2009

  • A Practical Guide to Counterfactual Estimators for Causal Inference with Time‐Series Cross‐Sectional Data

    Open Access•Licheng Liu, Ye Wang et al.•American Journal of Political…•2024

  • An Equivalence Approach to Balance and Placebo Tests

    Open Access•Elwood Hartman, Erin Hartman et al.•American Journal of Political…•2018

  • Comparative Politics and the Synthetic Control Method

    Open Access•Alberto Abadie, Alexis Diamond et al.•American Journal of Political…•2015

  • Reexamining the Effect of Mass Shootings on Public Support for Gun Control

    Open Access•David J Barney, Brian F Schaffner et al.•British Journal of Political…•2019

  • Accounting for Pre-Treatment Exposure in Panel Data

    Open Access•Todd K Hartman, Benjamin J Newman•British Journal of Political…•2019

  • The Credibility Revolution in Empirical Economics

    Open Access•Joshua D Angrist, Jorn‐steffen Pischke et al.•The Journal of Economic…•2010

  • The Effect of Television Advertising in United States Elections

    Open Access•Josh Sides, Lynn Vavreck et al.•American Political Science Review•2022

  • Violence and Voting in the United States

    Open Access•Laura García-Montoya, Ángeles Arjona et al.•American Political Science Review•2022

  • Trauma and Turnout

    Open Access•Wayde Z C Marsh•American Political Science Review•2023

Citations per year8.5
Citation span2024 - 2026 (3)
Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae