What Can Instrumental Variables Tell Us About Nonresponse In Household Surveys and Political Polls

This paper introduces an instrumental variables framework for analyzing how external factors that affect survey response rates can also affect the composition of the sample of respondents. The method may be useful for studying survey representativeness, and for assessing the effectiveness of some of the conventional corrections for survey nonresponse bias. The paper applies the method to data collected in the 2011 Swiss Electoral Study (SES), in which survey participation incentives were randomly assigned across members of the original survey sample. The empirical analysis shows that the incentives increased response rates substantially. Estimates of a new instrumental variable parameter called the Complier Average Survey Response (CASR) suggest that the incentives induced participation among people with more nationalist political opinions than those who would have participated without the incentives. Weighting the respondent data to match the covariate distribution in the target population did not account for the discrepancy in attitudes between the two groups, suggesting that the weights would not succeed in removing nonresponse bias

Affect (linguistics · Covariate · Econometrics · Economics · Incentive · Instrumental variable · Non-response bias · Political science · Representativeness heuristic · Respondent · Sample (material · Sample size determination · Sampling bias · Statistics · Survey data collection · Weighting · Advanced Causal Inference Techniques · Mathematics · Psychology · Social Psychology · Statistical Methods and Bayesian Inference · Survey Methodology and Nonresponse

• Graphical Causal Models for Survey Inference

  Open Access•Julian Schuessler, Peter Selb•Sociological Methods & Research•2025

  Incluir item

• Statistical analysis with missing data

  Roderick J A Little•Statistical analysis with missing…•2002

  Incluir item

• Counterfactuals and Causal Inference

  Open Access•Stephen L Morgan, C Winship•Counterfactuals and Causal…•2014

  Incluir item

• The Statistical Analysis of Quasi-Experiments

  Christopher H Achen, Christopher Achen•Statistical Analysis of…•1986

  Incluir item

• Semiparametric instrumental variable estimation of treatment response models

  Open Access•Alberto Abadie•Journal of Econometrics•2003

  Incluir item

• Shadow Prices, Market Wages, and Labor Supply

  James J Heckman, James Heckman•Econometrica•1974

  Incluir item

• Inference and missing data

  Donald B Rubin•Biometrika•1976

  Incluir item

• Identification of Causal Effects Using Instrumental Variables

  Joshua D Angrist, Guido W Imbens et al.•Journal of the American…•1996

  Incluir item

• Identification and Estimation of Local Average Treatment Effects

  Guido W Imbens, Joshua D Angrist•Econometrica•1994

  Incluir item

• Sample Selection Bias as a Specification Error

  James J Heckman•Econometrica•1979

  Incluir item

• Specification Tests in Econometrics

  Jerry A Hausman•Econometrica•1978

  Incluir item

• A Test of Missing Completely at Random for Multivariate Data with Missing Values

  Roderick J A Little, Roderick J Little•Journal of the American…•1988

  Incluir item

• Mostly Harmless Econometrics

  Joshua D Angrist, Jorn‐steffen Pischke et al.•Mostly Harmless Econometrics•2009

  Incluir item

• Internet, Phone, Mail, and Mixed‐Mode Surveys

  Don A Dillman, Jolene D Smyth et al.•Internet, Phone, Mail, and…•2014

  Incluir item

• Limited-dependent and qualitative variables in econometrics

  G S Maddala•Limited-Dependent and Qualitative…•1983

  Incluir item

• Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models

  James J Heckman, James Heckman et al.•The Review of Economics and…•2004

  Incluir item

• The Mythical Swing Voter

  Andrew Gelman, Sharad Goel et al.•Quarterly Journal of Political…•2016

  Incluir item

• Stubbing Our Toes for a Foot in the Door? Prior Contact, Incentives and Survey Response

  John Brehm, John M Brehm•International Journal of Public…•1994

  Incluir item

• Treatment Effect Heterogeneity in Theory and Practice

  Open Access•Joshua D Angrist•The Economic Journal•2004

  Incluir item

• Experiments in Producing Nonresponse Bias

  Robert M Groves, Mick P Couper et al.•Public Opinion Quarterly•2006

  Incluir item

• Trends in Nonresponse Rates, 1952-1979

  Charlotte Steeh, Charlotte G Steeh•Public Opinion Quarterly•1981

  Incluir item

• The Impact of Nonresponse Rates on Nonresponse Bias

  Robert M Groves, Emilia Peytcheva•Public Opinion Quarterly•2008

  Incluir item

• A Theory of Nonseparable Preferences in Survey Responses

  Dean Lacy•American Journal of Political…•2001

  Incluir item

• Leverage-Saliency Theory of Survey Participation

  Robert M Groves, Eleanor Singer et al.•Public Opinion Quarterly•2000

  Incluir item

• Prepaid Monetary Incentives and Data Quality in Face-to-Face Interviews

  Michael Davern, Todd Rockwood et al.•Public Opinion Quarterly•2003

  Incluir item

• Validation

  Open Access•Stephen Ansolabehere, E Hersh•Political Analysis•2012

  Incluir item

• The Logic of the Survey Experiment Reexamined

  Open Access•Barry J Gaines, Brian J Gaines et al.•Political Analysis•2006

  Incluir item

• The Use and Effects of Incentives in Surveys

  Open Access•Eleanor Singer, Cong Ye•The Annals of the American…•2013

  Incluir item

• Household Surveys in Crisis

  Open Access•Bruce D Meyer, Bruce Meyer et al.•The Journal of Economic…•2015

  Incluir item