Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Experiments in Producing Nonresponse Bias

Bibliographic Data

ID7363583
AuthorsRobert M Groves, Mick P Couper (0000-0001-5006-9346), Stanley Presser, Eleanor Singer, Roger Tourangeau, Giorgina Piani Acosta, Lindsay D Nelson (0000-0001-5258-953X), Lindsay Nelson (0000-0002-2880-8955)
Year2006
Volume70
Issue5
Pages720-736
Publication date2006-01-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenuePublic Opinion Quarterly (JOURNAL)
Journal identifiersISSN: 0033-362X • E-ISSN: 1537-5331
PublisherOxford University Press (OUP) (PUBLISHER)
DOI10.1093/poq/nfl036
OpenAlexW2102448843
LanguageEN
Citations received63
References cited7

While nonresponse rates in household surveys are increasing in most industrialized nations, the increasing rates do not always produce nonresponse bias in survey estimates. The linkage between nonresponse rates and nonresponse bias arises from the presence of a covariance between response propensity and the survey variables of interest. To understand the covariance term, researchers must think about the common influences on response propensity and the survey variable. Three variables appear to be especially relevant in this regard: interest in the survey topic, reactions to the survey sponsor, and the use of incentives. A set of randomized experiments tests whether those likely to be interested in the stated survey topic participate at higher rates and whether nonresponse bias on estimates involving variables central to the survey topic is affected by this. The experiments also test whether incentives disproportionately increase the participation of those less interested in the topic. The experiments show mixed results in support of these key hypotheses

Covariance · Econometrics · Economics · Incentive · Non-response bias · Randomized experiment · Response bias · Selection bias · Statistics · Survey data collection · Variables · Economic and Environmental Valuation · Healthcare Policy and Management · Mathematics · Psychology · Survey Methodology and Nonresponse · Social Psychology

  • Investigating the Relationship among Prepaid Token Incentives, Response Rates, and Nonresponse Bias in a Web Survey

    Open Access•Nicholas L Parsons, Matthew J Manierre et al.•CAM•2014

  • The Effect of Topic Salience on Nonresponse, Self‐Reported Turnout and Party Choice

    Open Access•Nursel Alkoç, Anke Tresch et al.•Swiss Political Science Review•2026

  • Who is asking? The effect of survey sponsor misperception on political trust

    Open Access•Mujtaba Isani, Bernd Schlipphak•Quality & Quantity•2023

  • Match or Mismatch? Assistant Principals’ Roles and Their Perceptions of the Evaluation System

    Open Access•Anna Moyer, Ellen Goldring•Educational Administration…•2023

  • Do perceptions of the Red‐tailed Hawk indicate a human‐wildlife conflict on the island of La Gonave, Haiti

    Open Access•Justin White, Lisa M Kennedy et al.•Singapore Journal of Tropical…•2017

  • Gender and Gambling Behaviors

    Open Access•Danielle M Venne, Alissa Mazar et al.•International Journal of Mental…•2019

  • The importance of friends and family to recreational gambling, at-risk gambling, and problem gambling

    Open Access•Alissa Mazar, Richard J Williams et al.•BMC Public Health•2018

  • Effects of survey response mode, purported topic, and incentives on response rates in human dimensions of fisheries and wildlife research

    Leif Anderson, Matt Jans et al.•Human Dimensions of Wildlife•2021

  • Effects of Token Financial Incentives on Response Rates and Item Nonresponse for Mail Surveys

    Adam S Willcox, William M Giuliano et al.•Human Dimensions of Wildlife•2010

  • Low survey response! Can I still use the data

    Larry M Gigliotti, Seth J Fopma•Human Dimensions of Wildlife•2018

  • The Downward Trend of Survey Response Rates

    Teresa L Bladon•Canadian Journal of Program…•2009

  • The Quality of Data on Participation in Adult Education and Training. An Analysis of Varying Participation Rates and Patterns Under Consideration of Survey Design and Measurement Effects

    Open Access•Sarah Widany, Johannes Christ et al.•Frontiers in Sociology•2019

  • Longitudinal Research

    Mo Wang, Daniel J Beal et al.•Work Aging and Retirement•2016

  • Do Incentives Exert Undue Influence on Survey Participation? Experimental Evidence

    Open Access•Eleanor Singer, Mick P Couper•Journal of Empirical Research on…•2008

  • Improving web survey efficiency

    Open Access•C Van Mol•International Journal of Social…•2016

  • Effects of Conditional Incentives on Response Rate, Non-Response Bias and Measurement Error in a High Response-Rate Context

    Open Access•Henrik Oscarsson, Sofia Arkhede•International Journal of Public…•2019

  • An Experimental Test of Mail Surveys as a Tool for Social Inquiry in Russia

    Olga Avdeyeva, O A Avdeyeva et al.•International Journal of Public…•2012

  • The End of the (Research) World As We Know It? Understanding and Coping With Declining Response Rates to Mail Surveys

    Richard C Stedman, Nancy A Connelly et al.•Society & Natural Resources•2019

  • Asking to Speak to Another

    D W Maynard, Matthew M Hollander•Research on Language and Social…•2014

  • Effects of nonresponse and coverage problems on survey estimates of physical activity

    Philip S Brenner•Sociological Spectrum•2021

  • What Matters Most for Recruiting Teachers to Rural Hard-to-Staff Districts

    Henry Tran, Douglas A Smith•American Journal of Education•2020

  • Social isolation, survey nonresponse, and nonresponse bias

    Open Access•Megumi Watanabe, K Olson et al.•Social Science Research•2017

  • Validity of Survey Response Propensity Indicators

    Open Access•Levente Littvay, Sebastian Adrian Popa et al.•Social Science Quarterly•2013

  • More than Money

    Open Access•Eunmi Chang, Hyun Chin et al.•International Migration•2019

  • Missing Data in Sociological Research

    Open Access•Jeremy R Porter, E H Ecklund•The American Sociologist•2012

  • The ethics of corporate hypocrisy

    Open Access•Johanna Jauernig, Matthias Uhl et al.•Futures•2021

  • Consequences of Survey Nonresponse

    Open Access•Andy Peytchev•The Annals of the American…•2013

  • Designing Passwords for Web Survey Access

    Open Access•Georg-Christoph Haas, Marieke Volkert et al.•Public Opinion Quarterly•2026

  • Is Success in Obtaining Contact and Cooperation Correlated With the Magnitude of Interviewer Variance

    Ian Brunton-Smith, Patrick Sturgis et al.•Public Opinion Quarterly•2012

  • What Can Instrumental Variables Tell Us About Nonresponse In Household Surveys and Political Polls

    Open Access•Coady Wing•Political Analysis•2019

  • Nonresponse in the Dutch Time Use Survey

    Open Access•Erik Van Ingen, Ineke Stoop et al.•CAM•2009

  • What Works, What Doesn’t? Three Studies Designed to Improve Survey Response

    Open Access•Hanyu Sun, Jocelyn Newsome et al.•CAM•2020

  • Do low survey response rates bias results? Evidence from Japan

    Open Access•Ronald R Rindfu, Ronald R Rindfuss et al.•Demographic Research•2015

  • Measuring Voter Registration and Turnout in Surveys

    Open Access•Matthew K Berent, Jon A Krosnick et al.•Public Opinion Quarterly•2016

  • Explaining Political Engagement with Online Panels

    Jeffrey A Karp, Maarja Lühiste•Public Opinion Quarterly•2016

  • Nonresponse Error, Measurement Error, And Mode Of Data Collection

    Joseph W Sakshaug, Ting Yan et al.•Public Opinion Quarterly•2010

  • The Changing Role of Address-Based Sampling in Survey Research

    Vincent G Iannacchione, G Iannacchione•Public Opinion Quarterly•2011

  • Sensitive Topics and Reluctant Respondents

    Roger Tourangeau, Robert M Groves et al.•Public Opinion Quarterly•2010

  • How Much Gets You How Much? Monetary Incentives and Response Rates in Household Surveys

    Andrew Mercer, Andrew Caporaso et al.•Public Opinion Quarterly•2015

  • The Impact of Nonresponse Rates on Nonresponse Bias

    Robert M Groves, Emilia Peytcheva•Public Opinion Quarterly•2008

  • Not All Survey Effort is Equal

    Andy Peytchev, Rodney K Baxter et al.•Public Opinion Quarterly•2009

  • Does Survey Nonresponse Bias Estimates of Religious Service Attendance? Evidence from an Address-Based Sample from the Boston Area

    Open Access•Philip S Brenner•Sociology of Religion•2018

  • Foreign-Sponsorship Effects in Developing-World Surveys

    Daniel Corstange•Public Opinion Quarterly•2014

  • Multiple Imputation for Unit Nonresponse and Measurement Error

    Andy Peytchev•Public Opinion Quarterly•2012

  • Response Rates, Nonresponse Bias, and Data Quality

    Mark Meterko, Joseph D Restuccia et al.•Public Opinion Quarterly•2015

  • The Impact of Partisan Sponsorship on Political Surveys

    Roger Tourangeau, Stanley Presser et al.•Public Opinion Quarterly•2014

  • Advances in Survey Methods for the Developing World

    Noam Lupu, Kristin Michelitch•Annual Review of Political Science•2018

  • Survey Data Collection Methods and Discrepancy in the Sociological Study of Religious Congregations

    Open Access•Gary J Adler, Brad R Fulton et al.•Sociology of Religion•2020

  • Applying Responsive Survey Design to Small-Scale Surveys

    Open Access•William G Axinn, Alberto Ruy Sánchez et al.•Sociological Methods & Research•2023

  • Organizations and Survey Research

    Open Access•Brad R Fulton•Sociological Methods & Research•2018

  • Web Survey Design

    Open Access•Kevin O Shropshire, James Hawdon et al.•Sociological Methods & Research•2009

  • Using population screening for recruitment of young adults engaged in illicit drug use

    Andrew Smirnov, Robert Kemp et al.•Social Science Research•2014

  • Unequal Upsides? The Status-Based Inequalities in the Relationship Between Schedule Control and Job Pressure

    Open Access•P J Badawy•Social Problems•2024

  • Associations between meal complexity and social context in four Nordic countries

    Open Access•Nina Kahma, Johanna Mäkelä et al.•Anthropology of food•2014

  • The Use and Effects of Incentives in Surveys

    Open Access•Eleanor Singer, Cong Ye•The Annals of the American…•2013

  • Will One More Dollar Help? The Effect of Sequential Incentives on Survey Participation and Costs in a Concurrent Mixed-mode Survey

    Open Access•K Olson, Amanda Ganshert et al.•CAM•2025

  • Calling for Participation

    Open Access•D W Maynard, Jeremy Freese et al.•American Sociological Review•2010

  • Informed consent

    Open Access•Jean Martins, Jean Martin et al.•Social Science & Medicine•2007

  • The Ties That Double Bind

    Open Access•Dawn Langan Teele, Joshua L Kalla et al.•American Political Science Review•2018

  • Doctors as migration brokers in the mandatory medical screenings of immigrants to the United States

    Aptekar•New Community•2020

  • The Effect of Differential Incentives on Attrition Bias

    Open Access•Barbara Felderer, Gerrit Müller et al.•CAM•2018

  • What Affects People's Willingness to Participate in Qualitative Research? An Experimental Comparison of Five Incentives

    Open Access•Bridget Kelly, Marjorie Margolis et al.•CAM•2017

  • The Effects of Differential Interviewer Incentives on a Field Data Collection Effort

    Open Access•Jeffrey Rosen, Jeffrey A Rosen et al.•CAM•2011

  • Statistical analysis with missing data

    Roderick J A Little•Statistical analysis with missing…•2002

  • The Effects of Response Rate Changes on the Index of Consumer Sentiment

    Richard Curtin, Richard T Curtin et al.•Public Opinion Quarterly•2000

  • Consequences of Reducing Nonresponse in a National Telephone Survey

    Scott Keeter, Carolyn Miller et al.•Public Opinion Quarterly•2000

  • Nonresponse Rates and Nonresponse Bias in Household Surveys

    Robert M Groves•Public Opinion Quarterly•2006

  • Leverage-Saliency Theory of Survey Participation

    Robert M Groves, Eleanor Singer et al.•Public Opinion Quarterly•2000

  • The Role of Topic Interest in Survey Participation Decisions

    Robert M Groves, Stanley Presser et al.•Public Opinion Quarterly•2004

Unique citing works63
Citations per year3,32
Citation span2007 - 2026 (20)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 62

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae