Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

The Twilight of the Polls? A Review of Trends in Polling Accuracy and the Causes of Polling Misses

Bibliographic Data

ID14171984
AuthorsChristopher Prosser (0000-0002-2992-8190, University of Manchester), Jonathan Mellon (0000-0001-6754-203X, University of Manchester)
Year2018
Volume53
Issue4
Pages757-790
Publication date2018-10-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueGovernment and Opposition (JOURNAL)
Journal identifiersISSN: 0017-257X • E-ISSN: 1477-7053
PublisherCambridge University Press (CUP) (PUBLISHER)
DOI10.1017/gov.2018.7
OpenAlexW2775990732
LanguageEN
Citations received28
References cited90

Polls have had a number of high-profile misses in recent elections. We review the current polling environment, the performance of polls in a historical context, the mechanisms of polling error, and the causes of several recent misses in Britain and the US. Contrary to conventional wisdom, polling errors have been constant over time, although the level of error has always been substantially beyond that implied by stated margins of error. Generally, there is little evidence that voters lying about their vote intention (so-called ‘shy’ voters) is a substantial cause of polling error. Instead, polling errors have most commonly resulted from problems with representative samples and weighting, undecided voters breaking in one direction, and to a lesser extent late swings and turnout models. We conclude with a discussion of future directions for polling both in terms of fixing the problems identified and new approaches to understanding public opinion

Computer network · Context (archaeology) · Econometrics · Economics · Polling · Polling system · Twilight · Weighting · Computer Science · Electoral Systems and Political Participation · Game Theory and Voting Systems · History · Legal and Constitutional Studies · Medicine

  • Are Nonprobability Surveys Fit for Purpose

    Open Access•Jennifer Jerit, Jason Barabas•Public Opinion Quarterly•2023

  • How to Poll Runoff Elections

    Open Access•Peter Selb, Sascha Göbel et al.•Public Opinion Quarterly•2021

  • Bias and Variance in Multiparty Election Polls

    Open Access•Peter Selb, Sina Chen et al.•Public Opinion Quarterly•2023

  • A decision theoretic perspective on artificial superintelligence

    Open Access•Jeff Dominitz, Charles F Manski•Theory and Decision•2026

  • The Effect of Topic Salience on Nonresponse, Self‐Reported Turnout and Party Choice

    Open Access•Nursel Alkoç, Anke Tresch et al.•Swiss Political Science Review•2026

  • Subjective Well-Being and Populist Voting in the Netherlands

    Open Access•Martijn Burger, Susanna Eiselt•Journal of Happiness Studies•2023

  • The elusiveness of representativeness in general population surveys for alcohol

    Open Access•Jurgen Rehm, Carolin Kilian et al.•Drug and Alcohol Review•2021

  • Making online polls more accurate

    Open Access•Alberto Arletti, Maria Letizia Tanturri et al.•Frontiers in Political Science•2025

  • Professional political pollsters as a liberal democratic epistemic community

    Open Access•Nyarwi Ahmad, Eriyanto Eriyanto•Asian Journal of Comparative…•2022

  • Ethnic Autonomy as a Dual-Use Technology

    Carter Johnson•Ethnopolitics•2021

  • Blame it on turnout? Citizens’ participation and polls’ accuracy

    Open Access•Jean-François Daoust•The British Journal of Politics…•2021

  • Silent Voices or More than a Feeling? January 6th Insurrection and Racialized (Non)Attitudes

    Open Access•Conner Martinez, C Martínez Martínez et al.•The Journal of Race Ethnicity and…•2025

  • Adopting restriction

    Open Access•Fabio Ellger, Heinrich Kluver•West European Politics•2025

  • Correlation with Time Explains the Relationship between Survey Nonresponse and Mass Polarization

    Jonathan Mellon, Christopher Prosser•The Journal of Politics•2020

  • Hey Google! will New Zealand vote to legalise cannabis? Using Google Trends data to predict the outcome of the 2020 New Zealand cannabis referendum

    Open Access•Jacques Raubenheimer, Jacques Eugene Raubenheimer et al.•International Journal of Drug…•2021

  • Survey participation as a function of democratic engagement, trust in institutions, and perceptions of surveys

    Open Access•H Silber, Patricia Moy et al.•Social Science Quarterly•2022

  • Biased polls

    Open Access•Ryan L Claassen, John Barry Ryan•Acta Politica•2025

  • Think Twice before Jumping on the Bandwagon

    Open Access•Matthew Barnfield•Political Studies Review•2020

  • On the Internet, No One Knows You’re an Activist

    Open Access•D J Hopkins, Tori Gorton•Political Research Quarterly•2024

  • Evaluating nonresponse and non-sampling error trends in election studies

    Open Access•Hafsteinn Einarsson, Agnar Freyr Helgason•Electoral Studies•2025

  • Survey Nonresponse and Mass Polarization

    Open Access•Amnon Cavari, Guy Freedman•American Political Science Review•2022

  • Analyzing the Effect of Regional Modality in Polling Surveys

    Open Access•Eric Levy, Eric P Levy et al.•American Behavioral Scientist•2023

  • Should we include margins of error in public opinion polls

    Open Access•Werner Krause, Christina Gahn•European Journal of Political…•2024

  • Quebec 2018

    Open Access•Claire Durand, André Blais•Canadian Journal of Political…•2020

  • How good are the polls? Australian election predictions, 1993–2019

    Murray Goot•Australian Journal of Political…•2021

  • Pesquisas eleitorais e mudanças tardias na decisão do voto

    Open Access•Frederico Batista Pereira, Felipe Nunes•Opinião Pública•2024

  • Momentum in the polls raises electoral expectations

    Open Access•Matthew Barnfield•Electoral Studies•2023

  • Pesquisas eleitorais no Brasil

    Open Access•Fernando Meireles, Gerard Russo•Estudos Avançados•2022

  • The Routledge Handbook of Elections, Voting Behaviorand Public Opinion

    SJ Ward, RK Gibson et al.•Routledge Handbook of Elections,…•2017

  • Forecasting elections with non-representative polls

    Open Access•Wei Wang, David Rothschild et al.•International Journal of…•2015

  • The central role of the propensity score in observational studies for causal effects

    Paul R Rosenbaum, Donald B Rubin•Biometrika•1983

  • The spiral of silence

    Elisabeth Noelle-Neumann•The spiral of silence•1984

  • The Total Survey Error Approach

    Herbert F Weisberg•Total Survey Error Approach•2005

  • The Psychology of Survey Response

    Open Access•Roger Tourangeau, Lance J Rips et al.•Psychology of Survey Response•2000

  • Summary Report of the Aapor Task Force on Non-probability Sampling

    Reg Baker, J Michael Brick et al.•Journal of Survey Statistics and…•2013

  • Twitter and Facebook are not representative of the general population

    Open Access•Jonathan Mellon, Christopher Prosser•Research & Politics•2017

  • The 2001 British Election Study Internet Poll

    David Sanders, Harold D Clarke et al.•Journal of Political Marketing•2004

  • When will Nonprobability Surveys Mirror Probability Surveys? Considering Types of Inference and Weighting Strategies as Criteria for Correspondence

    Josh Pasek•International Journal of Public…•2015

  • Mode Differences Between Face-to-Face and Web Surveys

    Dirk Heerwegh•International Journal of Public…•2009

  • Hungary's "Black Sunday" of Public Opinion Research

    Tamás Bodor•International Journal of Public…•2011

  • Studying Political Behavior

    Laura B Stephenson, Jean Crête•International Journal of Public…•2010

  • New Attempts to Reduce Overreporting of Voter Turnout and Their Effects

    Open Access•Eva Zeglovits, Sylvia Kritzinger•International Journal of Public…•2013

  • Vote Recall

    Erika J Van Elsas, Rozemarijn Lubbe et al.•International Journal of Public…•2013

  • The Polls—Review

    Claire Durand, André Blais et al.•Public Opinion Quarterly•2001

  • A Review

    Vladimir Shlapentokh•Public Opinion Quarterly•1994

  • Why Did the Polls Get It Wrong in the 2015 General Election? Evaluating the Inquiry into Pre‐Election Polls

    Open Access•Paul Whiteley•The Political Quarterly•2016

  • The Effects of Response Rate Changes on the Index of Consumer Sentiment

    Richard Curtin, Richard T Curtin et al.•Public Opinion Quarterly•2000

  • Exploring the Performance of Multilevel Modeling and Poststratification with Eurobarometer Data

    Open Access•Dimiter Toshkov•Political Analysis•2015

  • Social Desirability and Response Validity

    Jeffrey A Karp, David Brockington•The Journal of Politics•2005

  • Little White Lies and Social Science Models

    Stanley Presser, Michael W Traugott et al.•Public Opinion Quarterly•1992

  • Consequences of Reducing Nonresponse in a National Telephone Survey

    Scott Keeter, Carolyn Miller et al.•Public Opinion Quarterly•2000

  • Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey

    Scott Keeter, Courtney Kennedy et al.•Public Opinion Quarterly•2006

  • Effects of Mobile versus PC Web on Survey Response Quality

    Christopher Antoun, Mick P Couper et al.•Public Opinion Quarterly•2017

  • Sensitive Topics and Reluctant Respondents

    Roger Tourangeau, Robert M Groves et al.•Public Opinion Quarterly•2010

  • National Surveys Via Rdd Telephone Interviewing Versus the Internet

    Linchiat Chang, Jon A Krosnick•Public Opinion Quarterly•2009

  • Changes in Telephone Survey Nonresponse over the Past Quarter Century

    Richard T Curtin, R Curtin et al.•Public Opinion Quarterly•2005

  • No More Wilder Effect, Never a Whitman Effect

    D J Hopkins•The Journal of Politics•2009

  • Leverage-Saliency Theory of Survey Participation

    Robert M Groves, Eleanor Singer et al.•Public Opinion Quarterly•2000

  • Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires

    Allyson L Holbrook, Melanie C Green et al.•Public Opinion Quarterly•2003

  • Theory and Practice in Nonprobability Surveys

    Andrew W Mercer, Frauke Kreuter et al.•Public Opinion Quarterly•2017

  • The State of Surveying Cell Phone Numbers in the United States

    Paul J Lavrakas, Charles D Shuttles et al.•Public Opinion Quarterly•2007

  • An Evaluation of the 2016 Election Polls in the United States

    Courtney Kennedy, Mark Blumenthal et al.•Public Opinion Quarterly•2018

  • Research Synthesis

    R Baker, Stephen J Blumberg et al.•Public Opinion Quarterly•2010

  • The Role of Topic Interest in Survey Participation Decisions

    Robert M Groves, Stanley Presser et al.•Public Opinion Quarterly•2004

  • Web Surveys

    Mick P Couper•Public Opinion Quarterly•2000

  • Social Desirability Bias in Cati, IVR, and Web Surveys

    Frauke Kreuter, Stanley Presser et al.•Public Opinion Quarterly•2008

  • Apples to Oranges or Gala versus Golden Delicious

    David Dutwin, Trent D Buskirk•Public Opinion Quarterly•2017

  • The Evolution of Election Polling in the United States

    D Sunshine Hillygus•Public Opinion Quarterly•2011

  • Measuring Americans' Issue Priorities

    David S Yeager, B Larson et al.•Public Opinion Quarterly•2011

  • Effects of Interviewer Attitudes and Behaviors on Refusal in Household Surveys

    Gabriele B Durrant, Robert M Groves et al.•Public Opinion Quarterly•2010

  • Election Predictions

    William Buchanan, William J Buchanan•Public Opinion Quarterly•1986

  • The Opinion Polls and the 1970 British General Election

    Mark Abrams•Public Opinion Quarterly•1970

  • Good Excuses

    B Duff, Brittany R L Duff et al.•Public Opinion Quarterly•2007

  • Question Wording and the House Vote Choice

    Janet M Box-Steffensmeier, Gary C Jacobson et al.•Public Opinion Quarterly•2000

  • The Polls in the 2002 French Presidential Election

    Claire Durand•Public Opinion Quarterly•2004

  • Why the 1936 Literary Digest Poll Failed

    Peverill Squire•Public Opinion Quarterly•1988

  • Missing Nonvoters and Misweighted Samples

    Jonathan Mellon, Christopher Prosser•Public Opinion Quarterly•2017

  • Comparing Strategies for Estimating Constituency Opinion from National Survey Samples

    Open Access•Chris Hanretty, Benjamin E Lauderdale et al.•Political Science Research and…•2018

  • Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison

    Open Access•Stephen Ansolabehere, Brian F Schaffner et al.•Political Analysis•2014

  • The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior

    Open Access•N Malhotra, Jon A Krosnick•Political Analysis•2007

  • Voter Turnout and the National Election Studies

    Open Access•Barry C Burden, Barry Burden•Political Analysis•2000

  • Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study

    Open Access•David Sanders, Harold D Clarke et al.•Political Analysis•2007

  • Bayesian Multilevel Estimation with Poststratification

    Open Access•David K Park, Andrew Gelman et al.•Political Analysis•2004

  • The Advent of Internet Surveys for Political Research

    Open Access•Robert P Berrens, Alok K Bohara et al.•Political Analysis•2003

  • So What Went Wrong with the Electoral System? The 2010 Election Result and the Debate About Electoral Reform

    John Curtice•Parliamentary Affairs•2010

  • A Return to Normality? How the Electoral System Operated

    John Curtice•Parliamentary Affairs•2015

  • Three Tools for Forecasting Federal Elections

    Justin Wolfers, Andrew Leigh•Australian Journal of Political…•2002

  • Extending the Use and Prediction Precision of Subnational Public Opinion Estimation

    Open Access•Lucas Leemann, Fabio Wasserfallen•American Journal of Political…•2017

  • The Distortion of Voter Recall

    Blair T Weir•American Journal of Political…•1975

  • How Should We Estimate Public Opinion in The States

    Open Access•Jeffrey R Lax, Jane H Phillips et al.•American Journal of Political…•2009

  • Memory for Past Vote

    Open Access•Hilde T Himmelweit, Marianne Jaeger Biberian et al.•British Journal of Political…•1978

  • Policy Alienation, Social Alienation and Working-Class Abstention in Britain, 1964–2010

    Open Access•Oliver Heath•British Journal of Political…•2018

  • Did Shy Trump Supporters Bias the 2016 Polls? Evidence from a Nationally-representative List Experiment

    Alexander Coppock•Statistics Politics and Policy•2017

  • Can Non-full-probability Internet Surveys Yield Useful Data? A Comparison with Full-probability Face-to-face Surveys in the Domain of Race and Social Inequality Attitudes

    Open Access•Alicia D Simmons, Lawrence D Bobo•Sociological Methodology•2015

  • Characters to Victory

    Open Access•Pete Burnap, Rachel Gibson et al.•Electoral Studies•2016

  • Election polling errors across time and space

    Open Access•Will Jennings, Christopher Wlezien•Nature Human Behaviour•2018

  • Sensitive questions in surveys

    Roger Tourangeau, Ting Yan•Psychological Bulletin•2007

  • Does survey mode matter for studying electoral behaviour? Evidence from the 2009 German Longitudinal Election Study

    Open Access•Evelyn Bytzek, Ina E Bieber et al.•Electoral Studies•2016

  • Age and Turnout in New Electorates and Peasant Societies

    Open Access•Richard G Niemi, Joel D Barkan•American Political Science Review•1987

Unique citing works28
Citations per year4,67
Citation span2020 - 2026 (7)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 28

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae