Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and Non-Probability Samples
Bibliographic Data
| ID | 6367063 |
|---|---|
| Authors | David S Yeager (0000-0002-8522-9503, corresponding author), Jon A Krosnick (0000-0003-0336-1613, corresponding author), Linchiat Chang, Harold S Javitz (0000-0002-6370-174X), Matthew S Levendusky, Matthew Levendusky (0000-0003-3295-1276), Alberto Simpser (0000-0003-0547-8698), Rui Wang (0000-0001-7155-3356) |
| Year | 2011 |
| Volume | 75 |
| Issue | 4 |
| Pages | 709-747 |
| Publication date | 2011-01-01 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Public Opinion Quarterly (JOURNAL) |
| Journal identifiers | ISSN: 0033-362X • E-ISSN: 1537-5331 |
| Publisher | Oxford University Press (PUBLISHER • GB) |
| DOI | 10.1093/poq/nfr020 |
| OpenAlex | W2136621417 |
| Language | EN |
| Citations received | 278 |
| References cited | 62 |
This study assessed the accuracy of telephone and Internet surveys of probability samples and Internet surveys of non-probability samples of American adults by comparing aggregate survey results against benchmarks. The probability sample surveys were consistently more accurate than the non-probability sample surveys, even after post-stratification with demographics. The non-probability sample survey measurements were much more variable in their accuracy, both across measures within a single survey and across surveys with a single measure. Post-stratification improved the overall accuracy of some of the non-probability sample surveys but decreased the overall accuracy of others. Higher completion and response rates of the surveys were associated with less accuracy. Accuracy did not appear to change from 2004/2005 to 2009 for any of the methods, and these conclusions are reinforced by data collected in 2008 as well. These results are consistent with the conclusion that non-probability samples yield data that are neither as accurate as nor more accurate than data obtained from probability samples
Demographics · Environmental health · Population · Sample (material · Statistics · Survey data collection · Survey sampling · Demography · Healthcare Policy and Management · Mathematics · Medicine · Survey Methodology and Nonresponse · Urban, Neighborhood, and Segregation Studies
Socially Mediated Internet Surveys
How to study public imagination of autonomous systems
Shrinking the food-print
Women’s representation in science predicts national gender-science stereotypes
Trends in Awareness and Use of Electronic Cigarettes Among US Adults, 2010-2013
Data quality in online human-subjects research
Mass support for global climate agreements depends on institutional design
Discrimination in the United States
Forecasting elections with non-representative polls
A National Descriptive Portrait of Adolescent Relationship Abuse
Discrimination in the United States
Online, face-to-face and telephone surveys—Comparing different sampling methods in wine consumer research
A Review of Conceptual Approaches and Empirical Evidence on Probability and Nonprobability Sample Survey Research
Prevalence and pathways of recovery from drug and alcohol problems in the United States population
Trends in Electronic Cigarette Use Among U.S. Adults
Are Relational Inferences from Crowdsourced and Opt-in Samples Generalizable? Comparing Criminal Justice Attitudes in the GSS and Five Online Samples
International estimates of intended uptake and refusal of Covid-19 vaccines
Click, collect, compare
A Survey of Preferences for Estate Distribution at Death
Associations between mental health and HIV status among sexual minority and heterosexual adolescents in Nigeria
Aural Parasocial Relations
Material hardship and use of social safety net programs among LGBT adults and their families
A Cross-Sectional Study Examining Vaccine Uptake and Attitudes Among Parents Compared to Other Adults
Predicting Intentions to Vaccinate against Covid-19 and Seasonal Flu
Awareness of the presence of nicotine in the Juul Brand of e-cigarette among adolescents, young adults, and older adults in the United States
Do you have your smartphone with you? Behavioral barriers for measuring everyday activities with smartphone sensors
Can internet surveys represent the entire population? A practitioners’ analysis
Emotional Markers of Disrespect
The return of non-probability sample
Re-examination of the Possibilities and Challenges of Internet Surveys in the Social Sciences
Election worry, political identity, and subsequent physical health in the United States
An Exploratory Study of “Fake News” and Media Trust in Kenya, Nigeria and South Africa
Medical mistrust, discrimination, and Covid-19 vaccine behaviors among a national sample U.S. adults
How Citizenship Norms and Digital Media Use Affect Political Participation
It's a Matter of Trust
Environmental Risk Information Seeking
Environmental Risk (and Benefit) Information Seeking Intentions
Psychological Reactance From Reading Basic Facts on Climate Change
The influence of social media use on attitude toward suicide through psychological well-being, social isolation, and social support
Monitoring and correcting
Evaluating the Quality of Online Survey Data Collected in 2018 in the USA
It’s not my consensus
Does the Sun revolve around the Earth? A comparison between the general public and online survey respondents in basic scientific knowledge
On the limits of public engagement for the governance of emerging technologies
Seeing Media as Group Members
One Nation, Two Realities
Everyday security threats
Social Media, Web, and Panel Surveys
Web Versus Other Survey Modes
Use of Internet panels to conduct surveys
Condom Use Completeness, Perceptions, and Sexual Quality at Most Recent Sexual Event
Nonfatal Gun Use in Intimate Partner Violence
Parents’ perspectives on the inclusion of gender and sexuality diversity in K-12 schooling
The Unseen Picture
Atheists and Other Cultural Outsiders
Replication Note
Adopting a Stigmatized Label
Everything You Need to Consider When Deciding to Field a Survey of Jews
The Challenges of Local Jewish Community Studies
Religion, politics, and climate‐protective behaviors
Fear Factory
A Short Version of the Efeco Online Questionnaire for the Assessment of Executive Functions in School-Age Children
Smoking Trajectory Classes and Impact of Social Smoking Identity in Two Cohorts of U.S. Young Adults
Japanese version of the Brief Sense of Community Scale
Differences in Oral Lesions Associated with Tobacco Smoking, E-Cigarette Use and Covid-19 Infection among Adolescents and Young People in Nigeria
Covid-19 Workplace Mitigation Strategies and Employee Leave Policies Implemented during the Height of the Pandemic, United States, Fall 2020 and 2021
Female and Rural School Students Show More Positive Attitudes toward Disability during Physical Education Lessons
Differences among Male and Female Spanish Teachers on Their Self-Perceived Preparation for Inclusive Education
Preliminary Study of the Psychometric Properties of a Questionnaire to Assess Spanish Canoeists’ Perceptions of the Sport System’s Capacity for Talent Development in Women’s Canoeing
Psychometric Properties of a Questionnaire to Assess Perceptions of Corporal Expression in Future Spanish Teachers
Assessing equity in health, wealth, and civic engagement
Associations among political voting preference, high-risk health status, and preventative behaviors for Covid-19
An Innovative Method of Increasing Early Detection for Skin Cancer in Australia
Evaluating alternative survey methodologies in human dimensions of wildlife research
Declining hunter and trapper mail survey response rates between 1976 and 2020 in illinois
Patterns and Predictors of Support for Campus Gun Carrying
Interest in Over-the-Counter Access to a Progestin-Only Pill among Women in the United States
A dual-frame sampling methodology to address landline replacement in tobacco control research
Early adoption of heated tobacco products resembles that of e-cigarettes
Long-term e-cigarette use and smoking cessation
Use of e-cigarettes by individuals with mental health conditions
Public support for raising the age of sale for tobacco to 21 in the United States
Recruiting and retaining youth and young adults
Sociodemographic correlates of self-reported exposure to e-cigarette communications and its association with public support for smoke-free and vape-free policies
Increasing the dose of television advertising in a national antismoking media campaign
News consumption in France
Access to and Use of Health Care Services Among Latinos in East Los Angeles and Boyle Heights
Trivial” Topics and Rich Ties
Fee disbursements and the local acceptance of unconventional gas development
The politics of scientific consensus? Political divergence and partisanship in unconventional energy development in the United States
The social dimensions of smart meters in the United States
Linked fate, #MeToo, and political participation
Aversion, Acceptance, or Apprehension? The Effects of Gender on US Public Opinion Concerning US-Inflicted Civilian Casualties
Weighing Lives in War
You seem like a great candidate, but
Exploring the difference in participants’ factual knowledge between online and in-person survey modes
Authoritarianism and support for Trump and Clinton in the 2016 primaries
Reporting Balance Tables, Response Rates and Manipulation Checks in Experimental Research
Developing Standards for Post-Hoc Weighting in Population-Based Survey Experiments
Explaining the decision to vote
Struggles with Survey Weighting and Regression Modeling
College Sophomores in the Laboratory Redux
Randomized Controlled Trial of Audio Computer-assisted Self-Interviewing
A Critical Comparison of Three Strategies of Collecting Data from Households
The Effect of Social Desirability and Social Approval on Self-Reports of Physical Activity
Audio computer assisted self interview and face to face interview modes in assessing response bias among STD clinic patients
The 2006 Cooperative Congressional Election Study
Effects of Fear and Anger on Perceived Risks of Terrorism
Genetic Matching for Estimating Causal Effects
Web Surveys as Part of a Mixed-Mode Strategy for Populations that cannot be Contacted by E-Mail
A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey
A comparison of mail, telephone, and home interview strategies for household health surveys
The Differential Effects of Face-to-Face and Computer Interview Modes
Noncoverage and nonresponse in an Internet survey
The Validity of Self-Reported Nicotine Product Use in the 2001–2008 National Health and Nutrition Examination Survey
Comparisons of the Costs and Quality of Norms for the SF-36 Health Survey Collected by Mail Versus Telephone Interview
Self-Reported Smoking in Online Surveys
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires
The Effects of Response Rate Changes on the Index of Consumer Sentiment
Attributing Blame
Consequences of Reducing Nonresponse in a National Telephone Survey
Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey
National Surveys Via Rdd Telephone Interviewing Versus the Internet
Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires
Social desirability bias in voter turnout reports
Same-Gender Sex in the United States
Comparing Oral Interviewing with Self-Administered Computerized QuestionnairesAn Experiment
Impact of T-Acasi on Survey Measurements of Subjective Phenomena
Moral Conviction and Political Engagement
The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior
Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study
The Advent of Internet Surveys for Political Research
College sophomores in the laboratory
Measuring Political Mobilization
Estimation for Volunteer Panel Web Surveys Using Propensity Score Adjustment and Calibration Adjustment
Selection Bias in Web Surveys and the Use of Propensity Scores
The Growth of Internet Research Methods and the Reluctant Sociologist
| Unique citing works | 278 |
|---|---|
| Citations per year | 10,3 |
| Citation span | 1999 - 2026 (28) |
| Citation velocity | current |
| Highly cited | Yes |
| Citation types | Neutral: 275 |