Completion Time and Response Order Effects in Web Surveys
Bibliographic Data
| ID | 7363703 |
|---|---|
| Authors | N Malhotra (0000-0003-4477-6049, corresponding author) |
| Year | 2008 |
| Volume | 72 |
| Issue | 5 |
| Pages | 914-934 |
| Publication date | 2008-12-01 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Public Opinion Quarterly (JOURNAL) |
| Journal identifiers | ISSN: 0033-362X • E-ISSN: 1537-5331 |
| Publisher | Oxford University Press (OUP) (PUBLISHER) |
| DOI | 10.1093/poq/nfn050 |
| OpenAlex | W2134231299 |
| Language | EN |
| Citations received | 93 |
| References cited | 21 |
The use of the World Wide Web to conduct surveys has grown rapidly over the past decade, raising concerns regarding data quality, questionnaire design, and sample representativeness. This research note focuses on an issue that has not yet been studied: Are respondents who complete self-administered Web surveys more quickly—perhaps taking advantage of participation benefits while minimizing effort—also more prone to response order effects, a manifestation of “satisficing”? I surveyed a random sample of the US adult population over the Web and manipulated the order in which respondents saw the response options. I then assessed whether primacy effects were moderated by the overall length of time respondents took to complete the questionnaires. I found that low-education respondents who filled out the questionnaire most quickly were most prone to primacy effects when completing items with unipolar rating scales. These results have important implications for various aspects of Web survey methodology including panel management, human–computer interaction, and response order randomization
Business · Environmental health · Order (exchange · Population · Quality (philosophy · Representativeness heuristic · Sample (material · Satisficing · Web survey · World Wide Web · Computer Science · Focus Groups and Qualitative Methods · Medicine · Psychology · Social Media and Politics · Survey Methodology and Nonresponse · Applied Psychology · Social Psychology
Data quality in online human-subjects research
Data Collection in the Digital Age
Brief Commentary
A qualitative exploration of Australian parental perspectives of commercial squeeze pouches for infants and children
Playing the blame game
Four Paths To Misperceptions
Role of gamers’ communicative ecology on game community involvement and self-identification of gamer
Estimating preferences for Mediterranean deep-sea ecosystem services
Validating second-order model for economic welfare scale
How a “Something Else” Response Option for Sexual Identity Affects National Survey Estimates of Associations Between Sexual Identity, Reproductive Health, and Substance Use
Survey Satisficing Inflates Reliability and Validity Measures
Effects of Response Option Order on Likert-Type Psychometric Properties and Reactions
Seriousness checks are useful to improve data validity in online research
Public attitudes and values regarding a semi‐urban feral ungulate
Using paradata to improve data quality
Development of the Transferable Learning Orientations tool
Didn’t travel or just being lazy? An empirical study of soft-refusal in mobility diaries
The Moderating Effect of Cultural Tightness on the Influence of Personal Values and Social Norms on Behavior
Check the phone book
Rethinking Destination Attractiveness
The Evaluation of Statistical Process Control Methods to Monitor Interview Duration During Survey Data Collection
The bureaucratic reputation scale
Narcissism and Social Media
Nearby Nature ‘Buffers’ the Effect of Low Social Connectedness on Adult Subjective Wellbeing over the Last 7 Days
Question order sensitivity of subjective well-being measures
Consumer stated purchasing preferences and corporate social responsibility in the wood products industry
Conjoint effect of environmental labeling, disclosure of forest of origin and price on consumer preferences for wood products in the US and UK
Categorical and gradational
Voting, fast and slow
Pressure to prove
Keep your promises, even when your peers do not
Comparing Chatbots and Online Surveys for (Longitudinal) Data Collection
The mediating role of place attachment between nature connectedness and human well-being
Web Surveys in the Social Sciences
Us and Them
A Vicious Cycle? Threat of Terror, Perceived Media Bias, and Support for Surveillance Policies
Intention to Participate in Social Activism Activities in Response to Corporate Social Advocacy
Analysing the consumer purchasing behaviour for certified wood products in Italy
Investigating recruitment and completion mode biases in online and door to door electronic surveys
Improving web survey efficiency
Investigation of alternative interface designs for long-list questions–the case of a computer-assisted survey in Germany
Using memes and emoji-scales in a web survey
The impact of response options ordering on respondents’ answers to rating questions
Scale direction effects in agree/disagree and item-specific questions
Unfaithful brands
Answering Without Reading
Professional Respondents in Opt-in Online Panels
Straightlining
Using Paradata to Predict and Correct for Panel Attrition
Comparison of Smartphone and Online Computer Survey Administration
A Typology of Web Survey Paradata for Assessing Total Survey Error
Explaining Interview Duration in Web Surveys
What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts Done
Investigating Response Patterns Across Surveys
Beyond one-size-fits-all
The effect of question structure on self-reported drinking
Response Quality in Nonprobability and Probability-based Online Panels
Personality as a Predictor of Unit Nonresponse in an Internet Panel
A Convenient Truth
Displaced revenge
Surviving the screens
The Impact of Media Coverage and Motivation on Performance-Relevant Information
Do people feel more of a duty to vote in some elections
Video Content in Web Surveys
Questions for Surveys
Exploring the Effects of Removing “Too Fast” Responses and Respondents from Web Surveys
Improving Response Rates and Questionnaire Design for Mobile Web Surveys
One Language, Two Meanings
Racing the Clock
Choices Matter
Less Supervision, More Satisficing? Comparing Completely Self-Administered Web-Surveys and Interviews Under Controlled Conditions
Old versus New
Multitarea en una encuesta online prevalencia, predictores e impacto en la calidad de los datos
A randomized experiment evaluating survey mode effects for video interviewing
The Power of Humanitarian Narratives
Picking Up and Defending the Faith
The affective nexus between refugees and terrorism
Issue framing, political identities, and public support for multilateral vaccine cooperation during Covid‐19
Ballot Order in Cueless Elections
Voting Behaviour among the Gay, Lesbian, Bisexual and Transgendered Electorate
Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self‐Administered Surveys
The Upside of Accents
Measuring Generalized Trust
Religion Data from Australia's 2016 Census
Online Nonprobability Samples
Does the approach used to measure sexual identity affect estimates of health disparities differently by race? A randomized experiment from the National Survey of Family Growth
A pace of life indicator. Development and validation of a General Acceleration Scale
Religion in China
Are the Effects of Poor Survey Measurement of Sexual Identity on Estimated Associations between Sexual Identity and Health-Related Measures Moderated by the State-Level Policy Environment
Content Analysis of Spiritual Life in Contemporary USA, India, and China
Agree or Disagree
Les enquêtes par Internet en sciences sociales
Comparing Ranking Techniques in Web Surveys
Attitude Importance and Attitude Accessibility
Fast times and easy questions
Conducting Online Surveys
Response strategies for coping with the cognitive demands of attitude measures in surveys
An Evaluation of Nonresponse and Coverage Errors in a Prerecruited Probability Web Panel Survey
Explaining Response Latencies and Changing Answers Using Client-Side Paradata from a Web Survey
Web Surveys
What They See Is What We Get
Noncoverage and nonresponse in an Internet survey
Response Latency Versus Certainty as Indexes of the Strength of Voting Intentions in a Cati Survey
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Education Moderates Some Response Effects in Attitude Measurement
Spacing, Position, and Order
Web Surveys
Web Survey Design and Administration
The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior
Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study
| Unique citing works | 93 |
|---|---|
| Citations per year | 5,81 |
| Citation span | 2010 - 2026 (17) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 93 |