Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement

Bibliographic Data

ID7363578
AuthorsJon A Krosnick (0000-0003-0336-1613), Duane F Alwin
Year1987
Volume51
Issue2
Pages201-201
Publication date1987-01-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenuePublic Opinion Quarterly (JOURNAL)
Journal identifiersISSN: 0033-362X • E-ISSN: 1537-5331
PublisherOxford University Press (OUP) (PUBLISHER)
DOI10.1086/269029
OpenAlexW2112665044
LanguageEN
Citations received233
References cited24

Previous research has documented effects of the order in which response choices are offered to respondents using closed-ended survey items, but no theory of the psychological sources of these effects has yet been proposed. This paper offers such a theory drawn from a variety of psychological research. Using data from a split-ballot experiment in the 1984 General Social Survey involving a variant of Kohn's parental values measure, we test some predictions made by the theory about what kind of response order effect would be expected (a primacy effect) and among which respondents it should be strongest (those low in cognitive sophistication). These predictions are confirmed. We also test the “form-resistant correlation” hypothesis. Although correlations between items are altered by changes m response order, the presence and nature of the latent value dimension underlying these responses is essentially unaffected

Cognition · Cognitive psychology · Developmental psychology · Dimension (graph theory · Econometrics · Economics · Item response theory · Order (exchange · Psychometrics · Sociology · Sophistication · Statistics · Test (biology · Value (mathematics · Variety (cybernetics · Mathematics · Psychology · Psychology of Social Influence · Social and Intergroup Psychology · Social Psychology · Survey Methodology and Nonresponse

  • Sharing the love

    Open Access•Isobel K Wilson, Eva Johansen et al.•Psychology and Sexuality•2026

  • Response Alternatives

    Open Access•Norbert Schwarz, Hans‐Jürgen Hippler•Wiley Series in Probability and…•2004

  • Nonsampling Errors

    Open Access•Elizabeth A Stasny•International Encyclopedia of the…•2015

  • Collective Preferences in Democratic Politics

    Open Access•Scott L Althau, Scott L Althaus•Collective Preferences in…•2003

  • The cognitive basis of trust. The relation between education, cognitive ability, and generalized and political trust

    Marc Hooghe, Sofie Marien et al.•intelligence•2012

  • Mode of questionnaire administration can have serious effects on data quality

    Ann Bowling•Journal of Public Health•2005

  • Understanding and Improving the Validity of Self-Report of Parenting

    Open Access•Sarah K Morsbach, Ronald J Prinz•Clinical Child and Family…•2006

  • Interviewer effects in public health surveys

    R E Davis, Mick P Couper et al.•Health Education Research•2010

  • The Mental Health Literacy Scale (MHLS)

    Open Access•Matt O’Connor, Leanne M Casey et al.•Psychiatry Research•2015

  • Designing and testing questionnaires for children

    Open Access•Alice Bell•Journal of Research in Nursing•2007

  • Strengths use, self-concordance and well-being

    Reena Govindji, P Alex Linley•International Coaching Psychology…•2007

  • Parents' Perceptions of Their Child's Weight and Health

    Kathryn C Eckstein, Laura M Mikhail et al.•PEDIATRICS•2006

  • Response Effects in Surveys on Children and Adolescents

    Open Access•Natacha Borgers, Dirk Sikkel et al.•Quality & Quantity•2004

  • Common Method Bias in Marketing

    Open Access•Scott B Mackenzie, Scott Mackenzie et al.•Journal of Retailing•2012

  • Pretesting survey instruments

    Open Access•Debbie Collins•Quality of Life Research•2003

  • Efectos de respuesta en encuestas administradas

    Open Access•Vidal Díaz De Rada•Papers Revista de Sociologia•2023

  • Depression and suicidality as evolved credible signals of need in social conflicts

    Open Access•Michael R Gaffney, Kai H Adams et al.•Evolution and Human Behavior•2022

  • Exploring the Impact of Modality and Speech Rate Manipulation in Voice Permission Requests—Limits of Applicability and Potential for Influencing Decision-Making

    Open Access•Anna Leschanowsky, Anastasia Sergeeva et al.•International Journal of…•2025

  • The influence of mobile augmented reality on consumer behavior

    Open Access•Lingam Naveen, Irfanuzzaman Khan et al.•Computers in Human Behavior•2025

  • Resolving the Ethical Tension Between Creating a Civil Environment and Facilitating Free Expression Online

    Open Access•Dena Yadin, Inbal Yahav et al.•Journal of Business Ethics•2024

  • Psychological Distance Matters

    Jung Min Jang, Eun Young Park•Journal of Advertising•2025

  • Assessing bias in online surveys using alternative survey modes

    Open Access•Neil H Spencer, Neil Spencer et al.•Work Organisation Labour &…•2022

  • Effects of Response Order on Likert-Type Scales

    Open Access•Li‐Jen Weng, Li-Jen Weng et al.•Educational and Psychological…•2000

  • Response-Order Effects in Likert-Type Scales

    Open Access•Jason C K Chan, Jason C Chan•Educational and Psychological…•1991

  • Improving the Factor Structure of Psychological Scales

    Open Access•Xijuan Zhang, Victoria Savalei•Educational and Psychological…•2016

  • Experimental evidence about deficit reduction strategies

    Open Access•Jennifer N Dineen, Jennifer Dineen et al.•Journal of Public Budgeting…•2017

  • Response Effects in Surveys

    Hans‐j Hippler, Hans-J Hippler et al.•Social Information Processing and…•1987

  • A Telescope on Society

    Open Access•James S House, Eleanor Singer et al.•A telescope on society•2004

  • Context effects in Internet surveys

    Jolene D Smyth, Don A Dillman et al.•The Oxford Handbook Of Internet…•2012

  • From Childbearing to Childrearing

    Duane F Alwin•Population and Development Review•1996

  • Improving ability measurement in surveys by following the principles of IRT

    Open Access•M Ken Cor, Edward Haertel et al.•Social Science Research•2012

  • Disentangling mode-specific selection and measurement bias in social surveys

    Barry Schouten, Jan Van Den Brakel et al.•Social Science Research•2013

  • Conversational conventions, order of information acquisition, and the effect of base rates and individuating information on social judgments

    Jon A Krosnick, Fan Li et al.•Journal of Personality and Social…•1990

  • Some dynamic properties of attitude structures

    Charles M Judd, Roger A Drake et al.•Journal of Personality and Social…•1991

  • Religion Data from Australia's 2016 Census

    Open Access•David J Graham•Journal for the Scientific Study…•2021

  • Det mindst ringe spørgeskema

    Henning Olsen•Dansk Sociologi•1998

  • Designing Effective Web Surveys

    Open Access•Mick P Couper, Mick Couper•Designing Effective Web Surveys•2008

  • Response strategies for coping with the cognitive demands of attitude measures in surveys

    Open Access•Jon A Krosnick•Applied Cognitive Psychology•1991

  • The effect of response order on candidate viewing behaviour and item difficulty in a multiple-choice listening test

    Open Access•Franz Holzknecht, Gareth McCray et al.•Language Testing•2021

  • A Measurement Model for Likert Responses That Incorporates Response Time

    Pere J Ferrando, Urbano Lorenzo‐Seva et al.•Multivariate Behavioral Research•2007

  • Survey breakoffs during conflict

    Open Access•Ken Brackstone, Olga Maslovskaya et al.•International Journal of Social…•2026

  • A Quantum Walk Model For Emotion Transmission In Serial Reproduction Of Narratives

    Jiaqi Huang, Jiaqi Adam Huang et al.•2022

  • Measuring particularized trust

    Open Access•B G Robbins•Social Networks•2023

  • The affective antecedents of cognitive social network activation

    Open Access•Catherine T Shea, Catherine Shea et al.•Social Networks•2015

  • Perceptions of Emirati Youths on National Service at Initial Implementation Stage

    Open Access•Hwee Ling Lim•SAGE Open•2018

  • Déterminer l’origine des innovations institutionnelles

    Open Access•Mathias Rull Jan•SociologieS•2022

  • Social Information Processing and Survey Methodology

    Open Access•Hans-J Hippler, Norbert Schwarz et al.•Social Information Processing and…•1987

  • Paradoxical’ decline? Another look at the relative reduction in female happiness

    Open Access•Chris M Herbst•Journal of Economic Psychology•2011

  • Are attitudes toward labeling nano products linked to attitudes toward GMO? Exploring a potential ‘spillover’ effect for attitudes toward controversial technologies

    Open Access•Heather Akin, Sara K Yeo et al.•Journal of Responsible Innovation•2018

  • Comparing Barriers and Facilitators to Physical ActivityAmong Underrepresented Minorities

    Open Access•Rafael A Alamilla, Navin Kaushal et al.•International Journal of…•2025

  • Measured, opportunistic, unexpected and naïve quitting

    Open Access•A L Smith, Stacy M Carter et al.•BMC Public Health•2017

  • The effects of response option order and question order on self-rated health

    Open Access•Dana Garbarski, Nora Cate Schaeffer et al.•Quality of Life Research•2014

  • Readability estimates for commonly used health-related quality of life surveys

    Open Access•Sylvia H Paz, Honghu Liu et al.•Quality of Life Research•2009

  • The effect of response option order on self-rated health

    Open Access•Dana Garbarski, Nora Cate Schaeffer et al.•Quality of Life Research•2016

  • The inclusion of ‘then-test’ questions in post-test questionnaires alters post-test responses

    Open Access•Sandra Nolte, Gerald R Elsworth et al.•Quality of Life Research•2011

  • Clarifying quality of life assessment

    Open Access•Elsbeth F Bloem, Florence J Van Zuuren et al.•Quality of Life Research•2008

  • Distal order effects in stated preference surveys

    Open Access•Beilei Cai, Trudy Ann Cameron et al.•Ecological Economics•2011

  • The whole is more than the sum of its parts – assessing writing using the consensual assessment technique

    Daniela Zahn, Ursula Canton et al.•Studies in Higher Education•2021

  • Off the grid and on the fence

    Open Access•Jennifer I Schmidt, Michelle Wilber et al.•Energy Research & Social Science•2025

  • Exploring Chinese folk religion

    Open Access•Chunni Zhang, Yunfeng Lu et al.•Chinese Journal of Sociology•2021

  • Measurements of cognitive skill by survey mode

    Open Access•Anthony Gooch•Research & Politics•2015

  • Self-coding

    Open Access•Rebecca A Glazier, Amber E Boydstun et al.•Research & Politics•2021

  • Order effects of ballot position without information-induced confirmatory bias

    Open Access•Andrew Johnson, Andrew J Johnson et al.•British Politics•2011

  • Examining employee willingness to execute shared leadership

    Open Access•Henrico Van Roekel•Leadership•2023

  • Communicating emotion with animated text

    Open Access•Sabrina Malik, Jonathan Aitken et al.•Visual Communication•2009

  • Öffentliche Unterstützung von Reformen und ihre Stabilität in Zeiten der Eurokrise – eine experimentelle Untersuchung der Wirksamkeit von Gegenargumenten

    Elena Frech, Thomas König et al.•Zeitschrift für Politikwissenschaft•2015

  • Testing different rank order question layouts for PC and smartphone respondents

    Melanie Revilla, Mick P Couper•International Journal of Social…•2018

  • Investigation of alternative interface designs for long-list questions–the case of a computer-assisted survey in Germany

    Jessica M E Herzing•International Journal of Social…•2020

  • The silence of numbers

    Henning Olsen•International Journal of Social…•2002

  • The impact of response options ordering on respondents’ answers to rating questions

    Evgeniy Terentev, Natalia Maloshonok•International Journal of Social…•2018

  • Scale direction effects in agree/disagree and item-specific questions

    Jan Karem Höhne, Dagmar Krebs•International Journal of Social…•2017

  • Impact of Situational Factors on Survey Measured Fear of Crime

    Joel Miller•International Journal of Social…•2008

  • Who says what” in multiple choise questions. A comprehensive exploratory analysis protocol

    María Isabel Landaluce Calvo, M Landaluce-Calvo et al.•International Journal of Social…•2020

  • Self-report questionnaires scrutinised

    Margot Chauliac, Leen Catrysse et al.•International Journal of Social…•2022

  • Advancing the study of political cleavages through experimentation

    Adrienne Davidson, Matthew Lesch et al.•Regional & Federal Studies•2017

  • Asking Questions About Behavior

    Open Access•Norbert Schwarz, Daphna Oyserman•American Journal of Evaluation•2001

  • Asking questions about behavior

    Open Access•Norbert Schwarz•American Journal of Evaluation•2001

  • Primacy and Recency Effects on Clicking Behavior

    Open Access•Jamie Murphy, Charles F Hofacker et al.•Journal of Computer-Mediated…•2006

  • Addressing Measurement Errors in Ranking Questions for the Social Sciences

    Open Access•Yuki Atsusaka, Seo-Young Silvia Kim•Political Analysis•2025

  • Providing Information in Public Opinion Surveys

    Daan Van Knippenberg, D v Knippenberg et al.•International Journal of Public…•1996

  • How Do Real and Falsified Data Differ? Psychology of Survey Response as a Source of Falsification Indicators in Face-to-Face Surveys

    Natalja Menold, Christoph J Kemper•International Journal of Public…•2013

  • Answering Without Reading

    Eva Anduiza, Carol Galais•International Journal of Public…•2016

  • Why Do Respondents Break Off Web Surveys and Does It Matter? Results From Four Follow-up Surveys

    Markus Steinbrecher, Joss Roßmann et al.•International Journal of Public…•2014

  • Stability of Willingness-to-Pay for Coastal Management

    Open Access•Yvonne Matthews, Riccardo Scarpa et al.•Ecological Economics•2017

  • Left Feels Right

    Open Access•Timo Lenzner, Lars Kaczmirek et al.•Social Science Computer Review•2014

  • Comparison of Smartphone and Online Computer Survey Administration

    Open Access•Tom Wells, Justin T Bailey et al.•Social Science Computer Review•2013

  • Do Distractions During Web Survey Completion Affect Data Quality? Findings From a Laboratory Experiment

    Open Access•Alexander Wenz•Social Science Computer Review•2019

  • Effective Sampling From Social Media Sites and Search Engines for Web Surveys

    Open Access•Michael J Stern, Michael Stern et al.•Social Science Computer Review•2016

  • What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts Done

    Open Access•Melanie Revilla, Claudia Ochoa et al.•Social Science Computer Review•2014

  • Respondent Conditioning in Online Panel Surveys

    Open Access•Bella Struminskaya•Social Science Computer Review•2015

  • Dynamic Instructions in Check-All-That-Apply Questions

    Open Access•Tanja Kunz, Marek Fuchs•Social Science Computer Review•2018

  • Horizontal or Vertical? The Effects of Visual Orientation of Categorical Response Options on Survey Responses in Web Surveys

    Open Access•Jingwei Hu•Social Science Computer Review•2019

  • Data Quality in PC and Mobile Web Surveys

    Open Access•Aigul Mavletova•Social Science Computer Review•2013

  • The Effect of Seriousness and Device Use on Data Quality

    Open Access•Anne‐Roos Verbree, Anne-Roos Verbree et al.•Social Science Computer Review•2019

  • What They See Is What We Get

    Open Access•Mick P Couper, Roger Tourangeau et al.•Social Science Computer Review•2004

  • Investigating Response Patterns Across Surveys

    Open Access•Frank Bais, Barry Schouten et al.•Bulletin of Sociological…•2020

  • Investigating Interviewer Falsifications – A Quasi-experimental Design

    Open Access•Uta Landrock•Bulletin of Sociological…•2017

  • Considering Dialect in Survey Research

    Open Access•Isabelle Renschler, Brian Kleiner et al.•Bulletin of Sociological…•2013

  • Response Latency as an Indicator of Optimizing in Online Questionnaires

    Open Access•Mario Callegaro, Yongwei Yang et al.•Bulletin of Sociological…•2009

  • Survey Methods

    Open Access•Meadhbh Maguire•Journal of Planning Education and…•2021

  • Questions and answers in attitude surveys

    Howard Schuman•Questions and answers in attitude…•1981

  • The psychology of social norms.

    Muzafer Sherif•The psychology of social norms.•1965

  • Human inference

    Richard E Nisbett•Human inference•1980

  • Social Structure and Behavior

    Robert Hauser•Social structure and behavior•1982

  • The Framing of Decisions and the Psychology of Choice

    Open Access•Amos Tversky, Daniel Kahneman•Science•1981

  • American Soldier

    Samuel A Stouffer•American Soldier•1949

  • Class and conformity

    Melvin L Kohn•Class and conformity•1977

  • Gauging Public Opinion

    Hadley Cantril•Gauging Public Opinion•1944

  • Cognitive Responses in Persuasion

    Richard E Petty, Richard Petty et al.•Cognitive Responses in Persuasion•2014

  • Models of Man

    Open Access•Martin Hollis•Models of Man•1977

  • In search of reliable persuasion effects

    David L Ronis, Et Al et al.•Journal of Personality and Social…•1977

  • Significance tests and goodness of fit in the analysis of covariance structures

    Peter M Bentler, Douglas G Bonett•Psychological Bulletin•1980

  • The Measurement of Values in Surveys

    Duane F Alwin, Jon A Krosnick•Public Opinion Quarterly•1985

  • Choosing Among 133 Candidates

    Joanne Mueller, John E Mueller•Public Opinion Quarterly•1970

  • Why an Order Effect

    Sam L Becker•Public Opinion Quarterly•1954

  • The independence of evaluative and item information

    Elizabeth K Dreben, Susan T Fiske et al.•Journal of Personality and Social…•1979

  • Pattern of performance and ability attribution

    Edward E Jones, Leslie Rock et al.•Journal of Personality and Social…•1968

  • The Use of Pearson's with Ordinal Data

    Robert M O''Brien, Robert M O’brien et al.•American Sociological Review•1979

  • Social Class and Parental Values

    Melvin L Kohn•American Sociological Review•1976

  • Recency and primacy in persuasion as a function of the timing of speeches and measurements

    Norman Miller, Donald T Campbell•Journal of Abnormal & Social…•1959

  • Primacy effects in personality impression formation

    Norman H Anderson, Alfred A Barrios•Journal of Abnormal & Social…•1961

  • Primacy versus recency in persuasion as a function of the timing of arguments and measures

    Chester A Insko•Journal of Abnormal & Social…•1964

  • The Factor Analysis of Ipsative Measures

    Open Access•David J Jackson, Duane F Alwin•Sociological Methods & Research•1980

  • Trends in Parental Socialization Values

    Duane F Alwin•American Journal of Sociology•1984

Unique citing works233
Citations per year5,97
Citation span1987 - 2026 (40)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 232

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae