Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Color, Labels, and Interpretive Heuristics for Response Scales

Bibliographic Data

ID7363902
AuthorsRoger Tourangeau, Mick P Couper (0000-0001-5006-9346), Frederick G Conrad (0000-0002-1933-3273), Frederick Conrad (0000-0003-1805-2450)
Year2007
Volume71
Issue1
Pages91-112
Publication date2007-01-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenuePublic Opinion Quarterly (JOURNAL)
Journal identifiersISSN: 0033-362X • E-ISSN: 1537-5331
PublisherOxford University Press (OUP) (PUBLISHER)
DOI10.1093/poq/nfl046
OpenAlexW2156165061
LanguageEN
Citations received50
References cited11

We carried out two experiments to investigate how the shading of the options in a response scale affected the answers to the survey questions. The experiments were embedded in two web surveys, and they varied whether the two ends of the scale were represented by shades of the same or different hues. The experiments also varied the numerical labels for the scale points and examined responses to both unipolar scales (assessing frequency) and bipolar scales (assessing favorability). We predicted that the use of different hues would affect how respondents viewed the low end of the scale, making responses to that end seem more extreme than when the two ends were shades of the same hue. This hypothesis was based on the notion that respondents use various interpretive heuristics in assigning meaning to the visual features of survey questions. One such cue is visual similarity. When two options are similar in appearance, respondents will see them as conceptually closer than when they are dissimilar in appearance. The results were generally consistent with this prediction. When the end points of the scale were shaded in different hues, the responses tended to shift toward the high end of the scale, as compared to scales in which both ends of the scale were shaded in

Heuristics · Mathematical optimization · Natural language processing · Computer Science · Focus Groups and Qualitative Methods · Mathematics · Psychology · Survey Methodology and Nonresponse · Artificial Intelligence · Social Psychology

  • Evaluating the response effort and data quality of established political solidarity measures

    Open Access•Achim Goerres, Jan Karem Höhne•Quality & Quantity•2023

  • Context effects in Internet surveys

    Jolene D Smyth, Don A Dillman et al.•The Oxford Handbook Of Internet…•2012

  • Social and Behavioral Research and the Internet

    Marcel Das, Peter Ester et al.•Social and Behavioral Research…•2018

  • Disentangling mode-specific selection and measurement bias in social surveys

    Barry Schouten, Jan Van Den Brakel et al.•Social Science Research•2013

  • Designing Effective Web Surveys

    Open Access•Mick P Couper, Mick Couper•Designing Effective Web Surveys•2008

  • Does the format of the adult ADHD self-report scale influence screen-positive rates? A randomized controlled trial in primary care

    Open Access•Roni Kraut, Roni Y Kraut et al.•Frontiers in Psychiatry•2026

  • Response Styles in Survey Research

    Yves Van Vaerenbergh, Troy Thomas et al.•International Journal of Public…•2013

  • Toward a social psychology of survey methodology

    Open Access•Philip S Brenner•Sociology Compass•2017

  • The quality of responses to grid questions as used in Web questionnaires (compared with paper questionnaires)

    Vidal Díaz De Rada, Juan Antonio Chávez Domínguez et al.•International Journal of Social…•2014

  • Assessing the effect of questionnaire design on unit and item-nonresponse

    Open Access•Z Kmetty, Ádám Stefkovics•International Journal of Social…•2021

  • Four layouts and a finding

    James Hartley, Lucy R Betts•International Journal of Social…•2009

  • Analysis of 0 to 10-point response scales using factorial methods

    Elena Abascal Fernández, Vidal Díaz De Rada•International Journal of Social…•2013

  • From torches to trees

    Open Access•Matthias Avina, Jae‐jae Spoon•Party Politics•2024

  • A picture is worth a thousand words

    Open Access•Matthias Avina, Jae‐jae Spoon•Party Politics•2025

  • Opinions as Colors

    Open Access•Oladokun Omojola, Oscar Odiboh et al.•Qualitative Report•2018

  • Should I Stay or Should I go

    Ting Yan, Frederick G Conrad et al.•International Journal of Public…•2010

  • Midpoint Misperceptions on 1-to-10 Scales

    Lawrence J Zigerell•International Journal of Public…•2011

  • The Design of Grids in Web Surveys

    Open Access•Mick P Couper, Roger Tourangeau et al.•Social Science Computer Review•2013

  • Comparing Survey Results Obtained via Mobile Devices and Computers

    Open Access•Marika De Bruijne, Arnaud Wijnant•Social Science Computer Review•2013

  • Using Only Numeric Labels Instead of Verbal Labels

    Open Access•Tobias Gummer, Tanja Kunz•Social Science Computer Review•2020

  • Sliders for the Smart

    Open Access•Frederik Funke, Ulf-Dietrich Reips et al.•Social Science Computer Review•2010

  • Left Feels Right

    Open Access•Timo Lenzner, Lars Kaczmirek et al.•Social Science Computer Review•2014

  • Measuring Income (In)equality

    Open Access•Jan Karem Höhne, Dagmar Krebs et al.•Social Science Computer Review•2020

  • Words, Numbers, and Visual Heuristics in Web Surveys

    Open Access•Vera Toepoel, Don A Dillman•Social Science Computer Review•2010

  • Effects of Smiley Face Scales on Visual Processing of Satisfaction Questions in Web Surveys

    Open Access•Mathew Stange, Amanda R Barry et al.•Social Science Computer Review•2016

  • Horizontal or Vertical? The Effects of Visual Orientation of Categorical Response Options on Survey Responses in Web Surveys

    Open Access•Jingwei Hu•Social Science Computer Review•2019

  • Smileys, Stars, Hearts, Buttons, Tiles or Grids

    Open Access•Vera Toepoel, Brenda Vermeeren et al.•Bulletin of Sociological…•2019

  • Agree or Disagree? Cognitive Processes in Answering Contrastive Survey Questions

    Naomi Kamoen, Bregje Holleman et al.•Discourse Processes•2011

  • Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet

    Open Access•Don A Dillman, Glenn Phelps et al.•Social Science Research•2009

  • Clicking vs. Dragging

    Dirk Sikkel, R Steenbergen et al.•Public Opinion Quarterly•2014

  • Quantification of evaluations

    Open Access•Jinseok S Chun, Michael I Norton•Journal of Experimental Social…•2023

  • The Colors of the Populist Radical Right

    Open Access•Luigi Curini, Benjamin Moffitt et al.•The International Journal of…•2024

  • Effects of Design in Web Surveys

    Vera Toepoel, Marcel Das et al.•Public Opinion Quarterly•2008

  • Respondent mode choice in a smartphone survey

    Frederick G Conrad, Michael F Schober et al.•Public Opinion Quarterly•2017

  • Questions for Surveys

    Nora Cate Schaeffer, Jennifer Dykema•Public Opinion Quarterly•2011

  • Can Verbal Instructions Counteract Visual Context Effects in Web Surveys

    Vera Toepoel, Toepoel et al.•Public Opinion Quarterly•2011

  • The Effect of Labeling and Numbering of Response Scales on the Likelihood of Response Bias

    Open Access•Guy Moors, Natalia D Kieruj et al.•Sociological Methodology•2014

  • Una encuesta voluntaria y continua en la red en España

    Open Access•Pablo De Pedraza García, Kea Tijdens et al.•Revista Española de Investigaciones…•2024

  • Up Means Good

    Roger Tourangeau, Mick P Couper et al.•Public Opinion Quarterly•2013

  • The colors of ideology

    Open Access•Matteo Cm Casiraghi, Luigi Curini et al.•Party Politics•2023

  • Designing Scalar Questions for Web Surveys

    Open Access•Leah Melani Christian, Nicholas L Parsons et al.•Sociological Methods & Research•2009

  • Measurement Error Calibration in Mixed-mode Sample Surveys

    Open Access•Bart Buelens, Jan A Van Den Brakel•Sociological Methods & Research•2015

  • Rating-Scale Labeling in Online Surveys

    Open Access•Natalja Menold•Sociological Methods & Research•2020

  • Measurement properties of completely and end labeled unipolar and bipolar scales in Likert-type questions on income (in)equality

    Open Access•Jan Karem Höhne, Dagmar Krebs et al.•Social Science Research•2021

  • Fully Labeled Scales Are More Cognitively Demanding

    Open Access•Aigul Klimova, Inna F Deviatko et al.•CAM•2025

  • The effects of rating scale format on the measurement of policy attitudes in web surveys

    Open Access•Alexander Jedinger•Electoral Studies•2018

  • Lexical Similarity in Grid Questions

    Open Access•Chan Zhang, Shuaiying Cao et al.•CAM•2025

  • Are Scale Direction Effects the Same in Different Survey Modes? Comparison of a Face-to-Face, a Telephone, and an Online Survey Experiment

    Open Access•Ádám Stefkovics•CAM•2022

  • The State of Survey Methodology

    Open Access•Michael J Stern, Michael Stern et al.•CAM•2014

  • Design of Web Questionnaires

    Open Access•Vera Toepoel, Marcel Das et al.•CAM•2009

  • Designing Rating Scales for Effective Measurement in Surveys

    Open Access•Jon A Krosnick, Leandre R Fabrigar•Wiley Series in Probability and…•1997

  • Judgment in a Social Context

    Norbert Schwarz•Advances in Experimental Social…•1994

  • The Psychology of Survey Response

    Open Access•Roger Tourangeau, Lance J Rips et al.•Psychology of Survey Response•2000

  • Contrast effects in attitude judgment

    Charles M Judd, Judith M Harackiewicz•Journal of Personality and Social…•1980

  • The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions

    L M Christian, Christian Lovis et al.•Public Opinion Quarterly•2004

  • Spacing, Position, and Order

    Roger Tourangeau•Public Opinion Quarterly•2004

  • Web Surveys

    Mick P Couper•Public Opinion Quarterly•2000

  • Picture This

    Mick P Couper, Roger Tourangeau et al.•Public Opinion Quarterly•2004

  • Rating Scales

    Norbert Schwarz, Bärbel Knäuper et al.•Public Opinion Quarterly•1991

  • Formal Features of Rating Scales and the Interpretation of Question Meaning

    Norbert Schwarz, Catherine-Lune Grayson et al.•International Journal of Public…•1998

Unique citing works50
Citations per year2,78
Citation span2008 - 2026 (19)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 50

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae