Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Response Styles in Rating Scales

Evidence of Method Bias in Data From Six EU Countries

Bibliographic Data

ID7842789
AuthorsHester Van Herk (0000-0002-3503-5698, Vrije Universiteit Amsterdam, corresponding author), Ype H Poortinga (Tilburg University), T M M Verhallen (0000-0002-8130-3235, Tilburg University)
Year2004
Volume35
Issue3
Pages346-360
Publication date2004-05-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueJournal of Cross-Cultural Psychology (JOURNAL)
Journal identifiersISSN: 0022-0221 • E-ISSN: 1552-5422
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/0022022104264126
OpenAlexW2141960018
LanguageEN
Citations received103
References cited43

In cross-cultural studies with social variables such as values or attitudes, it is often assumed that differences in scores can be compared at face value. However, response styles like acquiescence and extreme response style may affect answers, particularly on rating scales. In three sets of data from marketing studies, each with representative samples fromat least threeoutofsix countries(Greece,Italy, Spain,France,Germany, andthe United Kingdom), these two response styles were found to be more present in the Mediterranean than in Northwestern Europe. Evidence for response style effects was not only found in response distributions on rating scales, but also in discrepancies of these distributions with national consumer statistics and self-reported actual behavior

Acquiescence · Affect (linguistics · Developmental psychology · Econometrics · Face value · Geography · Political science · Rating scale · Response bias · Statistics · Style (visual arts · Consumer Behavior in Brand Consumption and Identification · Cultural Differences and Values · Customer Service Quality and Loyalty · Mathematics · Psychology · Social Psychology

  • Comparison of Psychological Data between Populations, A Measurement Perspective

    Open Access•Ype H Poortinga, Hester Van Herk et al.•Online Readings in Psychology and…•2025

  • Measurement Equivalence of a Concise Customer Engagement Metric across Country, Language, and Customer Types

    D Yu, Yuxiang Yang•Public Opinion Quarterly•2015

  • Political Journalism in Comparative Perspective

    Open Access•Erik Albæk, Arjen Van Dalen et al.•Political Journalism in…•2014

  • The stability of individual response styles.

    Bert Weijters, Maggie Geuens et al.•Psychological Methods•2010

  • Emotion and lying in a non-native language

    Open Access•Catherine L Caldwell-Harris, Ayse Aycicegi-Dinn•International Journal of…•2009

  • Facts and Artefacts in the Comparison of Attitudes Among Ethnic Minorities. A Multigroup Latent Class Structure Model with Adjustment for Response Style Behavior

    Guy Moors•European Sociological Review•2004

  • Is Popular Support for Democracy Underreported? Evidence From 32 African Countries

    Open Access•Sophie Panel•International Journal of Public…•2018

  • Variations in Response Style Behavior by Response Scale Format in Attitude Research

    N D Kieruj, Guy Moors•International Journal of Public…•2010

  • The Meaning of Parental Control in Migrant, Sending, and Host Communities

    Open Access•Derya Güngör•Applied Psychology•2008

  • Effects of Online Self-Regulated Learning on Learning Ineffectiveness in the Context of Covid-19

    Open Access•Wei He, Li Zhao et al.•The International Review of…•2022

  • Student Experiences and Changing Science Interest When Transitioning from K-12 to College

    Open Access•David E Reed, Emily C Kaplita et al.•Education Sciences•2022

  • Happiness and life satisfaction

    Open Access•Giulia Greco, Cristina Fabbri et al.•Journal of Happiness Studies•2026

  • Mapping the everyday concept of disgust in five cultures

    Open Access•Inge Schweiger Gallo, Sofián El‐Astal et al.•Current Psychology•2024

  • Making public concerns tangible

    Open Access•Lyn Ellen Pleger, Katharina Guirguis et al.•Computers in Human Behavior•2021

  • Do People Agree on How Positive Emotions Are Expressed? A Survey of Four Emotions and Five Modalities Across 11 Cultures

    Open Access•Kunalan Manokara, Mirna Đurić et al.•Journal of Nonverbal Behavior•2021

  • Assessing the hierarchy of personal values among adolescents

    Open Access•Yudai Iijima, Yasuyuki Okumura et al.•Journal of Adolescence•2020

  • A re different countries equally green with envy? A comparison of the everyday concept of envy in the United States , Spain, and Germany

    Open Access•Inge Schweiger Gallo, Lucia A Görke et al.•Scandinavian Journal of Psychology•2024

  • Sources of uncertainty in functional measurement methodology

    Open Access•Sergio Cesare Masin, Michele Vicovaro•Quality & Quantity•2023

  • Cross-Cultural Applications of the New Ecological Paradigm in Protected Area Contexts

    Open Access•Leejiah Dorward, Harriet Ibbett et al.•Environment and Behavior•2024

  • Consumers' views on egg quality and preferences for responsible production – results from nine European countries

    Open Access•Charlotta Harju, Katja Lähtinen et al.•British Food Journal•2024

  • Response Styles and the Rural–Urban Divide

    Open Access•Troy Thomas, Troy D Thomas et al.•Educational and Psychological…•2013

  • A cross-cultural comparison of non-cognitive outputs towards science between Turkish and Dutch students taking into account detected person misfit

    Open Access•Asiye Şengül Avşar, Wilco H M Emons•Studies In Educational Evaluation•2021

  • Self-concept in reading

    Open Access•Danielle Lafontaine, Dominique Lafontaine et al.•Studies In Educational Evaluation•2019

  • An Item Response Theory Model for Incorporating Response Times in Forced-Choice Measures

    Open Access•Z Y Guo, Daxun Wang et al.•Educational and Psychological…•2024

  • Item Response Modeling of Forced-Choice Questionnaires

    Open Access•Anna Brown, Alberto Maydeu-Olivares et al.•Educational and Psychological…•2011

  • Generalized IRT Models for Extreme Response Style

    Open Access•Kuan‐Yu Jin, Kuan-Yu Jin et al.•Educational and Psychological…•2014

  • Measuring Response Style Stability Across Constructs With Item Response Trees

    Open Access•Allison J Ames•Educational and Psychological…•2022

  • Influence of Context on Item Parameters in Forced-Choice Personality Assessments

    Open Access•Yin Lin, Anna Brown•Educational and Psychological…•2017

  • Cohort differences in Big Five personality factors over a period of 25 years

    Iris A M Smits, Conor V Dolan et al.•Journal of Personality and Social…•2011

  • Assessing the experience of person‐centred coordinated care of people with chronic conditions in the Netherlands

    Open Access•Mieke Rijken, James Close et al.•Health Expectations•2022

  • Prediction-Based Student Evaluations of Teaching as an Alternative to Traditional Opinion-Based Evaluations

    Tania Tomes, Stephen A Coetzee et al.•Assessment & Evaluation in Higher…•2019

  • The influence of student experiences on post-graduation surveys

    Joe Hirschberg, Jenny Lye•Assessment & Evaluation in Higher…•2016

  • ‘Student experience’ surveys

    Mantz Yorke•Assessment & Evaluation in Higher…•2009

  • Measuring Response Styles Across the Big Five

    Lale Khorramdel, Matthias von Davier•Multivariate Behavioral Research•2014

  • The Impact of Item Feature and Response Preference in a Mixed-Format Design

    Hui-Fang Chen, Kuan‐Yu Jin•Multivariate Behavioral Research•2022

  • The Effects of Questionnaire Length on the Relative Impact of Response Styles in Ambulatory Assessment

    Open Access•Kilian Hasselhorn, Charlotte Ottenstein et al.•Multivariate Behavioral Research•2024

  • Item Response Modeling of Paired Comparison and Ranking Data

    Alberto Maydeu‐olivare, Anna Brown•Multivariate Behavioral Research•2010

  • Implicit motives and basic psychological needs

    Open Access•Jeanne Schuler, Nicola Baumann et al.•Journal of Personality•2019

  • Principles and Practices of Methodology and Methods in Cross-Cultural Psychology

    Open Access•Ype H Poortinga, Johnny R J Fontaine•Journal of Cross-Cultural…•2022

  • Method Bias Mechanisms and Procedural Remedies

    Open Access•Minghui Yao, Yunjie Xu•Sociological Methods & Research•2024

  • Beyond the middle

    Open Access•Kemal Kurtuluş, Cigdem Basfirinci et al.•Humanities and Social Sciences…•2026

  • Constructing a Framework for the Use of Tests Within a Developing Nation’s School System

    Elias Mpofu, Thomas Oakland et al.•International Perspectives in…•2014

  • A rasch model to test the cross-cultural validity in the positive and negative syndrome scale (PANSS) across six geo-cultural groups

    Open Access•Anzalee Khan, Christian Yavorsky et al.•BMC Psychology•2013

  • Meaningful entertainment experiences and self-transcendence

    Open Access•Diana Rieger, Lena Frischlich et al.•International Communication Gazette•2018

  • Feasibility of smartphone app-based neuropsychological tasks for screening people with subclinical depression and anxiety

    Open Access•Mingyu Jeon, Sanghun Lee et al.•Frontiers in Psychiatry•2026

  • How Attitudes toward Alcohol Policies Differ across European Countries

    Open Access•Carolin Kilian, Jurgen Manthey et al.•International Journal of…•2019

  • Factors affecting responses to Likert type questionnaires

    Open Access•Boaz Shulruf, John Hattie et al.•Social Psychology of Education•2007

  • Toward a unification of acquiescent, extreme, and midpoint response styles

    Open Access•Jia He, Fons JR van de Vijver et al.•International Journal of Cross…•2014

  • Response Styles in Cross-national Survey Research

    Open Access•Anne-Wil Harzing•International Journal of Cross…•2006

  • The effect of self-construals on perceptions of organizational events

    Open Access•Andre Pekerti, Catherine T Kwantes•International Journal of Cross…•2011

  • Responding to Adverse Situations Within Exchange Relationships

    Open Access•Olivier Furrer, Brian V Tjemkes et al.•Journal of Cross-Cultural…•2012

  • The relations of temperament reactivity and effortful control to children’s adjustment problems in China and the United States

    Q Zhou, Liliana Lengua et al.•Developmental Psychology•2009

  • Scottish, English, British

    Open Access•Carmen Llamas, Carmen Caravaca Llamas et al.•Language and Linguistics Compass•2014

  • Beyond self-reports

    Open Access•Patricia Malitzke, Stephan Schwan et al.•Acta Psychologica•2025

  • Priorities for Hepatocellular Carcinoma (HCC) Control

    John F P Bridges, Susan M Joy et al.•Journal of Comparative Policy…•2012

  • The importance of honor concerns across eight countries

    Open Access•Valeschka Martins Guerra, Roger Giner‐sorolla et al.•Group Processes & Intergroup…•2012

  • The use of differential item functioning analyses to identify cultural differences in responses to the EORTC QLQ-C30

    Open Access•Neil Scott, N W Scott et al.•Quality of Life Research•2006

  • Using quantitative methods within the Universalist model framework to explore the cross-cultural equivalence of patient-reported outcome instruments

    Open Access•Antoine Regnault, Michael Herdman•Quality of Life Research•2014

  • Engagement in learning

    Y Sakurai, Anna Parpala et al.•Compare A Journal of Comparative…•2014

  • Filtered Life Satisfaction and Its Socioeconomic Determinants in Hong Kong

    Open Access•C K Cheung, Chau-Kiu Cheung et al.•Social Indicators Research•2012

  • Estimating heterogeneous treatment effects with item‐level outcome data

    Open Access•Joshua B Gilbert, Zachary Himmelsbach et al.•Journal of Policy Analysis and…•2025

  • Dealing with Extreme Response Style in Cross-Cultural Research

    Open Access•Meike Morren, John Gelissen et al.•Sociological Methodology•2011

  • The Effect of Labeling and Numbering of Response Scales on the Likelihood of Response Bias

    Open Access•Guy Moors, Natalia D Kieruj et al.•Sociological Methodology•2014

  • Evidence of Validity Does not Rule out Systematic Bias

    Open Access•Ronald Fischer, Johannes A Karl et al.•Sociological Methods & Research•2022

  • The Situation of the Standardised Interview from the Perspective of Cognitive Approaches

    Open Access•Jiří Vinopal•Czech Sociological Review•2009

  • Perceived Efficiency and Use of Strategies for Emotion Regulation

    Open Access•Arne Vikan, Maria D G Dias et al.•Psychological Reports•2009

  • Simultaneous Administration of the Rosenberg Self-Esteem Scale in 53 Nations

    D P Schmitt, Jüri Allik•Journal of Personality and Social…•2005

  • Response Styles in Survey Research

    Yves Van Vaerenbergh, Troy Thomas et al.•International Journal of Public…•2013

  • Caveats of non-ipsatization of basic values

    Open Access•Maksim Rudnev•Journal of Research in Personality•2021

  • On Detecting Systematic Measurement Error in Cross-Cultural Research

    Open Access•Diana Boer, Katja Hanke et al.•Journal of Cross-Cultural…•2018

  • The potential of including the UK in comparisons with other European countries in research on teenage pregnancy

    Open Access•Alexandra Franz, Anke Franz et al.•Critical Social Policy•2009

  • Beyond the United States and Japan

    Open Access•Mirona Gheorghiu, Mirona A Gheorghiu et al.•Social Psychology Quarterly•2009

  • Charlemagne’s Legacy

    Open Access•Diego Dametto, Luc Vieira et al.•Social Psychology Quarterly•2024

  • Educational travel

    Open Access•Erik van ‘t Klooster, Jeroen Van Wijk et al.•Annals of Tourism Research•2008

  • The role of response biases in the relationship between students’ perceptions of their courses and their approaches to studying in higher education

    Open Access•John T E Richardson•British Educational Research…•2012

  • Consistency of extreme response style and non-extreme response style across traits

    Open Access•Eunike Wetzel, Claus H Carstensen et al.•Journal of Research in Personality•2013

  • Impact of content nonresponsivity on model fit and psychometric network characteristics

    Open Access•Gary N Burns, Ina Grau et al.•Journal of Research in Personality•2025

  • Cross-National Adolescent Multidimensional Life Satisfaction Reports

    Open Access•Rich Gilman, E Scott Huebner et al.•Journal of Youth and Adolescence•2008

  • Who's a yea‐sayer? Habitual trust and affirmative response behaviour

    Open Access•Ann-Christin Posten, Janina Steinmetz•European Journal of Social…•2022

  • An abstract mind is a principled one

    Open Access•Sinan Alper•Journal of Experimental Social…•2018

  • Physical temperature affects response behavior

    Open Access•Janina Steinmetz, Ann-Christin Posten•Journal of Experimental Social…•2016

  • Quantification of evaluations

    Open Access•Jinseok S Chun, Michael I Norton•Journal of Experimental Social…•2023

  • Apples and Oranges? The Problem of Equivalence in Comparative Research

    Open Access•Daniel Stegmueller•Political Analysis•2011

  • The impact of perceived complexity, deviation and comprehension on the appreciation of visual metaphor in advertising across three European countries

    Open Access•Margot Van Mulken, Rob Le Pair et al.•Journal of Pragmatics•2010

  • Understanding Cultural Models of Parenting

    Open Access•Bettina Lamm, H Keller•Journal of Cross-Cultural…•2007

  • Cultural Differences in Implicit Theories and Self-Perceptions of Traitedness

    Open Access•A Timothy Church, Stephanie L Willmore et al.•Journal of Cross-Cultural…•2012

  • African Cultures and the Five-Factor Model of Personality

    Open Access•Gregory Zecca, Sabrina Verardi et al.•Journal of Cross-Cultural…•2013

  • Current and Historical Antecedents of Individual Value Differences Across 195 Regions in Europe

    Open Access•Hester Van Herk, Ype H Poortinga•Journal of Cross-Cultural…•2012

  • Response Styles and Personality Traits

    Open Access•Jia He, Dave Bartram et al.•Journal of Cross-Cultural…•2014

  • Mapping the Minds of Retirement Planners

    Open Access•Douglas A Hershey, Kène Henkens et al.•Journal of Cross-Cultural…•2007

  • The Geographic Distribution of Big Five Personality Traits

    Open Access•D P Schmitt, Jüri Allik et al.•Journal of Cross-Cultural…•2007

  • Measurement Invariance, Response Styles, and Rural–Urban Measurement Comparability

    Open Access•Troy Devon Thomas, Troy Thomas et al.•Journal of Cross-Cultural…•2014

  • Differences in Empathic Concern and Perspective Taking Across 63 Countries

    Open Access•W J Chopik, Ed O''Brien et al.•Journal of Cross-Cultural…•2017

  • Psychometric Properties of the Marlowe-Crowne Social Desirability Scale in Eight African Countries and Switzerland

    Open Access•Sabrina Verardi, Donatien Dahourou et al.•Journal of Cross-Cultural…•2010

  • The Relation Between Culture and Response Styles

    Open Access•Timothy P Johnson, Timothy Johnson et al.•Journal of Cross-Cultural…•2005

  • Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (Panas)

    Open Access•Edmund R Thompson•Journal of Cross-Cultural…•2007

  • Manifestations of Autonomy and Relatedness in Mothers' Accounts of Their Ethnotheories Regarding Child Care Across Five Cultural Communities

    Open Access•Joscha Kärtner, H Keller et al.•Journal of Cross-Cultural…•2007

  • Individual-Level Cultural Factors and Use of Survey Response Styles Among Latino Survey Respondents

    Open Access•R E Davis, Sung-Hee Lee et al.•Hispanic Journal of Behavioral…•2022

  • Within- and Between-Country Value Diversity in Europe

    Open Access•Vladimir Magun, Владимир Самуилович Магун et al.•European Sociological Review•2016

  • Response Strategies and Response Styles in Cross-Cultural Surveys

    Open Access•Meike Morren, John Gelissen et al.•Cross-Cultural Research•2012

  • International encyclopedia of the social sciences.

    David L Sills•International encyclopedia of the…•1968

  • Social values and social change

    Lynn R Kahle•Social values and social change•1983

  • Methods and Data Analysis for Cross-Cultural Research

    Open Access•Fons J R Van De Vijver, Kwok Leung et al.•Methods and Data Analysis for…•2021

  • Response Style and Cross-Cultural Comparisons of Rating Scales Among East Asian and North American Students

    Open Access•C Chen, Shin-Ying Lee et al.•Psychological Science•1995

  • A Method for Synthesis of Factor Analysis Studies

    Ledyard R Tucker•1951

  • Response Styles in Marketing Research

    Open Access•Hans Baumgartner, Jan-Benedict E M Steenkamp•Journal of Marketing Research•2001

  • Measurement and Control of Response Bias

    Delroy L Paulhus•Measures of personality and…•1991

  • Further Evidence on Response Sets and Test Design

    Open Access•Lee J Cronbach•Educational and Psychological…•1950

  • Response Sets and Test Validity

    Open Access•Lee J Cronbach•Educational and Psychological…•1946

  • A Legitimate Case of Component Analysis of Ipsative Measures, and Partialling the Mean as an Alternative to Ipsatization

    Jos M F Ten Berge•Multivariate Behavioral Research•1999

  • Confirmatory Factor Analysis of Multitrait-Multimethod Self-concept Data

    Herbert W Marsh, Barbara M Byrne•Multivariate Behavioral Research•1993

  • A Cross-Cultural Study of Response Biases in Personality Measures

    Open Access•Stephanie D Grimm, A Timothy Church•Journal of Research in Personality•1999

  • Acquiescent Responding in Self-Reports

    Open Access•Eric S Knowles, Kobi T Nathan et al.•Journal of Research in Personality•1997

  • Social interest, extreme response style, and implications for adjustment

    Open Access•James E Crandall•Journal of Research in Personality•1982

  • Personality attributes associated with extreme response style

    David L Hamilton•Psychological Bulletin•1968

  • Acquiescent Response Bias as an Aspect of Cultural Communication Style

    Open Access•P B Smith•Journal of Cross-Cultural…•2004

  • Extreme Response Style in Cross-Cultural Research

    Open Access•Kl-Taek Chun, John B Campbell et al.•Journal of Cross-Cultural…•1974

  • Culture, Gender, and Response Bias

    Open Access•David Watkins, Dora N Watkins et al.•Journal of Cross-Cultural…•1995

  • Assessing Extreme and Acquiescence Response Sets in Cross-Cultural Research Using Structural Equations Modeling

    Open Access•Gordon W Cheung, Roger B Rensvold•Journal of Cross-Cultural…•2000

  • Effects of Culture and Response Format on Extreme Response Style

    Open Access•C Harry Hui, Harry C Triandis•Journal of Cross-Cultural…•1989

  • Extreme Response Style and Acquiescence among Hispanics

    Open Access•Gerardo Marin, Raymond J Gamba et al.•Journal of Cross-Cultural…•1992

  • Assessing Measurement Invariance in Cross‐National Consumer Research

    Jan-Benedict E M Steenkamp, Jan‐Benedict E M Steenkamp et al.•Journal of Consumer Research•1998

  • Are Studies of Dark Side Variables Confounded by Socially Desirable Responding? The Case of Materialism

    David Glen Mick•Journal of Consumer Research•1996

  • Yea-Saying, Nay-Saying, and Going to Extremes

    Jerald G Bachman, Patrick M O’malley•Public Opinion Quarterly•1984

  • The Instability of Response Sets

    C Harry Hui, Harry C Triandis•Public Opinion Quarterly•1985

  • Measuring Extreme Response Style

    Eric A Greenleaf, Eric Greenleaf•Public Opinion Quarterly•1992

  • Chinese Values and the Search for Culture-Free Dimensions of Culture

    Open Access•The Chinese Culture Connection•Journal of Cross-Cultural…•1987

  • The self and social behavior in differing cultural contexts

    Harry C Triandis•Psychological Review•1989

  • Identification of content and style

    Peter M Bentler, Douglas N Jackson et al.•Psychological Bulletin•1971

  • Convergent and discriminant validation by the multitrait-multimethod matrix

    Donald T Campbell, Donald W Fiske•Psychological Bulletin•1959

  • Content and style in personality assessment

    Douglas N Jackson, Samuel Messick•Psychological Bulletin•1958

  • Multitrait-Multimethod Matrices in Consumer Research

    Richard P Bagozzi, Y Yi•Journal of Consumer Research•1991

  • A Meta-Analysis of Effect Sizes in Consumer Behavior Experiments

    Robert A Peterson, Gerald Albaum et al.•Journal of Consumer Research•1985

Unique citing works103
Citations per year4,68
Citation span2004 - 2026 (23)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 102

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae