On Detecting Systematic Measurement Error in Cross-Cultural Research
A Review and Critical Reflection on Equivalence and Invariance Tests
Datos Bibliográficos
| ID | 14257574 |
|---|---|
| Autores | Diana Boer (0009-0005-9713-6370, University of Koblenz–Landau, Germany, autor de correspondencia), Katja Hanke (GESIS-Leibniz Institute for the Social Sciences, Mannheim, Germany), Jia He (0009-0001-5362-2554, Tilburg University, the Netherlands) |
| Año | 2018 |
| Volumen | 49 |
| Número | 5 |
| Páginas | 713-734 |
| Fecha de publicación | 2018-06-01 |
| Peer Reviewed | Sí |
| Open Access | Sí |
| Tipo | ARTICLE |
| Revista | Journal of Cross-Cultural Psychology (JOURNAL) |
| Identificadores de la revista | ISSN: 0022-0221 • E-ISSN: 1552-5422 |
| Editorial | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0022022117749042 |
| OpenAlex | W2803318088 |
| Idioma | EN |
| Citas recibidas | 99 |
| Referencias citadas | 71 |
One major threat to revealing cultural influences on psychological states or processes is the presence of bias (i.e., systematic measurement error). When quantitative measures are not targeting the same construct or they differ in metric across cultures, the validity of inferences about cultural variability (and universality) is in doubt. The objectives of this article are to review what can be done about it and what is being done about it. To date, a multitude of useful techniques and methods to reduce or assess bias in cross-cultural research have been developed. We explore the limits of invariance/equivalence testing and suggest more flexible means of dealing with bias. First, we review currently available established and novel methods that reveal bias in cross-cultural research. Second, we analyze current practices in a systematic content analysis. The content analysis of more than 500 culture-comparative quantitative studies (published from 2008 to 2015 in three outlets in cross-cultural, social, and developmental psychology) aims to gauge current practices and approaches in the assessment of measurement equivalence/invariance. Surprisingly, the analysis revealed a rather low penetration of invariance testing in cross-cultural research. Although a multitude of classical and novel approaches for invariance testing is available, these are employed infrequent rather than habitual. We discuss reasons for this hesitation, and we derive suggestions for creatively assessing and handling biases across different research paradigms and designs
Cognitive psychology · Confirmatory factor analysis · Epistemology · Equivalence (formal languages) · Measurement invariance · Multitude · Physics · Psychological research · Statistics · Universality (dynamical systems) · Computer Science · Cultural Differences and Values · Mathematics · Mental Health Research Topics · Psychology · Social and Intergroup Psychology · Social Psychology
Fueling big data analytics for project success
Competence and control beliefs in three cultures
Mjerna invarijatnost nekih mjera međugrupnih odnosa izbjeglica i članova zajednice primatelja
Immigrant Youth Resilience
The WHO-5 well-being index – validation based on item response theory and the analysis of measurement invariance across 35 countries
Measuring place attachment with the Abbreviated Place Attachment Scale (Apas)
A Primer to (Cross-Cultural) Multi-Group Invariance Testing Possibilities in R
All Human, yet Different
Empirical validation study and psychometric evaluation of the properties of the populist attitudes scale for the portuguese population
Psychometric Properties of the WHO-5 Well-Being Index among Nurses during the Covid-19 Pandemic
Psychometric Properties of the Violence Exposure Scale in Ecuadorian Adolescents and Its Relationship with Child-to-Parent Violence
Automated Algorithmic Data Analysis for Confirmatory Factor Analysis and Invariance Assessment
Assessing measurement invariance of MSQOL-54 across Italian and English versions
Is the meaning of subjective well-being similar in Latin American countries? A cross-cultural measurement invariance study of the WHO-5 well-being index during the Covid-19 pandemic
Early Childhood Educators’ AI Literacy
How Does Digital Connection Shape Cultural Adaptation? Differentiated Social Media Use, Intercultural Communication Self-Efficacy, and Adaptation Among International Students in China
The way I see the world, the way I envy others
Design and Cross-Cultural Invariance of the Covid-19 Vaccine Conspiracy Beliefs Scale (Covid-VCBS) in 13 Latin American Countries
Veteran Evolution
Veteran Evolution Therapy
Veteran Evolution
Unpredictable Changes
Social motives of university students in seven countries
Interdependent happiness across age in Costa Rica, Japan, and the Netherlands
Why Full, Partial, or Approximate Measurement Invariance Are Not a Prerequisite for Meaningful and Valid Group Comparisons
Finding Clusters of Groups with Measurement Invariance
The role of parenting, self-compassion and friendships in depressive symptoms among young people in the UK and China
Towards a new operationalization of ambiguity intolerance
Investigating measurement invariance of the Emotion Regulation Questionnaire-8 (ERQ-8) across 29 countries
Dating violence among Chilean adolescents and young adults
Covid-19 anxiety, psychological well-being and preventive behaviors during the Covid-19 pandemic in Latin America and the Caribbean
Cross-cultural validation of the new version of the Coronavirus Anxiety Scale in twelve Latin American countries
Cross-cultural measurement invariance of the purpose in life test - Short form (PIL-SF) in seven Latin American countries
Development and first validation of the Pictorial Climate Emotions Test (PiCET) in a multinational sample from the Middle East
Economic Predictors of Differences in Interview Faking Between Countries
The Moderating Effect of Gender and Academic Background in Open Government Data (OGD) User Adoption and Usage
The Mismeasure of Culture
Measuring social-emotional development in schoolchildren
The Mini Version of the Level of Personality Functioning Scale-Brief Form (Mini-LPFS)
Construct Validity, Measurement Invariance, and Nomological Network of Conspiracy Mentality Questionnaire (CMQ) Across Four Different Languages
Measuring Happiness Orientations
Identification with all humanity—A test of the factorial structure and measurement invariance of the scale in five countries
My job matters
The impact of gender-role-orientations on subjective career success
Encountering 'the Other' in Religious Social Media
Identifying accurate pro‐choice and pro‐life identity labels in Spanish
Servant leadership and employee wellbeing
Power distance orientation as an antecedent of individuals’ intentions to engage in radical political action
Outgroup threat and the emergence of cohesive groups
Adolescent self‐construal across cultures
Preschool practices in Sweden, Portugal, and the United States
Using a decentering framework to create English/Spanish surveys about abortion
Harder Won and Easier Lost? Testing the Double Standard in Gender Rules in 62 Countries
Social trust and satisfaction with life
Measurement invariance of subjective social status
The structure of teaching practices across countries
Measurement invariance of non-cognitive measures in TIMSS across countries and across time. An application and comparison of Multigroup Confirmatory Factor Analysis, Bayesian approximate measurement invariance and alignment optimization approach
Can students’ attitudes towards mathematics and science be compared across countries? Evidence from measurement invariance modeling in TIMSS 2019
Cultural identity development in adult forced migrants
Assessment of Obsessive Thoughts About Covid-19 in 7 Latin American Countries
Side messages, side effects
Four Decades of Challenges by Culture to Mainstream Psychology
Principles and Practices of Methodology and Methods in Cross-Cultural Psychology
The Value of Thinking About Feelings Across Cultures
Organizational Dehumanization and Emotional Labor
Evidence of Validity Does not Rule out Systematic Bias
Differences and Similarities in the Use of Nine Emotion Regulation Strategies in Western and East-Asian Cultures
Translate Wisely! An Evaluation of Close and Adaptive Translation Procedures in an Experiment Involving Questionnaire Translation
Cultural lessons missed and learnt about religion and culture
Many analysts and few incentives
The Emotion Matching Task (EMT)
Cooking readiness in stressful times
Years of Psychological Acculturation Research
Benefits of a Pragmatic Approach
Against the Mainstream
Measurement invariance in the social sciences
Perceived Social Support from Different Sources and Adolescent Life Satisfaction Across 42 Countries/Regions
The three facets of national identity
A post-individualistic turn? Intergenerational change in self-orientation in Poland and Germany
Endogenous Institutions and Economic Outcomes
Single and Partnered Individuals’ Sexual Satisfaction as a Function of Sexual Desire and Activities
Family functioning in students of health sciences in four Latin American countries
The State Mindfulness Scale for Physical Activity
Empirical Correlates of Cosmopolitan Orientation
Religiosity Inside and Outside the Muslim World
Are you happy for me
Experiences of Discrimination and Alcohol Involvement Among Young Adults at the Intersection of Race/Ethnicity and Gender
Replication and Reproducibility in Cross-Cultural Psychology
Cross-Cultural Variations in Extreme Rejecting and Extreme Affirming Response Styles
Addressing Methodological Challenges in Culture-Comparative Research
Cross-Cultural Validity of the Grief Impairment Scale (GIS)
Measurement Invariance of Human Values Across Time and Countries—An Analysis Using 11 Rounds of the European Social Survey
Two-Dimensional Models of Cultural Differences
Why We Need to Rethink Measurement Invariance
The Necessity of Testing Measurement Invariance in Cross-Cultural Research
Assessing the Importance of Internal and External Self-Esteem and Their Relationship to Honor Concerns in Six Countries
Aferindo experiências com discriminação em múltiplos grupos sociais
Current Theories and Epistemologies of Couple Communication Center White American Modes of Interaction
Making Multimethod Latent State–Trait Models for Random and Fixed Situations Accessible
The Encyclopedia of Cross-Cultural Psychology
Cross-Cultural Psychology
Applying Multigroup Confirmatory Factor Models for Continuous Outcomes to Likert Scale Data Complicates Meaningful Group Comparisons
Facing off with Scylla and Charybdis
A practical and theoretical guide to measurement invariance in aging research
Bayesian structural equation modeling
Exploratory Structural Equation Modeling
A new look at the big five factor structure through exploratory structural equation modeling.
IRT studies of many groups
Towards an Integrated Analysis of Bias in Cross-Cultural Assessment
Multiple-Group Factor Analysis Alignment
Cultural constructions of happiness
Bias and equivalence in cross-cultural assessment
Testing for Measurement and Structural Equivalence in Large-Scale Cross-Cultural Studies
Latent Variable Modeling in Heterogeneous Populations
A Review and Synthesis of the Measurement Invariance Literature
Hierarchical Linear Models
Exploratory Structural Equation Modeling
Differences Between Tight and Loose Cultures
Structural Equations with Latent Variables
Assessing the Hypothesis of Measurement Invariance in the Context of Large-Scale International Surveys
The Psychology of Survey Response
Bias and Equivalence in Cross-Cultural Research
Testing for the Factorial Validity, Replication, and Invariance of a Measuring Instrument
Where Is Culture in Cross Cultural Research
Differences in Gender Norms Between Countries
Meaning of life as a protective factor of positive affect in acculturation
Illusions, Patterns and Pictures
The Comparability of Measurements of Attitudes toward Immigration in the European Social Survey
Testing for the equivalence of factor covariance and mean structures
Evaluating Sensitivity of Parameters of Interest to Measurement Invariance in Latent Variable Models
Using a Multilevel Structural Equation Modeling Approach to Explain Cross-Cultural Measurement Noninvariance
Response Styles in Rating Scales
Assessing Measurement Invariance in Cross‐National Consumer Research
Response-Time Measurement in Survey Research A Method for Cati and a New Look at Nonattitudes
Necessary but Insufficient
The Practice of Cross-Cultural Cognitive Interviewing
Value Orientations From the World Values Survey
Misconceptions of Measurement Equivalence
Monocultural and cross-cultural indigenous approaches
Cultural Psychology
The role of repetition in the processes of memorising and understanding
The Influence of Culture on Visual Perception
Effects of Anchoring Vignettes on Comparability and Predictive Validity of Student Self-Reports in 64 Cultures
Testing and Explaining Differences in Common and Residual Factors Across Many Countries
Personality Differences Between the United States and the Netherlands
Toward Emically Informed Cross-Cultural Comparisons
Scalar Equivalence of OPQ32
Cross-Cultural Dimensions of Meaning in the Evaluation of Events in World History
Individualism-collectivism as Descriptive Norms
The Geographic Distribution of Big Five Personality Traits
Methodological Issues in Psychological Research on Culture
A Theory of Cultural Value Orientations
| Obras citantes distintas | 99 |
|---|---|
| Citas por año | 12,38 |
| Intervalo de citas | 2018 - 2026 (9) |
| Velocidad de citación | current |
| Altamente citado | No |
| Tipos de cita | Neutras: 96 |