Evidence of Validity Does not Rule out Systematic Bias
A Commentary on Nomological Noise and Cross-Cultural Invariance
Datos Bibliográficos
| ID | 11610728 |
|---|---|
| Autores | Ronald Fischer (0000-0002-3055-3955, Victoria University of Wellington, autor de correspondencia), Johannes A Karl (0000-0001-5166-0728, Victoria University of Wellington), Johnny R J Fontaine (0000-0002-5684-0178, Ghent University), Ype H Poortinga (Tilburg University, the Netherlands) |
| Año | 2022 |
| Volumen | 52 |
| Número | 3 |
| Páginas | 1420-1437 |
| Fecha de publicación | 2022-04-06 |
| Peer Reviewed | Sí |
| Open Access | Sí |
| Tipo | ARTICLE |
| Revista | Sociological Methods & Research (JOURNAL) |
| Identificadores de la revista | ISSN: 0049-1241 • E-ISSN: 1552-8294 |
| Editorial | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/00491241221091756 |
| OpenAlex | W4226258271 |
| Idioma | EN |
| Citas recibidas | 10 |
| Referencias citadas | 36 |
We comment on the argument by Welzel, Brunkert, Kruse and Inglehart (2021) that theoretically expected associations in nomological networks should take priority over invariance tests in cross-national research. We agree that narrow application of individual tools, such as multi-group confirmatory factor analysis with data that violates the assumptions of these techniques, can be misleading. However, findings that fit expectations of nomological networks may not be free of bias. We present supporting evidence of systematic bias affecting nomological network relationships from a) previous research on intelligence and response styles, b) two simulation studies, and c) data on the choice index from the World Value Survey (WVS). Our main point is that nomological network analysis by itself is insufficient to rule out systematic bias in data. We point out how a thoughtful exploration of sources of biases in cross-national data can contribute to stronger theory development
Confirmatory factor analysis · Econometrics · Measurement invariance · Meta-analysis · Nomological network · Statistics · Structural equation modeling · Survey data collection · Cultural Differences and Values · Mathematics · Mental Health Research Topics · Psychological Well-being and Life Satisfaction · Psychology · Social Psychology
Comparison of Psychological Data between Populations, A Measurement Perspective
Measurement invariance in the social sciences
Comparing institutional trust
Cross-cultural validation and standardization of the Impostor-Profile 30
The Mismeasure of Culture
The Human Five Factor Personality Model Is Not Appropriate for Describing Great Ape Personality
Using measurement alignment in research on adolescence involving multiple groups
Benefits of a Pragmatic Approach
Comparative Culturology and Cross-Cultural Psychology
Measurement Invariance of Human Values Across Time and Countries—An Analysis Using 11 Rounds of the European Social Survey
Margins of Error
The Psychology of Literacy
Human Cognitive Abilities
Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures
Toward a formalized account of attitudes
Structural equation modelling
A Primer to (Cross-Cultural) Multi-Group Invariance Testing Possibilities in R
The theoretical status of latent variables.
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
In Search of Golden Rules
What Explains Personality Covariation? A Test of the Socioecological Complexity Hypothesis
The Role of Measurement Quality on Practical Guidelines for Assessing Measurement and Structural Invariance
Constructs and their vicissitudes in educational and psychological measurement
On Detecting Systematic Measurement Error in Cross-Cultural Research
Response Styles in Cross-national Survey Research
Non-invariance? An Overstated Problem With Misconceived Causes
Acquiescent Response Bias as an Aspect of Cultural Communication Style
Using a Multilevel Structural Equation Modeling Approach to Explain Cross-Cultural Measurement Noninvariance
Response Styles in Rating Scales
The Effect of Familiarity with the Response Category Labels on Item Response to Likert Scales
Socially Desirable Responding
The Index of Emancipative Values
How specific are perceptual skills? A cross-cultural study of pattern reproduction
The validity and utility of selection methods in personnel psychology
Does Social Context Affect Value Structures? Testing the Within-Country Stability of Value Structures With a Functional Theory of Values
Structural Equivalence of the Values Domain Across Cultures
Adjustment for Acquiescence in the Assessment of the Construct Equivalence of Likert-Type Score Items
Structural Equivalence in Multilevel Research
Cross-Cultural Generalization and Universality
| Obras citantes distintas | 10 |
|---|---|
| Citas por año | 3,33 |
| Intervalo de citas | 2023 - 2026 (4) |
| Velocidad de citación | current |
| Altamente citado | No |
| Tipos de cita | Neutras: 8 |