Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research
Bibliographic Data
| ID | 3359631 |
|---|---|
| Authors | Gary King (0000-0002-5327-7631, Harvard University Press), Christopher J L Murray (0000-0002-4930-9450), Christopher Murray (0000-0003-0569-8658, World Health Organization - Pakistan), Joshua A Salomon (0000-0003-3929-5515, Harvard University Press), Ajay Tandon (0000-0003-0578-7490, World Health Organization - Pakistan) |
| Year | 2004 |
| Volume | 98 |
| Issue | 1 |
| Pages | 191-207 |
| Publication date | 2004-02-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Political Science Review (JOURNAL) |
| Journal identifiers | ISSN: 0003-0554 • E-ISSN: 1537-5943 |
| Publisher | Cambridge University Press (CUP) (PUBLISHER) |
| DOI | 10.1017/s000305540400108x |
| OpenAlex | W3123667390 |
| Language | EN |
| Citations received | 379 |
| References cited | 38 |
We address two long-standing survey research problems: measuring complicated concepts, such as political freedom and efficacy, that researchers define best with reference to examples; and what to do when respondents interpret identical questions in different ways. Scholars have long addressed these problems with approaches to reduce incomparability, such as writing more concrete questions-with uneven success. Our alternative is to measure directly response category incomparability and to correct for it. We measure incomparability via respondents' assessments, on the same scale as the self-assessments to be corrected, of hypothetical individuals described in short vignettes. Because the actual (but not necessarily reported) levels of the vignettes are invariant over respondents, variability in vignette answers reveals incomparability. Our corrections require either simple recodes or a statistical model designed to save survey administration costs. With analysis, simulations, and cross-national surveys, we show how response incomparability can drastically mislead survey researchers and how our approach can alleviate this problem
Comparability · Data mining · Data science · Econometrics · Geography · Measure (data warehouse · Scale (ratio · Statistics · Survey data collection · Survey research · Vignette · Applied Psychology · Computer Science · Electoral Systems and Political Participation · Mathematics · Psychology · Social Capital and Networks · Social Power and Status Dynamics · Social Psychology
Challenging Prevailing Stereotypes About Gender Differences in Health Reporting
Side by Side, Worlds Apart
What they say and what they do
Using Multilevel Modeling to Assess Case-Mix Adjusters in Consumer Experience Surveys in Health Care
Surveys
Can Subjective Questions on Economic Welfare be Trusted? Evidence for Three Developing Countries
Frame-Of-Reference Bias In Subjective Welfare Regressions
Who Remained in Poverty, Who Moved up, and Who Fell Down? An Investigation of Poverty Dynamics in Senegal in the Late 2000s
Modeling Ordered Choices
Pisa 2018 Assessment and Analytical Framework
Self-reported health assessments in the 2002 World Health Survey
Does the predictive power of self-rated health for subsequent mortality risk vary by socioeconomic status in the US?
Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010
Assessing Intercultural Competence in Higher Education
Current research overstates American support for political violence
Global, regional, and national disability-adjusted life years (Dalys) for 306 diseases and injuries and healthy life expectancy (Hale) for 188 countries, 1990–2013
Annual Research Review
Global, regional, and national disability-adjusted life-years (Dalys) for 315 diseases and injuries and healthy life expectancy (Hale), 1990–2015
The Prevalence of Loneliness Among Adults
Corruption perceptions vs. corruption reality
Vignettes and Self-Reports of Work Disability in the United States and the Netherlands
Happiness Economics From 35 000 Feet
Differential health reporting by education level and its impact on the measurement of health inequalities among older Europeans
Rethinking the measurement of food security
Promise and Paradox
True health vs response styles
Does reporting heterogeneity bias the measurement of health disparities?
Neighbors as Negatives
Programa Edu-Car para o desenvolvimento socioemocional e de carreira
Factorial Survey Experiments in the Sociology of Education. Potentials, Pitfalls, Evaluation
Counseling students’ responsibility attributions
Exploring the measurement of political trust A multilevel observational analysis of six Swedish public agencies
Happiness and the state
Educative performance transitions in engineering students through the Covid-19 pandemic
Post-Covid-19 Transition in University Physics Courses
Measuring Happiness and Life Satisfaction amongst Swedish Citizens
How Conscious Are You of Others? Further Evidence on Relative Income and Happiness
When conflict fuels negativity. A large-scale comparative investigation of the contextual drivers of negative campaigning in elections worldwide
Longitudinal validity of self-rated health
Foreign language learning motivation and the socioeconomic status of Czech lower secondary students
Whose autonomy support is more effective? Managers' or Co‐Workers’? An experimental comparison of source and occupational context on intrinsic motivation
Technology-related teaching skills and attitudes
First-in-their-family students at university
The effect of the judge’s condition on the judgment of others’ well-being
Scenario‐Based AI Literacy Scale ( Sails )
Monopoly Money
Networked Authoritarianism and Social Media in Azerbaijan
Making Sense of the News in a Hybrid Regime
Ask me, I (Dis)agree! Acquiescence in student ratings of teaching quality in German vocational schools
From ratings to rankings
Measuring Hope
Intersubjective Meaning and Collective Action in Developing Societies
Survey Data Collection and Integration
The Cultural Logic of Politics in Mainland China and Taiwan
The Cambridge Handbook of the Capability Approach
Reclaiming Everyday Peace
China's Gilded Age
Technology, Narratives, Vignettes, and the Intercultural and Cross-Cultural Teaching Portal
Field Notes
What Level of English Proficiency Do Elementary School Teachers Need to Attain to Teach EFL? Case Studies from Korea, Taiwan, and Japan
The effect of community health worker–led education on women’s health and treatment–seeking
A Dynamic Ordered Logit Model with Fixed Effects
Extreme Response Style and the Measurement of Intra-Individual Variability in Affect
Non-technical health care quality and health system responsiveness in middle-income countries
Health and quality of life among older rural people in Purworejo District, Indonesia
‘In general, how do you feel today?’ self-rated health in the context of aging in India
Health inequalities among older men and women in Africa and Asia
Use of anchoring vignettes to evaluate health reporting behavior amongst adults aged 50 years and above in Africa and Asia – testing assumptions
Ageing and adult health status in eight lower-income countries
Recognition of psychopathology with religious content by clergy members
Double-Question Survey Measures for the Analysis of Financial Bubbles and Crashes
Limited family ties, friendship, and contextual variation in loneliness risk across 25 countries
On the comparison of group inequalities using subjective data
Is it Possible to Raise National Happiness
Is it possible to raise national happiness
The French unhappiness puzzle
Human Trafficking in Southeast Asia
How Are We Apart? Continuity and Change in the Structure of Ideological Disagreement in the American Public, 1980–2012
Physically Here, Mentally There? A Study of Transnational Links and Civic Engagement Among Migrants in the USA
Can we Rate Public Support for Democracy in a Comparable Way? Cross-National Equivalence of Democratic Attitudes in the World Value Survey
Chinese Political Attitudes and Values in Comparative Context
Estrategias de autorregulación en contextos virtuales de aprendizaje
Whiners, deniers, and self-rated health
Democracy in context
Die Wahrnehmung zur Legitimität in der EU
Bringing the state back in
Moving Together
The gender health gap in China
Pain and subjective well-being among older adults in the developing world
Health care payments in the asia pacific
Health and ageing in Nairobi’s informal settlements-evidence from the International Network for the Demographic Evaluation of Populations and Their Health (INDEPTH)
Mind matters
Towards patients’ understanding of health-related quality of life—a mixed-method study in psoriasis and multiple sclerosis
Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior
Correcting bias in self-rated quality of life
Do response styles affect the predictive validity of self-rated health among Chinese older men and women
EuroQol data for assessment of population health needs and instrument evaluation (EQ-DAPHNIE)
Anchoring vignettes for health comparisons
Differences in rating of health related quality of life on the EQ-5D-5 L between ethnic groups
Differential item functioning and health assessment
Measuring social judgments
Handbook of Modern Item Response Theory
Ordinal Data Modeling
Experimental Foundations of Political Science
Analysis of Individual Differences in Multidimensional Scaling Via an N-way Generalization of “Eckart-Young” Decomposition
A Model-Based Standardization Approach that Separates True Bias/DIF from Group Ability Differences and Detects Test Bias/DTF as well as Item Bias/DIF
Health: perception versus observation
Ideology, Party, and Voting in the U.S. Congress, 1959–1980
Health-Related Quality-of-Life Assessments in Diverse Population Groups in the United States
Assessing Extreme and Acquiescence Response Sets in Cross-Cultural Research Using Structural Equations Modeling
Recovering a Basic Space From a Set of Issue Scales
Measuring Policy Change in the U.S. Supreme Court
Comparing Interest Group Scores across Time and Chambers
Equivalence in Cross-National Research
Estimating Legislators' Preferred Points
Estimating Voter Preference Distributions from Individual-Level Voting Data
No Evidence on Directional vs. Proximity Voting
The Relationship between Information, Ideology, and Voting Behavior
Patterns of Congressional Voting
A Unified Method of Evaluating Electoral Systems and Redistricting Plans
Analyzing Incomplete Political Science Data
The Statistical Analysis of Roll Call Data
Measuring Social Judgements
The Validity of a Self-reported Delinquency Scale
Innovations in Experimental Design in Attitude Surveys
| Unique citing works | 379 |
|---|---|
| Citations per year | 17,23 |
| Citation span | 2004 - 2026 (23) |
| Citation velocity | current |
| Highly cited | Yes |
| Citation types | Neutral: 375 |