A Meta-analysis of the Relative Effectiveness of the Item Count Technique Compared to Direct Questioning
Bibliographic Data
| ID | 2330998 |
|---|---|
| Authors | Jiayuan Li (0000-0003-4743-2479, South China University of Technology, corresponding author), Wim Van Den Noortgate (0000-0003-4011-219X, KU Leuven) |
| Year | 2022 |
| Volume | 51 |
| Issue | 2 |
| Pages | 760-799 |
| Publication date | 2022-05-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Sociological Methods & Research (JOURNAL) |
| Journal identifiers | ISSN: 0049-1241 • E-ISSN: 1552-8294 |
| Publisher | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/0049124119882468 |
| OpenAlex | W2994653774 |
| Language | EN |
| Citations received | 20 |
| References cited | 70 |
This article presents an updated meta-analysis of survey experiments comparing the performance of the item count technique (ICT) and the direct questioning method. After synthesizing 246 effect sizes from 54 studies, we find that the probability that a sensitive item will be selected is .089 higher when using ICT compared to direct questioning. In recognition of the heterogeneity across studies, we seek to explain this variation by means of moderator analyses. We find that the relative effectiveness of ICT is moderated by cultural orientation in the context in which ICT is conducted (collectivism vs. individualism), the valence of topics involved in the applications (socially desirable vs. socially undesirable), and the number of nonkey items. In the Discussion section, we elaborate on the methodological implications of the main findings
Collectivism · Context (archaeology) · Individualism · Information and Communications Technology · Meta-analysis · Moderation · Political science · Social desirability · Social desirability bias · Statistics · Computer Science · Mathematics · Psychology · Social Psychology · Survey Methodology and Nonresponse · Survey Sampling and Estimation Techniques
Handle with Care
Norms to be prejudiced
A Tale of Two Countries
Revisiting an “urban legend”
Social Desirability Bias in Measures of Norm Violations and Compliance during the Covid-19 Pandemic
Overestimation of Covid-19 Vaccination Coverage in Population Surveys Due to Social Desirability Bias
Horizontal inequalities, sectarian identities, and violent conflict
In Praise of Skepticism
Strategic misreporting on tax evasion
Eliciting Legal Status Through Social Media Surveys Among Immigrants—Evidence from a List Experiment, Direct Question and Stepwise Exclusion
Ethical challenges in qualitative sociology
Are Estimates of Irregular Migration Intentions Biased? Evidence from a Double List Experiment in Ethiopia
Addressing Abortion Underreporting in Surveys with the List Experiment
Improving studies of sensitive topics using prior evidence
Fear of punishment as a driver of survey misreporting and item non-response in Russia and its neighbors
Cancel Culture
Big Little Election Lies
When to Worry about Sensitivity Bias
Is it Time to Put a Moratorium on List Experiments for Domestic Violence Elicitation
Do African Americans overreport or underreport their experiences of discrimination? Evidence from list experiments
The Handbook of Research Synthesis and Meta-Analysis
Multivariate Regression Analysis for the Item Count Technique
Combining List Experiment and Direct Question Estimates of Sensitive Behavior Prevalence
Meta-analysis of multiple outcomes
Corruption perceptions vs. corruption reality
Robust variance estimation in meta‐regression with dependent effect size estimates
Three-level meta-analysis of dependent effect sizes
Disclosure of sensitive behaviors across self-administered survey modes
Conducting Meta-Analyses in R with the metafor Package
Monopoly Money
Measuring Corruption
The Psychology of Survey Response
Comparing the unmatched count technique and direct self-report for sensitive health-risk behaviors in HIV+ adults
Eliciting illegal migration rates through list randomization
Answering the Call for a Standard Reliability Measure for Coding Data
Comparing Sexual Assault Prevalence Estimates Obtained With Direct and Indirect Questioning Techniques
Measuring Social Desirability Effects on Self-Reported Turnout Using the Item Count Technique
Estimating Sensitive Behavior
List randomization for sensitive behavior
National Culture and Social Desirability Bias in Measuring Public Service Motivation
Meta-Analysis of Randomized Response Research
Body Mass Index and Physical Attractiveness
Sensitive Questions in Online Surveys
Education and Social Desirability Bias
Measuring Drug and Alcohol Use Among College Student‐Athletes
The Influence of Social Desirability Pressures on Expressed Immigration Attitudes
Sexual risk behaviors and alcohol
Vote Trafficking in Lebanon
The role of social desirability bias and racial/ethnic composition on the relation between education and attitude toward immigration restrictionism
"Racial Attitudes and the "New South
Social desirability bias in voter turnout reports
What Can We Learn with Statistical Truth Serum
Are Survey Respondents Lying about Their Support for Same-Sex Marriage? Lessons from a List Experiment
Who Lies About Electoral Gifts
A Study of the Properties of the Item Count Technique
Is Putin’s popularity real
Artificial Inflation or Deflation? Assessing the Item Count Technique in Comparative Surveys
Who gets targeted for vote-buying? Evidence from an augmented list experiment in Turkey
An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions
Affirmative Action and the Politics of Realignment
What is the relation between cultural orientation and socially desirable responding
When Grapevine News Meets Mass Media
Sensitive questions in surveys
Individualism-Collectivism
Does Islam play a role in anti-immigrant sentiment? An experimental approach
| Unique citing works | 20 |
|---|---|
| Citations per year | 3,33 |
| Citation span | 2020 - 2026 (7) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 18 |