Artificial-Intelligence-Mediated Contamination in Online Research

Taxonomy, Risk Gradient, and Recommendations

Bibliographic Data

ID22434907
AuthorsZhicheng Lin (0000-0002-6864-6559, Yonsei University, corresponding author)
Year2026
Volume9
Issue3
Publication date2026-07-01
Open AccessYes
TypeARTICLE
VenueAdvances in Methods and Practices in Psychological Science (JOURNAL)
Journal identifiersISSN: 2515-2459 • E-ISSN: 2515-2467
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/25152459261454231
OpenAlexW7167794015
LanguageEN
References cited40

For 2 decades, online research has relied on a quality heuristic: Careful, coherent responding is good data. That heuristic is no longer reliable. Autonomous artificial-intelligence (AI) agents can now pass nearly all conventional quality checks, and in text-rich crowd-work tasks, reported use of large language models approaches one third. When such consultation shapes the response process itself—not just its surface expression—the resulting data appear human-generated while embedding systematic, model-shaped distortions. I synthesize emerging evidence on how AI-mediated contamination varies across research settings in prevalence, mechanism, and inferential consequence; and distinguish three contamination pathways (full delegation, partial mediation, and spillover) and three vulnerability zones (text-rich tasks at highest risk, browser-based cognitive paradigms as an emerging vulnerability, and supervised or identity-vetted settings at lower risk). Even modest contamination can shift estimated public opinion, compress attitudinal extremes, and, over time, feed back into the training data for future models. Current platform countermeasures may raise the cost of contamination but have not been independently validated under adversarial conditions. I argue for a shift from ad hoc detection to infrastructure redesign: contamination-aware sensitivity analyses, explicit stratification of data collection by evidential role, transparency norms that balance open science with adversarial robustness, and a minimum reporting checklist for online studies in vulnerable settings. I close by asking when AI mediation should be treated not as contamination but as part of the ecological baseline of human responding—a question that requires the field to specify the target cognitive system in any given study.

Adversarial system · Categorization · Cognition · Contamination · Data quality · Mediation · Computational and Text Analysis Methods · Focus Groups and Qualitative Methods · Mental Health via Writing

Tools

Open DOIOpen Access