How Do Older Adults Recruited Using MTurk Differ From Those in a National Probability Sample
Bibliographic Data
| ID | 21423261 |
|---|---|
| Authors | Aaron M Ogletree (0000-0001-8300-6966, Health Research and Evaluation, American Institutes for Research, Washington, DC, USA, corresponding author), Benjamin Katz (0000-0002-5612-7540, Virginia Tech) |
| Year | 2021 |
| Volume | 93 |
| Issue | 2 |
| Pages | 700-721 |
| Publication date | 2021-09-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | The International Journal of Aging and Human Development (JOURNAL) |
| Journal identifiers | ISSN: 0091-4150 • E-ISSN: 1541-3535 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0091415020940197 |
| PMID | 32683886 |
| OpenAlex | W3044360556 |
| Language | EN |
| Citations received | 12 |
| References cited | 32 |
A growing number of studies within the field of gerontology have included samples recruited from Amazon’s Mechanical Turk (MTurk), an online crowdsourcing portal. While some research has examined how younger adult participants recruited through other means may differ from those recruited using MTurk, little work has addressed this question with older adults specifically. In the present study, we examined how older adults recruited via MTurk might differ from those recruited via a national probability sample, the Health and Retirement Study (HRS), on a battery of outcomes related to health and cognition. Using a Latin-square design, we examined the relationship between recruitment time, remuneration amount, and measures of cognitive functioning. We found substantial differences between our MTurk sample and the participants within the HRS, most notably within measures of verbal fluency and analogical reasoning. Additionally, remuneration amount was related to differences in time to complete recruitment, particularly at the lowest remuneration level, where recruitment completion required between 138 and 485 additional hours. While the general consensus has been that MTurk samples are a reasonable proxy for the larger population, this work suggests that researchers should be wary of overgeneralizing research conducted with older adults recruited through this portal
Cognition · Health and Retirement Study · Population · Proxy (statistics) · Psychiatry · Remuneration · Sample (material) · Clinical Psychology · Computer Science · Demography · Digital Marketing and Social Media · FinTech, Crowdfunding, Digital Finance · Medicine · Mobile Crowdsensing and Crowdsourcing · Psychology · Gerontology
Intent-Based Moral Judgment in Old Age
The Association between Message Framing and Intention to Vaccinate Predictive of Hepatitis A Vaccine Uptake
Hyper-binding
Examining goal re-engagement as a mediator of longitudinal associations between awareness of age-related change and vitality in midlife and older adulthood
On the Measurement of Aging Anxiety
Psychometric Properties of the Wake Forest Physician Trust Scale with Older Adults
Understanding Age Differences in Well-Being
Relationships Between Diverse Forms of Anxiety With Intrapersonal Functioning Among Older Adults
A Differential Item Functioning Analysis of the Alternative Model of Personality Disorders Across Younger and Older Age Groups
Predicting Decisional Determinants of Physical Activity Among Older Adults
Older adults' needs and preferences for a nutrition education digital health solution
Autobiographical memory specificity in younger and older adults as a function of cue type
Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing
Using Effect Size—or Why the P Value Is Not Enough
Clustering and switching as two components of verbal fluency
Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology
Demographics and Dynamics of Mechanical Turk Workers
Attentive Turkers
Comparing Amazon’s Mechanical Turk Platform to Conventional Data Collection Methods in the Health and Medical Research Literature
The Consortium to Establish a Registry for Alzheimer's Disease (Cerad). Part I. Clinical and neuropsychological assesment of Alzheimer's disease
Amazon's Mechanical Turk
Using Mechanical Turk to Assess the Effects of Age and Spatial Proximity on Inattentional Blindness
Intertemporal Differences Among MTurk Workers
Who are these people?” Evaluating the demographic characteristics and political preferences of MTurk survey respondents
Optimism for the Future in Younger and Older Adults
Situation-Based Contingencies Underlying Wisdom-Content Manifestations
The latin square principle in the design and analysis of psychological experiments
A power primer
The Demographic and Political Composition of Mechanical Turk Samples
| Citations per year | 2.4 |
|---|---|
| Citation span | 2021 - 2026 (6) |
| Highly cited | No |