Amazon's Mechanical Turk
A New Source of Inexpensive, Yet High-Quality, Data?
Bibliographic Data
| ID | 23313329 |
|---|---|
| Authors | Michael D Buhrmester (0000-0002-9892-3334, The University of Texas at Austin), Michael Buhrmester (Department of Psychology, University of Texas at Austin), Tracy Kwang (The University of Texas at Austin), Samuel D Gosling (0000-0001-8970-591X, The University of Texas at Austin) |
| Year | 2011 |
| Volume | 6 |
| Issue | 1 |
| Pages | 3-5 |
| Publication date | 2011-01-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Perspectives on Psychological Science (JOURNAL) |
| Journal identifiers | ISSN: 1745-6916 • E-ISSN: 1745-6924 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/1745691610393980 |
| PMID | 26162106 |
| OpenAlex | W2141708418 |
| Language | EN |
| Citations received | 2.432 |
| References cited | 10 |
Amazon’s Mechanical Turk (MTurk) is a relatively new website that contains the major elements required to conduct research: an integrated participant compensation system; a large participant pool; and a streamlined process of study design, participant recruitment, and data collection. In this article, we describe and evaluate the potential contributions of MTurk to psychology and other social sciences. Findings indicate that (a) MTurk participants are slightly more demographically diverse than are standard Internet samples and are significantly more diverse than typical American college samples; (b) participation is affected by compensation rate and task length, but participants can still be recruited rapidly and inexpensively; (c) realistic compensation rates do not affect data quality; and (d) the data obtained are at least as reliable as those obtained via traditional methods. Overall, MTurk can be used to obtain high-quality data inexpensively and rapidly.
Affect (linguistics) · Amazon rainforest · Biology · Compensation (psychology) · Data collection · Data quality · Data science · Operations management · Quality (philosophy) · Statistics · Task (project management) · The Internet · World Wide Web · Applied Psychology · Behavioral Health and Interventions · Computer Science · Digital Mental Health Interventions · Engineering · Mental Health Research Topics · Psychology · Social Psychology
Safety and Security
Smartphone Usage
Social Interaction and Interpersonal Relationships
Personality and Individual Differences
Smartphones within Psychological Science
Perception of strength from 3D faces is linked to facial cues of physique
Watch out! How a fearful face adds credibility to warnings of danger
Hamilton vs. Kant
Commitment signals in friendship and romantic relationships
Public Opinion on Prostitution Courts
The Particularistic President
Development and validation of the Female Gamer Stereotypes Scale
The role of envy in linking active and passive social media use to memory functioning
Intellectual, narcissistic, or Machiavellian? How Twitter users differ from Facebook-only users, why they use Twitter, and what they tweet about
Problematic phone use, depression, and technology interference among mothers
Client treatment preferences in psychedelic-assisted therapy for depression in participants with depressive symptoms
Does the visual salience of credit card features affect choice
Anticipated stigma, stereotypes, and Covid-19 testing
A new look at the attribution model
The soulless cycle
Mental illness as a relationship dealbreaker
Active coping efforts temper negative attributions of disability stigma
Explaining the relation between masculinity and stigma toward mental illness
The obesity stigma asymmetry model
The role of emotion dysregulation in the association between substance use stigma and depressive symptoms among trauma-exposed, substance-using individuals
It’s interpersonal
Factors linking perceived discrimination and weight bias internalization to body appreciation and eating pathology
Examining the link between socioeconomic status and mental illness prejudice
Partners and prejudice
Development of gender identity implicit association tests to assess attitudes toward transmen and transwomen
Marital status, gender, and sexual orientation
An experimental investigation of the application of binegative stereotypes
A comparison between self-identified evangelical Christians’ and nonreligious persons’ attitudes toward transgender persons
Disparagement humor and anti-obesity attitudes
Convincing conservatives
Psychological inflexibility as a mediator of the relationship between depressive symptom severity and public stigma in depression
A psychometric comparison of psychological inflexibility measures
Emerging Adults in the Military and College
Nighttime notifications and compulsivity illuminate the link between emerging adults’ cellphone use and sleep-related problems
Suicide contagion in response to widely publicized celebrity deaths
Development and validation of the Problematic Media Use Measure
Weight-related humor in the media
Narcissism and social media use
How national culture influences individuals’ subjective experience with paradoxical tensions
The Generalizability of Survey Experiments
American Men’s and Women’s Beliefs about Gender Discrimination
Conformity to Masculine Norms and Intellectual Engagement
Feeling good—and feeling bad—Affect social problem solving
What’s in a game?” Acculturation and drinking game behaviors among Asian American young adults
Imagining atheists
Testing the love thy neighbor hypothesis
The Religious and Spiritual Struggles Scale
Examining a purported association between attachment to God and scrupulosity
God’s role in suffering
The buffering effect of religiosity on the relationship between intolerance of uncertainty and depressive symptoms
The mind of the Lord
Fear of Muslims
The social significance of spirituality
Association between daily rumination and posttraumatic growth during the Covid-19 pandemic
Is Amazon’s Mechanical Turk (MTurk) a comparable recruitment source for trauma studies
Posttraumatic stress disorder symptom severity modulates avoidance of positive emotions among trauma-exposed military veterans in the community
Online crowdsourcing to study trauma and mental health symptoms in military populations
Methodological considerations for assessing trauma history via self-report
Morally injurious experiences and mental health
Development of the Healthcare Triggering Questionnaire in adult sexual abuse survivors
Women’s self-perceptions in the aftermath of trauma
The influence of trauma-related shame on the associations between posttraumatic symptoms and impulsivity facets
Impulsivity as a mediating factor in the association between posttraumatic stress disorder symptoms and substance use
The interplay of negative and positive emotion dysregulation on mental health outcomes among trauma-exposed community individuals
Posttraumatic stress disorder and deliberate self-harm among military veterans
Examining indirect effects of emotion dysregulation between PTSD symptom clusters and reckless/self-destructive behaviors
Posttraumatic stress symptoms and risky alcohol use
Examining the incremental contribution of metacognitive beliefs beyond content-specific beliefs in relation to posttraumatic stress in a community sample
PTSD symptoms and perception of cognitive problems
Social and psychological heterogeneity among binary transgender, non-binary transgender and cisgender individuals
Exploring how online political quizzes boost interest in politics, political news, and political engagement
Attitudes to in vitro meat
Measuring the Closeness of Relationships
Metaphors We Think With
A novel coding scheme for assessing responses in divergent thinking
Mappings between linguistic sound and motion
How Do Depression Medications Taken by Pilots Affect Passengers’ Willingness to Fly—A Mediation Analysis
The Doors of Social Robot Perception
Tracking the structure and sentiment of vaccination discussions on Mumsnet
Manipulated luxury-apartment ownership enhances opposite-sex attraction in females but not males
Perceiving Political Polarization in the United States
Depression, Environmental Reward, Coping Motives and Alcohol Consumption During the Covid-19 Pandemic
Psychological Impact and Compliance with Staying at Home of the Public to Covid-19 Outbreak during Chinese Spring Festival
Rethinking Cell Phone Use While Driving
A Psychometric Pilot Study Examining the Functions of Suicidal Communications Using IRT and Factor Analysis
Face Covered and Six Feet Apart
Narcissism and Social Media
Are mHealth Interventions to Improve Child Restraint System Installation of Value? A Mixed Methods Study of Parents
Validation of the Covid-19 Transmission Misinformation Scale and Conditional Indirect Negative Effects on Wearing a Mask in Public
Revealing the Preference Falsification in Russia
Individual Choose-to-Transmit Decisions Reveal Little Preference for Transmitting Negative or High-Arousal Content
Development and Validation of a Porous Theory of Mind Scale
Piercing the Smoke Screen
Pregaming among Latina/o emerging adults
My worst faults and misdeeds
Society and the Adolescent Self-Image
The weirdest people in the world?
A very brief measure of the Big-Five personality domains
Support seeking and support giving within couples in an anxiety-provoking situation
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires
Social dominance orientation
The Advent of Internet Surveys for Political Research
Self-concept clarity
Stalking the perfect measure of implicit self-esteem
College sophomores in the laboratory
| Unique citing works | 2.432 |
|---|---|
| Citations per year | 152 |
| Citation span | 2010 - 2026 (17) |
| Citation velocity | current |
| Highly cited | Yes |
| Citation types | Neutral: 2.145 |