Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Turkopticon

Interrupting Worker Invisibility in Amazon Mechanical Turk

Bibliographic Data

ID23366306
AuthorsLilly Irani (0000-0001-8990-2411, University of California, Irvine), Lilly C Irani (University of California - Irvine, Irvine, CA, USA), M Six Silberman (0009-0004-7693-8457, Bureau of Economic Analysis)
Year2013
Pages611-620
Publication date2013-04-27
Peer ReviewedYes
Open AccessYes
TypeCONFERENCE
VenueProceedings of the SIGCHI Conference on Human Factors in Computing Systems (CONFERENCE)
PublisherACM (PUBLISHER)
DOI10.1145/2470654.2470742
OpenAlexW2147603330
LanguageEN
Citations received138
References cited27

As HCI researchers have explored the possibilities of human computation, they have paid less attention to ethics and values of crowdwork. This paper offers an analysis of Amazon Mechanical Turk, a popular human computation system, as a site of technically mediated worker-employer relations. We argue that human computation currently relies on worker invisibility. We then present Turkopticon, an activist system that allows workers to publicize and evaluate their relationships with employers. As a common infrastructure, Turkopticon also enables workers to engage one another in mutual aid. We conclude by discussing the potentials and challenges of sustaining activist technologies that intervene in large, existing socio-technical systems.

Computation · Data science · Engineering ethics · Internet privacy · Invisibility · Sociology · Artificial Intelligence · Computer Science · Engineering · Ethics and Social Impacts of AI · Innovative Human-Technology Interaction · Mobile Crowdsensing and Crowdsourcing

  • Virtuality

    Open Access•Bonnie Nardi•Annual Review of Anthropology•2015

  • New Media and Labor

    Judit Kroo, Ilana Gershon•2022

  • How can working conditions for online crowdworkers be improved? Institutional experiments for cross-jurisdictional polycentric work

    Open Access•H Johnston, M Six Silberman et al.•Work in the Global Economy•2025

  • Refugees in the Digital Economy

    Open Access•Evan Easton‐calabria, A Hackl•Journal of Humanitarian Affairs•2023

  • Becoming an African Techpreneur

    Open Access•Angela Okune, Leonida Mutuku•Engaging Science Technology and…•2023

  • Aoir Ethics Panel 2

    Open Access•Martyna Gliniecka, Joseph Reagle et al.•AoIR Selected Papers of Internet…•2021

  • The Conditions of the Global Digital Working Class

    Open Access•Shahram Azhar•tripleC Communication Capitalism…•2020

  • Digital Workerism

    Open Access•Sai Englert, Jamie Woodcock et al.•tripleC Communication Capitalism…•2020

  • Opportunities and impediments for use of local data in the management of salmon fisheries

    Open Access•Sarah C Inman, Sarah Inman et al.•Conservation Ecology•2021

  • Inequality and limits

    Open Access•Bonnie Nardi•First Monday•2015

  • The crowd in crowdsourcing

    Open Access•Lina Eklund, Isabell Stamm et al.•First Monday•2019

  • Turking in a Global Labour Market

    Open Access•David Martin, Jacki O’Neill et al.•Computer Supported Cooperative…•2016

  • Antecedents of frustration in crowd work and the moderating role of autonomy

    Open Access•Kim Strunk, Kim Simon Strunk et al.•Computers in Human Behavior•2022

  • The ethical debate about the gig economy

    Open Access•Zhi Ming Tan, Nikita Aggarwal et al.•Technology in Society•2021

  • The Role of Digital Communities in Organizing Gig Workers

    Open Access•Michael David Maffie•Industrial Relations A Journal of…•2020

  • Crowdsourcing and Human Computation, Introduction

    Open Access•Matthew Lease, Omar Alonso•Encyclopedia of Social Network…•2014

  • The Fight Against Platform Capitalism

    Open Access•Jamie Woodcock•Fight Against Platform Capitalism•2021

  • Working with Machines

    Open Access•Min Kyung Lee, Daniel Kusbit et al.•Proceedings of the 33rd Annual…•2015

  • Algorithms that Divide and Unite

    Open Access•Vili Lehdonvirta•Space, Place and Global Digital…•2016

  • The Rise of the 'Just-in-Time Workforce'

    Open Access•Valerio De Stefano•SSRN Electronic Journal•2015

  • A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk

    Open Access•Kotaro Hara, Abigail Adams et al.•Proceedings of the 2018 CHI…•2018

  • Conducting Clinical Research Using Crowdsourced Convenience Samples

    Joan Chandler, Jesse Chandler et al.•Annual Review of Clinical…•2016

  • The sharing economy and digital platforms

    Open Access•Will Sutherland, Mohammad Hossein Jarrahi•International Journal of…•2018

  • Left to Our Own Devices

    Julia Ticona•Left to Our Own Devices•2022

  • Delivery workers’ visibility struggles

    Open Access•Erol Bulut, Adem Yeşilyurt•Convergence The International…•2023

  • Algorithmic Management in Organizations? From Edge Case to Center Stage

    Open Access•Anne Keegan, Jeroen Meijerink•Annual Review of Organizational…•2025

  • The ironies of autonomy

    Open Access•Maya Indira Ganesh•Humanities and Social Sciences…•2020

  • How Media Unions Stabilize Technological Hype Tracing Organized Journalism’s Discursive Constructions of Generative Artificial Intelligence

    Mike Ananny, Jake Karr•Digital Journalism•2026

  • What can the aspirational humanities teach us

    Open Access•Patrik Svensson•Arts and Humanities in Higher…•2026

  • A Capability Approach to worker dignity under Algorithmic Management

    Open Access•Laura Lamers, Jeroen Meijerink et al.•Ethics and Information Technology•2022

  • Artificial Intelligence and the Future of Work

    Open Access•Filippo Santoni de Sio•The Journal of Ethics•2024

  • Cooperative solidarity among crowdworkers? Social learning practices on a crowdtesting social media platform

    Open Access•Annika Becker, Leonard Ecker et al.•Convergence The International…•2024

  • Künstliche Künstliche Intelligenz«

    Sarrah Kassem, Chris W Wilpert•PROKLA Zeitschrift für kritische…•2024

  • Fair compensation of crowdsourcing work

    Joni Salminen, Ahmed Mohamed Sayed Kamel et al.•Behaviour and Information…•2023

  • Explaining crowdworker behaviour through computational rationality

    Open Access•Michael A Hedderich, Antti Oulasvirta•Behaviour and Information…•2025

  • Peer-to-peer online voice as emergent collective action

    Open Access•Michael Walker•Journal of Industrial Relations•2021

  • Whither Chat-GPT

    Lauren Gerlowski, Vignesh Ramachandran et al.•Journal of Geography•2026

  • Governance of labour relations in the platform economy. The cooperation between YouTubers Union and IG Metall

    Open Access•Patrick Witzak, Markus Hertwig•Industrial Relations Journal•2025

  • Turkers of the World Unite

    Open Access•Abdullah Almaatouq, P M Krafft et al.•Social Psychological and…•2020

  • VidAngel

    Gavin Feller, Andrew Ventimiglia•Internet Histories•2020

  • Ethics in Linguistics

    Open Access•Alex D’arcy, Emily M Bender•Annual Review of Linguistics•2022

  • Unintended consequences

    Open Access•K M Zheng•The Journal of Chinese Sociology•2024

  • Behind the AI’s Gaze

    Open Access•Daniele Ruggiu, Berkin Özdemir•NanoEthics•2025

  • The center’s ‘invisible back support’

    Open Access•Andrea Alarcón, Cheryll Ruth Soriano•Journal of Cultural Economy•2026

  • Caring Technologies

    Open Access•Mariacristina Sciannamblo•Sociology Compass•2024

  • What is algorithmic governance

    Open Access•Shiv Issar, A Aneesh•Sociology Compass•2021

  • Have you learned your lesson?” Communities of practice under algorithmic competition

    Open Access•Elizabeth Anne Watkins•New Media & Society•2022

  • The labor of search engine evaluation

    Open Access•Colten Meisner, Brendan Duffy et al.•New Media & Society•2022

  • Red flags, sob stories, and scams

    Open Access•Julia Ticona•New Media & Society•2022

  • Beyond non-/use

    Open Access•Susann Wagenknecht•New Media & Society•2017

  • How it actually works”

    Open Access•Thomas W L MacDonald•New Media & Society•2021

  • Out of sight, out of mind? (In)visibility of/in platform-mediated work

    Open Access•Katarzyna Gruszka, Madeleine Böhm•New Media & Society•2020

  • Gendered labour’s positions of vulnerabilities in digital labour platforms and strategies of resistance

    Dipsita Dhar, Ashique Ali Thuppilikkat•Gender & Development•2022

  • Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis

    Open Access•Saif M Mohammad•Computational Linguistics•2022

  • Graduated suspension

    Gulinigaer Yishake, June Wang•Journal of Urban Affairs•2025

  • Towards a political economy of platform-mediated work

    E Tucker•Studies in Political Economy•2020

  • Crowdsourcing research

    Kim Bartel Sheehan•Communication Monographs•2017

  • Hybride Interessenvertretung in der Plattformökonomie. Herausforderungen des „Coalition Building“ bei der Kooperation zwischen IG Metall und YouTubers Union

    Open Access•Markus Hertwig, Patrick Witzak•Zeitschrift für Soziologie•2022

  • The two kinds of artificial intelligence, or how not to confuse objects and subjects

    Open Access•Alan F Blackwell•Interdisciplinary Science Reviews•2023

  • Ethnographic artificial intelligence

    Alan F Blackwell•Interdisciplinary Science Reviews•2021

  • Inventing Artificial Intelligence in Ethiopia

    Alan F Blackwell, Addisu Damena et al.•Interdisciplinary Science Reviews•2021

  • Embedded reproduction in platform data work

    Jose Posada•Information Communication & Society•2022

  • Room with a viewership

    Christine H Tran•Information Communication & Society•2024

  • Crowdsourcing

    Open Access•Robert M Bauer, Thomas Gegenhuber•Organization•2015

  • “Everybody knows what a pothole is”

    Open Access•SJ Bennett, Benedetta Catanzariti et al.•AI & Society•2025

  • Breaking digital silence

    Open Access•Yelkal Mulualem Walle•AI & Society•2026

  • Artificial intelligence and institutional critique 2.0

    Open Access•Gabriel Pereira, Bruno Moreschi•AI & Society•2021

  • Making sense of the ‘Human’ in human-centered AI

    Open Access•Luuk Stellinga, Paulan Korenhof et al.•AI & Society•2026

  • On the data set’s ruins

    Open Access•nicolas maleve•AI & Society•2021

  • Crowdsourcing as a Tool for Research

    Open Access•Stephen Rea, Hanzelle Kleeman et al.•Bulletin of Science Technology &…•2020

  • Cornelius Castoriadis’ agonistic theory of the future of work at Amazon Mechanical Turk

    Open Access•Tim Christiaens•Distinktion Journal of Social…•2024

  • Social relations and worker resistance in the platform economy

    Open Access•Prakriti Dasgupta, Ronan Carbery et al.•New Political Economy•2025

  • A big data confession

    Open Access•Beki Grinter•interactions•2013

  • Running user studies with crowd workers

    Open Access•Brian McInnis, Gilly Leshed•interactions•2016

  • Big data, diminished design

    Open Access•Jonathan Bean, Daniela K Rosner•interactions•2014

  • Distributed Apprenticeship in Online Communities

    Julie Hui, Julie S Hui et al.•Human-Computer Interaction•2018

  • Perception of rhythmic agency for conversational labeling

    Christine Guo Yu, Alan F Blackwell et al.•Human-Computer Interaction•2021

  • Loops, ladders and links

    Open Access•Marion Fourcade, Fleur Johns•Theory and Society•2020

  • Flexibility in the gig economy

    Open Access•Vili Lehdonvirta•New Technology Work and Employment•2018

  • Harnessing trust and engaging with the online workforce

    David Kocsis, Gert-Jan de Vreede et al.•Journal of Information…•2026

  • AI failure loops in devalued work

    Open Access•Anna Kawakami, Jordan Taylor et al.•Big Data & Society•2026

  • Making AI Work

    Open Access•Rosalie A Waelen, J P Deranty et al.•Constellations•2026

  • The Gender Wage Gap in an Online Labor Market

    Abi Adams, Abi Adams‐Prassl et al.•The Review of Economics and…•2025

  • The Influence of Climate Fiction

    Open Access•Matthew Schneider-Mayerson•Environmental Humanities•2018

  • A Bookmobile Critique of Institutions, Infrastructure, and Precarious Mobility

    Jessa Lingel•Public Culture•2018

  • A review of perspectives and challenges for international development in information and communication technologies

    José Abdelnour-Nocera, Melissa Densmore•Annals of the International…•2017

  • Identity in the Gig Economy

    Open Access•W Charles•Sociological Forum•2026

  • Identity Alignment and the Sociotechnical Reconfigurations of Emotional Labor in Transnational Gig-education Platforms

    Open Access•Zefeng Zhang, Ben Zefeng Zhang et al.•Computer Supported Cooperative…•2025

  • The Dark Side of Recruitment in Crowdsourcing

    Open Access•Haoyu Xie, Eddy Maddalena et al.•Computer Supported Cooperative…•2023

  • Rating Working Conditions on Digital Labor Platforms

    Open Access•Ellie Harmon, M Six Silberman•Computer Supported Cooperative…•2018

  • Capitalizing Relationships

    Open Access•Karin Hansson, Thomas Ludwig et al.•Computer Supported Cooperative…•2019

  • A Worker-Driven Common Information Space

    Open Access•Naja Holten Møller, Maren Gausdal Eriksen et al.•Computer Supported Cooperative…•2020

  • Crowdsourcing historical photographs

    Open Access•Karin Hansson, Anna Näslund et al.•Computer Supported Cooperative…•2022

  • Investigating the Amazon Mechanical Turk Market Through Tool Design

    Open Access•Benjamin V Hanrahan, David Martins et al.•Computer Supported Cooperative…•2018

  • Last-mile Work of Infrastructures

    Open Access•Sam Addison Ankenbauer, Alex Jiahong Lu•Computer Supported Cooperative…•2025

  • The Human Infrastructure of Civic Data

    Open Access•Firaz Peer•Computer Supported Cooperative…•2023

  • Privacy in Crowdsourcing

    Open Access•Huichuan Xia, B Mckernan•Computer Supported Cooperative…•2020

  • Solidarity not Charity! Empowering Local Communities for Disaster Relief during Covid-19 through Grassroots Support

    Open Access•Tiffany Knearem, Jeongwon Jo et al.•Computer Supported Cooperative…•2024

  • Platformic Management, Boundary Resources for Gig Work, and Worker Autonomy

    Open Access•Mohammad Hossein Jarrahi, Will Sutherland et al.•Computer Supported Cooperative…•2020

  • Fleeting Alliances and Frugal Collaboration in Piecework

    Open Access•Riyaj Shaikh, Moira Mcgregor et al.•Computer Supported Cooperative…•2024

  • Feminist HCI

    Open Access•Shaowen Bardzell•Proceedings of the SIGCHI…•2010

  • Who are the crowdworkers?

    Open Access•Joel Ro, Joel Ross et al.•CHI '10 Extended Abstracts on…•2010

  • Analyzing the Amazon Mechanical Turk marketplace

    Open Access•Panagiotis G Ipeirotis•XRDS: Crossroads, The ACM…•2010

  • Steps Toward an Ecology of Infrastructure

    Susan Leigh Star, Karen Ruhleder•Information Systems Research•1996

  • Digital interdependence and how to design for it

    Open Access•Andrew Light•interactions•2011

  • Featurelearning from activists

    Open Access•Tad Hirsch•interactions•2009

  • The Intellectual Challenge of CSCW

    Mark S Ackerman•Human-Computer Interaction•2000

  • Human-Machine Reconfigurations

    Open Access•Lucy Suchman, Lucille Alice Suchman•Human-Machine Reconfigurations•2006

  • Mapping the Margins

    Kimberlé Crenshaw, Kimberlé W Crenshaw•Stanford Law Review•1991

  • Layers of Silence, Arenas of Voice

    Open Access•Susan Leigh Star, Anselm Strau et al.•Computer Supported Cooperative…•1999

  • The Politics of Technology

    Open Access•Marc Berg•Science Technology & Human Values•1998

  • Simians, Cyborgs, and Women

    Donna Haraway•Simians, Cyborgs, and Women•2013

  • New Forms of Work Organization

    Vera C Smith, Vicki Smith•Annual Review of Sociology•1997

Unique citing works138
Citations per year10,62
Citation span2013 - 2026 (14)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 123

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae