Beyond Algorithmic Bias

A Socio-Computational Interrogation of the Google Search by Image Algorithm

Bibliographic Data

ID12170484
AuthorsOrestis Papakyriakopoulos (0000-0003-4680-0022, Princeton University, Princeton, NJ, USA, corresponding author), Arwa Michelle Mboya (IIT@MIT)
Year2022
Volume41
Issue4
Pages1100-1125
Publication date2022-02-25
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSocial Science Computer Review (JOURNAL)
Journal identifiersISSN: 0894-4393 • E-ISSN: 1552-8286
PublisherSAGE Publishing (PUBLISHER • US)
DOI10.1177/08944393211073169
OpenAlexW3165288160
LanguageEN
Citations received6
References cited57

We perform a socio-computational interrogation of the google search by image algorithm, a main component of the google search engine. We audit the algorithm by presenting it with more than 40 thousands faces of all ages and more than four races and collecting and analyzing the assigned labels with the appropriate statistical tools. We find that the algorithm reproduces white male patriarchal structures, often simplifying, stereotyping and discriminating females and non-white individuals, while providing more positive descriptions of white men. By drawing from Bourdieu’s theory of cultural reproduction, we link these results to the attitudes of the algorithm’s designers, owners, and the dataset the algorithm was trained on. We further underpin the problematic nature of the algorithm by using the ethnographic practice of studying-up: We show how the algorithm places individuals at the top of the tech industry within the socio-cultural reality that they shaped, many times creating biased representations of them. We claim that the use of social-theoretic frameworks such as the above are able to contribute to improved algorithmic accountability, algorithmic impact assessment and provide additional and more critical depth in algorithmic bias and auditing studies. Based on the analysis, we discuss the scientific and design implications and provide suggestions for alternative ways to design just socio-algorithmic systems

Algorithm · Audit · Interrogation · White (mutation · Computer Science · Ethics and Social Impacts of AI · Misinformation and Its Impacts · Mobile Crowdsensing and Crowdsourcing

Tools

Open DOI