Pular para o conteúdo principal

ETHNOS_APP

Início • Busca • Periódicos • Lista 0

Bias in data‐driven artificial intelligence systems—An introductory survey

Dados Bibliográficos

ID23326136
AutoresEirini Ntoutsi (0000-0001-5729-1003, Leibniz University Hannover, autor correspondente), Pavlos Fafalios (0000-0003-2788-526X, Foundation for Research and Technology Hellas), Ujwal Gadiraju (0000-0002-6189-6539, Leibniz University Hannover), Vasileios Iosifidis (0000-0002-3005-4507, Leibniz University Hannover), Wolfgang Nejdl (0000-0003-3374-2193, Leibniz University Hannover), Maria‐Esther Vidal (TIB Leibniz Information Centre For Science and Tecnhnology Hannover Germany), María-Esther Vidal (0000-0003-1160-8727, Technische Informationsbibliothek (TIB)), Salvatore Ruggieri (0000-0002-1917-6087, University of Pisa), Franco Turini (0000-0001-6789-5476, University of Pisa), Papadopoulo (0000-0002-5441-7341, Information Technologies Institute), Emmanouil Krasanakis (0000-0002-3947-222X, Information Technologies Institute), Ioannis Kompatsiaris (0000-0001-6447-9020, Information Technologies Institute), Katharina Kinder-Kurlanda (0000-0002-7749-645X, GESIS - Leibniz Institute for the Social Sciences), Claudia Wagner (0000-0002-0640-8221, GESIS - Leibniz Institute for the Social Sciences), Fowzia Karimi (0000-0002-0037-2475, GESIS - Leibniz Institute for the Social Sciences), Fariba Karimi (0000-0002-2209-7590, GESIS Leibniz Institute for the Social Sciences Cologne Germany), Miriam Fernandez (0000-0001-5939-4321, The Open University), Harith Alani (0000-0003-2784-349X, The Open University), Bettina Berendt (0000-0002-8003-3413, Technische Universität Berlin), Tina Kruegel (Leibniz University Hannover), Christian Heinze (0000-0002-9114-8080, Leibniz University Hannover), Klaus Broelemann (Arbeitsgemeinschaft Gynäkologische Onkologie Studiengruppe), Gjergji Kasneci (0000-0002-3123-7268, Arbeitsgemeinschaft Gynäkologische Onkologie Studiengruppe), Thanassis Tiropanis (0000-0002-6195-2852, University of Southampton), Steffen Staab (0000-0002-0780-4154, University of Stuttgart)
Ano2020
Volume10
Fascículo3
Data de publicação2020-05-01
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoWIREs Data Mining and Knowledge Discovery (JOURNAL)
Identificadores do periódicoISSN: 1942-4787 • E-ISSN: 1942-4795
EditoraWiley (PUBLISHER • GB)
DOI10.1002/widm.1356
OpenAlexW3004493409
IdiomaEN
Citações recebidas92
Referências citadas63

Artificial Intelligence (AI)‐based systems are widely employed nowadays to make decisions that have far‐reaching impact on individuals and society. Their decisions might affect everyone, everywhere, and anytime, entailing concerns about potential human rights issues. Therefore, it is necessary to move beyond traditional AI algorithms optimized for predictive performance and embed ethical and legal principles in their design, training, and deployment to ensure social good while still benefiting from the huge potential of the AI technology. The goal of this survey is to provide a broad multidisciplinary overview of the area of bias in AI systems, focusing on technical challenges and solutions as well as to suggest new research directions towards approaches well‐grounded in a legal frame. In this survey, we focus on data‐driven AI, as a large part of AI is powered nowadays by (big) data and powerful machine learning algorithms. If otherwise not specified, we use the general term bias to describe problems related to the gathering or processing of data that might result in prejudiced decisions on the bases of demographic features such as race, sex, and so forth. This article is categorized under: Commercial, Legal, and Ethical Issues > Fairness in Data Mining Commercial, Legal, and Ethical Issues > Ethical Considerations Commercial, Legal, and Ethical Issues > Legal Issues

Big data · Data mining · Data science · Engineering ethics · Ethical issues · Multidisciplinary approach · Political science · Software deployment · Artificial Intelligence · Artificial Intelligence in Healthcare and Education · Computer Science · Ethics and Social Impacts of AI · Explainable Artificial Intelligence (XAI · Law

  • Expanded productivity, contested authority

    Open Access•Iván Sánchez-López, Heleny Méndiz-Rojas et al.•AI & Society•2026

  • Digital twins and systemic acceleration

    Open Access•Simon Plakolb, Raffael Hiden•Frontiers in Sociology•2026

  • Computational Methods and Nationalism Studies

    Open Access•Justin Chun-Ting Ho•Studies on National Movements•2025

  • Policy advice and best practices on bias and fairness in AI

    Open Access•Jose M Alvarez, Alejandra Bringas Colmenarejo et al.•Ethics and Information Technology•2024

  • Promoting parent-child shared reading with a bilingual conversational agent

    Open Access•Kunlei He, Kelsyann Cervera et al.•International Journal of…•2025

  • A principlist-based study of the ethical design and acceptability of artificial social agents

    Open Access•D Richards, Ravi Vythilingam et al.•International Journal of…•2023

  • “I’ve never seen a glass ceiling better represented”

    Open Access•Helena A Haxvig, Vincenzo D’Andrea et al.•International Journal of…•2025

  • To err is human

    Open Access•Mathew S Isaac, Rebecca Jen-Hui Wang et al.•Computers in Human Behavior•2024

  • Language learning development in human-AI interaction

    Open Access•Feifei Wang, Alan Cheung et al.•System•2024

  • Can Artificial Intelligence Engage in the Practice of Law as the Art of Good and Justice

    Open Access•Neringa Gaubienė•Filosofija. Sociologija•2024

  • Research evaluation with ChatGPT

    Open Access•Mike Thelwall, Zeyneb Kurt•Scientometrics•2025

  • Unmasking inequalities of the code

    Open Access•Tuba Bircan, Mustafa F Özbilgin•Technological Forecasting and…•2025

  • Artificial intelligence in knowledge management

    Open Access•Mojtaba Rezaei•Technological Forecasting and…•2025

  • What drives managers towards algorithm aversion and how to overcome it? Mitigating the impact of innovation resistance through technology readiness

    Open Access•Hasan Mahmud, A K M Najmul Islam et al.•Technological Forecasting and…•2023

  • Generative artificial intelligence

    Open Access•Leonardo Banh, Gero Strobel•Electronic Markets•2023

  • Artificial intelligence in the creative industries

    Open Access•Nantheera Anantrasirichai, David Bull•Artificial Intelligence Review•2022

  • New Era of Artificial Intelligence in Education

    Open Access•Firuz Kamalov, David Santandreu Calonge et al.•Sustainability•2023

  • Generative AI and ChatGPT

    Fiona Fui‐hoon Nah, Fiona Fui-Hoon Nah et al.•Journal of Information Technology…•2023

  • Would You Trust Your GenAI Chatbot as Your School Therapist? Perspectives and Implications From Teachers and Students

    Open Access•Cecilia K Y Chan, Amine Moussa•Human Behavior and Emerging…•2025

  • Digital surveillance capitalism and cities

    Open Access•Ashish Makanadar•Humanities and Social Sciences…•2024

  • From awareness to action

    Open Access•Clemens Striebing, Henriette Bertram et al.•Humanities and Social Sciences…•2026

  • Identity, crimes, and law enforcement in the Metaverse

    Open Access•Hua Xuan Qin, Yuyang Wang et al.•Humanities and Social Sciences…•2025

  • Culturally Responsive Artificial Intelligence – Problems, Challenges and Solutions

    Open Access•Natalia Ożegalska-Łukasik, Szymon Łukasik•Intercultural Relations•2023

  • The ‘Postdigital Teacher Identities’ Praxis

    Open Access•Janine Aldous Arantes•Postdigital Science and Education•2022

  • Toward Exploring Fairness in Visual Transformer Based Natural and GAN Image Detection Systems

    Open Access•Manjary P Gangan, Anoop Kadan et al.•IEEE Transactions on Computational…•2025

  • “There’s a Rule Book in my Head”

    Open Access•Angela Misri, Nicole Blanchett et al.•Digital Journalism•2026

  • Exploring HR Professionals’ Experiences with Generative AI in Recruitment

    Open Access•Mahadih Kyambade, Afulah Namatovu•SAGE Open•2026

  • Amplifying Voices, Not Replacing Them

    Manoj Deori, Kanchan K Malik•Journal of Radio & Audio Media•2025

  • How AI’s reporting Differs

    Open Access•Gong Chen, Jiliang Sha et al.•Journalism Practice•2026

  • Striking the (im)balance – a review of the relative prevalence of meta-ethical models in AI journalism research

    Open Access•Malte Egelyng Sigsgaard•Journalism•2026

  • Tracing app technology

    Open Access•Saleh Afroogh, Amir Esmalian et al.•Ethics and Information Technology•2022

  • Allying with AI? Reactions toward human-based, AI/ML-based, and augmented hiring processes

    Open Access•Manuel F Gonzalez, Weiwei Liu et al.•Computers in Human Behavior•2022

  • Personalization in Australian K-12 classrooms

    Open Access•Janine Aldous Arantes•The Australian Educational…•2023

  • Inequities in artificial intelligence acceptance

    Open Access•Seung-Yoon Shin, Insik Bang•Information Development•2025

  • Artificial intelligence and learning environment

    Open Access•Esmaeil Jafari•Journal of Computer Assisted…•2024

  • From hearing to seeing

    Open Access•Yonggai Zhuang, Yuhao Kang et al.•Computers Environment and Urban…•2024

  • Assessing differences in safety perceptions using GeoAI and survey across neighbourhoods in Stockholm, Sweden

    Open Access•Yuhao Kang, Jonatan Abraham et al.•Landscape and Urban Planning•2023

  • Voices of the crowd

    Open Access•Kai Ding, Yan Yang et al.•Acta Psychologica•2026

  • Decoding urban policies

    Open Access•Zhengyang Lu, Weifan Wang et al.•Environment and Planning B Urban…•2026

  • Mitigating implicit and explicit bias in structured data without sacrificing accuracy in pattern classification

    Open Access•Fabian Hoitsma, Gonzalo Nápoles et al.•AI & Society•2025

  • Bridging perspectives on artificial intelligence

    Open Access•Amirmahdi Mohammadi, Mehrdad Maghsoudi•AI & Society•2025

  • Negotiating AI fairness

    Open Access•Marta Gibin, Emmanouil Krasanakis et al.•AI & Society•2026

  • Writing with emotion? Assessing emotional valence and appeals in AI-generated vs. human-written articles

    Open Access•Mingxiao Sui•AI & Society•2026

  • GPT-4-Trinis

    Open Access•Samantha Jackson, Barend Beekhuizen et al.•AI & Society•2025

  • Algorithmic bias, fairness, and inclusivity

    Open Access•Paola Panarese, Marco Grasso et al.•AI & Society•2026

  • The next frontier of the Internet of Behaviors

    Open Access•Andrei O J Kwok•Journal of Tourism Futures•2025

  • Integrating AI and EdTech into Inclusive Learning

    Open Access•Olga Ergunova, Gaini Mukhanova et al.•Social Sciences•2026

  • Evaluating disability bias in the Allegheny Family Screening Tool

    Open Access•Ian Moura, Robyn M Powell et al.•Journal of Public Child Welfare•2026

  • Embed systemic equity throughout industrial ecology applications

    Open Access•Joe F Bozeman, Catharina Hollauer et al.•Journal of Industrial Ecology•2024

  • Reliable but supervised

    Muniza Askari•Assessment & Evaluation in Higher…•2026

  • A vision for responsible AI integration in citizen science

    Open Access•Maryam Lotfian, Christophe Claramunt et al.•Humanities and Social Sciences…•2026

  • The Role of Gender Equality in Ethical AI Development for Sustainable Societies

    Open Access•Arzu Kilitci Calayir, Ceren Cubukcu Cerasi et al.•Gender Issues•2026

  • Red teaming for culturally grounded LLM evaluation

    Open Access•Arisa Ema•AI & Society•2026

  • A study on the visual rhetorical differences in national image representation of China and the United States by generative artificial intelligence

    Ping Guo, Peihao Guo et al.•Journal of Information Technology…•2025

  • Critical, but constructive

    Open Access•Valerie Hase, Marko Bachl et al.•Communication Methods and Measures•2025

  • Plagiarism in the age of massive Generative Pre-trained Transformers (GPT-3)

    Open Access•Nassim Dehouche•Ethics in Science and Environmental…•2021

  • Generative Artificial Intelligence in Education and Its Implications for Assessment

    Open Access•Jin Mao, Baiyun Chen et al.•TechTrends•2023

  • The Change We Work

    Open Access•Stephanie Moore, Amir Hedayati Mehdiabadi et al.•TechTrends•2023

  • Toward a political economy of synthetic data

    Open Access•James Steinhoff•New Media & Society•2022

  • Managing the tension between opposing effects of explainability of artificial intelligence

    Open Access•Babak Abedin•Internet Research•2021

  • A profile analysis of pre-service teachers’ AI acceptance

    Open Access•Chengming Zhang, Min Hu et al.•Teaching and Teacher Education•2025

  • A data quality approach to the identification of discrimination risk in automated decision making systems

    Open Access•Antonio Vetrò, Marco Torchiano et al.•Government Information Quarterly•2021

  • How to promote AI in the US federal government

    Open Access•Muhammad Salar Khan, Azka Shoaib et al.•Government Information Quarterly•2024

  • Intelligent technologies, governments, and citizens

    Open Access•Mila Gascó-Hernández, David Valle-Cruz•Government Information Quarterly•2025

  • Do citizens trust trustworthy artificial intelligence? Experimental evidence on the limits of ethical AI measures in government

    Open Access•Bjorn Kleizen, Wouter Van Dooren et al.•Government Information Quarterly•2023

  • Understanding local government responsible AI strategy

    Open Access•Anne David, Tan Yigitcanlar et al.•Cities•2024

  • Exploring collaborative decision-making

    Open Access•Xinyue Hao, Emrah Demir et al.•Technology in Society•2024

  • Ten Core Concepts for Ensuring Data Equity in Public Health

    Open Access•Yiran Wang, Alicia E Boyd et al.•JAMA Health Forum•2026

  • How Should Surgeons Consider Emerging Innovations in Artificial Intelligence and Robotics

    Open Access•Ava G Chappell, Chad M Teven•The AMA Journal of Ethic•2023

  • Does artificial intelligence bias perceptions of environmental challenges

    Open Access•Hamish Van Der Ven, Diego Corry et al.•Environmental Research Letters•2024

  • An Iterative and Collaborative End-to-End Methodology Applied to Digital Mental Health

    Open Access•Laura Joy Boulos, Alexandre Mendes et al.•Frontiers in Psychiatry•2021

  • AI-driven corporate governance

    Open Access•José-Miguel Bello Y Villarino, Simon Bronitt•Griffith Law Review•2024

  • Opportunities and challenges of AI-systems in political decision-making contexts

    Open Access•Max Tretter•Frontiers in Political Science•2025

  • Laughing with machines

    Open Access•Jarno Hietalahti•European Journal of Humour Research•2021

  • Training in Co-Creation as a Methodological Approach to Improve AI Fairness

    Open Access•Ian Slesinger, Evren Yalaz et al.•Societies•2024

  • Other worlds

    Luke Munn, Liam Magee•The Information Society•2026

  • Governing with artificial intelligence

    Open Access•Desmond Lartey, Kris M Y Law•Technology in Society•2026

  • AI vs. human-generated content and accounts on Instagram

    Open Access•Jeongeun Park, Changhoon Oh et al.•Technology in Society•2024

  • A Utopian Dystopia

    Open Access•Enzo Lenine, Bruna Toso de Alcântara et al.•Contexto Internacional•2025

  • A theoretical model of AI bias mitigation

    Subhasis Bera, Ishita Bera et al.•Journal of Information…•2025

  • Feminist perspectives to artificial intelligence

    Open Access•Ariana Guevara-Gómez, Lucía O de Zárate-Alcarazo et al.•Information Polity•2021

  • Higher-order interactions shape collective human behaviour

    Open Access•Federico Battiston, Valerio Capraro et al.•Nature Human Behaviour•2025

  • Energy Gen-AI technology framework

    Open Access•Leonardo Fontoura, Daniel Luiz De Mattos Nascimento et al.•Technology in Society•2025

  • Navigating the muddy waters of bias in artificial intelligence research

    Open Access•Mohammad Hossein Jarrahi, Amir Karami et al.•Technology in Society•2026

  • AI and Epistemic Agency

    Open Access•Mark Coeckelbergh•Social Epistemology•2026

  • The role of expectancy violation in the selection of Latino professionals

    Open Access•Cynthia Saldanha Halliday, María Fernanda García•Applied Psychology•2025

  • Improving Compliance in Experimental Studies of Discrimination

    Aaron R Kaufman, Christopher Celaya et al.•The Journal of Politics•2025

  • Administration by algorithm

    Frank Bannister, Robert Connolly et al.•Information Polity•2020

  • Computercode in seinen Dimensionen ethnografisch begegnen

    Open Access•Libuše Hannah Vepřek, Sarah Thanner et al.•Kulturanthropologie Notizen•2023

  • AI and racism

    Open Access•Timothy Appignani, Jacob Sanchez•Discourse Studies•2024

  • Analyzing AI Bias

    Open Access•Tal Samuel-Azran, Ilan Manor et al.•American Behavioral Scientist•2024

  • A Inteligência Artificial e os desafios da Ciência Forense Digital no século XXI

    Open Access•Rafael Padilha, Antônio Theóphilo et al.•Estudos Avançados•2021

  • Peeking Inside the Black-Box

    Open Access•Amina Adadi, Mohammed Berrada•IEEE Access•2018

  • Algorithmic Accountability

    Nicholas Diakopoulos•Digital Journalism•2015

  • Explaining Explanations in AI

    Open Access•Brent Mittelstadt, Chris Russell et al.•Proceedings of the Conference on…•2019

  • Big Data's Disparate Impact

    Open Access•Solon Barocas, Andrew D Selbst•SSRN Electronic Journal•2016

  • On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games

    Open Access•Phan Minh Dung•Artificial Intelligence•1995

  • Bias and causal associations in observational research

    Open Access•David A Grimes, Kenneth F Schulz•The Lancet•2002

  • Fairness through awareness

    Open Access•Cynthia Dwork, Moritz Hardt et al.•Proceedings of the 3rd…•2012

  • A Survey of Methods for Explaining Black Box Models

    Open Access•Riccardo Guidotti, Anna Monreale et al.•ACM Computing Surveys•2019

  • Big Questions for Social Media Big Data

    Open Access•Zeynep Tufekci•Proceedings of the International…•2014

  • A Dictionary of Media and Communication

    Daniel Chandler, Rod Munday•A dictionary of media and…•2011

  • Picturing Algorithmic Surveillance

    Open Access•Lucas D Introna, Lucas Introna et al.•Surveillance & Society•2002

  • Critical Questions for Big Data

    Drick Boyd, Danah Boyd et al.•Information Communication & Society•2012

Obras citantes distintas92
Citações por ano15,33
Intervalo de citações2020 - 2026 (7)
Velocidade de citaçãocurrent
Altamente citadoNão
Tipos de citaçãoNeutras: 78
Ethnos_APP • Projeto Open Source • Licença MIT • Frontend v2.0.0 • Privacidade e Cookies • Documentação da API: api.ethnos.app/docs • Código da API: GitHub • DOI: 10.5281/zenodo.17049435 • Código do Frontend: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae