“I’m afraid I can’t let you do that, Doctor”

Meaningful disagreements with AI in medical contexts

Dados Bibliográficos

ID20396552
AutoresHendrik Kempt (0000-0002-5886-2987, RWTH Aachen University, autor correspondente), Jan-Christoph Heilinger, Jan‐Christoph Heilinger (0000-0003-2491-9794, RWTH Aachen University), Saskia K Nagel (0000-0001-9657-5121, RWTH Aachen University)
Ano2023
Volume38
Fascículo4
Páginas1407-1414
Data de publicação2023-08-01
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoAI & Society (JOURNAL)
Identificadores do periódicoISSN: 0951-5666 • E-ISSN: 1435-5655
EditoraSpringer Science and Business Media LLC (PUBLISHER)
DOI10.1007/s00146-022-01418-x
OpenAlexW4221081267
IdiomaEN
Citações recebidas13
Referências citadas23

This paper explores the role and resolution of disagreements between physicians and their diagnostic AI-based decision support systems (DSS). With an ever-growing number of applications for these independently operating diagnostic tools, it becomes less and less clear what a physician ought to do in case their diagnosis is in faultless conflict with the results of the DSS. The consequences of such uncertainty can ultimately lead to effects detrimental to the intended purpose of such machines, e.g. by shifting the burden of proof towards a physician. Thus, we require normative clarity for integrating these machines without affecting established, trusted, and relied upon workflows. In reconstructing different causes of conflicts between physicians and their AI-based tools—inspired by the approach of “meaningful human control” over autonomous systems and the challenges to resolve them—we will delineate normative conditions for “meaningful disagreements”. These incorporate the potential of DSS to take on more tasks and outline how the moral responsibility of a physician can be preserved in an increasingly automated clinical work environment

CLARITY · Knowledge management · Normative · Political science · Workflow · Artificial Intelligence in Healthcare and Education · Computer Science · Engineering · Ethics and Social Impacts of AI · Ethics in Clinical Research · Law · Medicine · Psychology · Artificial Intelligence