“I’m afraid I can’t let you do that, Doctor”

Meaningful disagreements with AI in medical contexts

Datos Bibliográficos

ID20396552
AutoresHendrik Kempt (0000-0002-5886-2987, RWTH Aachen University, autor de correspondencia), Jan-Christoph Heilinger, Jan‐Christoph Heilinger (0000-0003-2491-9794, RWTH Aachen University), Saskia K Nagel (0000-0001-9657-5121, RWTH Aachen University)
Año2023
Volumen38
Número4
Páginas1407-1414
Fecha de publicación2023-08-01
Peer ReviewedSí
Open AccessSí
TipoARTICLE
RevistaAI & Society (JOURNAL)
Identificadores de la revistaISSN: 0951-5666 • E-ISSN: 1435-5655
EditorialSpringer Science and Business Media LLC (PUBLISHER)
DOI10.1007/s00146-022-01418-x
OpenAlexW4221081267
IdiomaEN
Citas recibidas13
Referencias citadas23

This paper explores the role and resolution of disagreements between physicians and their diagnostic AI-based decision support systems (DSS). With an ever-growing number of applications for these independently operating diagnostic tools, it becomes less and less clear what a physician ought to do in case their diagnosis is in faultless conflict with the results of the DSS. The consequences of such uncertainty can ultimately lead to effects detrimental to the intended purpose of such machines, e.g. by shifting the burden of proof towards a physician. Thus, we require normative clarity for integrating these machines without affecting established, trusted, and relied upon workflows. In reconstructing different causes of conflicts between physicians and their AI-based tools—inspired by the approach of “meaningful human control” over autonomous systems and the challenges to resolve them—we will delineate normative conditions for “meaningful disagreements”. These incorporate the potential of DSS to take on more tasks and outline how the moral responsibility of a physician can be preserved in an increasingly automated clinical work environment

CLARITY · Knowledge management · Normative · Political science · Workflow · Artificial Intelligence in Healthcare and Education · Computer Science · Engineering · Ethics and Social Impacts of AI · Ethics in Clinical Research · Law · Medicine · Psychology · Artificial Intelligence