The Emerging Hazard of AI‐Related Health Care Discrimination

Bibliographic Data

ID20338581
AuthorsSharona Hoffman (0009-0009-8766-0127, corresponding author)
Year2021
Volume51
Issue1
Pages8-9
Publication date2021-01-01
Open AccessYes
TypeARTICLE
VenueThe Hastings Center Report (JOURNAL)
Journal identifiersISSN: 0093-0334 • E-ISSN: 1552-146X
PublisherWiley (PUBLISHER • GB)
DOI10.1002/hast.1203
PMID33315263
OpenAlexW3112534039
LanguageEN
Citations received3
References cited5

Artificial intelligence holds great promise for improved health‐care outcomes. But it also poses substantial new hazards, including algorithmic discrimination. For example, an algorithm used to identify candidates for beneficial “high risk care management” programs routinely failed to select racial minorities. Furthermore, some algorithms deliberately adjust for race in ways that divert resources away from minority patients. To illustrate, algorithms have underestimated African Americans’ risks of kidney stones and death from heart failure . Algorithmic discrimination can violate Title VI of the Civil Rights Act and Section 1557 of the Affordable Care Act when it unjustifiably disadvantages underserved populations. This article urges that both legal and technical tools be deployed to promote AI fairness. Plaintiffs should be able to assert disparate impact claims in health‐care litigation, and Congress should enact an Algorithmic Accountability Act. In addition, fairness should be a key element in designing, implementing, validating, and employing AI

Accountability · Actuarial science · Business · Civil rights · Disparate impact · Element (criminal law) · Health care · Health insurance · Patient Protection and Affordable Care Act · Plaintiff · Political science · Race (biology) · Sociology · Artificial Intelligence in Healthcare and Education · Computer Science · Healthcare cost, quality, practices · Law · Medical Malpractice and Liability Issues

Tools

Open DOI