Artificial Intelligence

Arguments for Catastrophic Risk

Dados Bibliográficos

ID4079996
AutoresAdam Bales (0000-0002-9629-0318, University of Oxford), William D’alessandro (0000-0002-5451-079X, University of Oxford), Cameron Domenico Kirk‐giannini (0000-0001-9372-227X, Rutgers, the State University of New Jersey, autor correspondente)
Ano2024
Volume19
Fascículo2
Data de publicação2024-02-01
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoPhilosophy Compass (JOURNAL)
Identificadores do periódicoISSN: 1747-9991 • E-ISSN: 1747-9991
EditoraWiley (PUBLISHER • GB)
DOI10.1111/phc3.12964
OpenAlexW4391719496
IdiomaEN
Citações recebidas14
Referências citadas24

Recent progress in artificial intelligence (AI) has drawn attention to the technology's transformative potential, including what some see as its prospects for causing large-scale harm. We review two influential arguments purporting to show how AI could pose catastrophic risks. The first argument - theProblem of Power-Seeking- claims that, under certain assumptions, advanced AI systems are likely to engage in dangerous power-seeking behavior in pursuit of their goals. We review reasons for thinking that AI systems might seek power, that they might obtain it, that this could lead to catastrophe, and that we might build and deploy such systems anyway. The second argument claims that the development of human-level AI will unlock rapid further progress, culminating in AI systems far more capable than any human - this is theSingularity Hypothesis. Power-seeking behavior on the part of such systems might be particularly dangerous. We discuss a variety of objections to both arguments and conclude by assessing the state of the debate

Argument (complex analysis · Artificial general intelligence · Cognitive science · Epistemology · Harm · Power (physics · Transformative learning · Variety (cybernetics · Computer Science · Ethics and Social Impacts of AI · Neuroethics, Human Enhancement, Biomedical Innovations · Philosophy · Psychology · Social Psychology · Space Science and Extraterrestrial Life · Artificial Intelligence