Using chat GPT to evaluate police threats, risk and harm

Datos Bibliográficos

ID12926646
AutoresEric Halford (0000-0002-3913-1679, Birla Institute of Technology and Science, Pilani - Dubai Campus, autor de correspondencia), Andrew Webster (0000-0002-5782-0793)
Año2024
Volumen78
Páginas100686-100686
Fecha de publicación2024-07-16
Peer ReviewedSí
Open AccessSí
TipoARTICLE
RevistaInternational journal of law, crime and justice (JOURNAL)
Identificadores de la revistaISSN: 1756-0616 • E-ISSN: 1876-763X
EditorialElsevier BV (PUBLISHER)
DOI10.1016/j.ijlcj.2024.100686
OpenAlexW4400673983
IdiomaEN
Citas recibidas4
Referencias citadas15

General purpose artificial intelligence (GPAI) is a form of advanced AI system that includes the recently introduced ChatGPT. GPAI is known for its capacity to understand and emulate human responses, and potentially offers an opportunity to reduce human error when conducting tasks that involve analysis, judgement, and reasoning. To support officers to do this, the police presently use a range of decision-making support tools, one of which is called THRIVE (Threat, Harm, Risk, Investigation, Vulnerability, and Engagement). THRIVE is designed to provide police practitioners with a model to improve their identification and response to vulnerability. Despite the existence of such decision models, a 2020 meta-analysis of police cases resulting in death or serious injury identified contributory failures that included poor risk identification, risk management, failure to adhere to evidentiary processes, poor criminal investigations, and inadequate police engagement with victims, including the level of care and assistance provided (Allnock, et al, 2020). Importantly, this report outlined human error as being a major underpinning factor of the failures. Although GPAI offers an opportunity to improve analysis, judgement, and reasoning, such systems have not yet been tested in policing, a field where any reduction in human error, particularly in the assessment of threat, harm, risk, and vulnerability can potentially save lives. This study is the first attempt to do this by using the chain-of-thought prompt methodology to test the GPAI ChatGPT (3.5 vs 4) in a controlled environment using 30 life-like police scenarios, crafted, and analyzed by expert practitioners. In doing so, we identify that ChatGPT 4 significantly outperforms its 3.5 predecessor, indicating that GPAI presents considerable opportunity in policing. However, systems that use this technology require extensive directional prompting to ensure outputs that can be considered accurate, and therefore, potentially safe to utilize in an operational setting. The article concludes by discussing how practitioners and researchers can further refine police related chain-of-thought prompts or use application programming interfaces (APIs) to improve responses provided by such GPAI

Business · Computer security · Harm · Human error · Identification (biology · Judgement · Political science · Risk analysis (engineering · Risk assessment · Risk management · Vulnerability (computing · Artificial Intelligence in Healthcare and Education · Computer Science · Deception detection and forensic psychology · Ethics and Social Impacts of AI · Medicine · Psychology · Social Psychology