Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Is AI-Generated Extremism Credible? Experimental Evidence from an Expert Survey

Bibliographic Data

ID4086597
AuthorsStephane J Baele (0000-0002-3632-0888, UCLouvain), Elahe Naserian (0000-0003-2668-0107, Trilateral Research Ltd, London, UK), Gregory Katz (0000-0001-5970-2769, Department of Political Science, University of Exeter, Exeter, UK, corresponding author)
Year2024
Volume37
Issue8
Pages1-17
Publication date2024-08-02
Open AccessNo
TypeARTICLE
VenueTerrorism and Political Violence (JOURNAL)
Journal identifiersISSN: 0954-6553 • E-ISSN: 1556-1836
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/09546553.2024.2380089
OpenAlexW4401243254
LanguageEN
Citations received1

Rapid progress in Artificial Intelligence (AI) over the past few years has unfolded important questions—and triggered anxiety—about the potential (mis)use of AI-generated content in information warfare and disinformation campaigns. A crucial question remains unanswered, however: whether—and to what extent—this technology can be harnessed in a credible way by extremists, whose language is usually characterized by highly specific subcultural registers that make them unlikely to be easily mimicked by AI models. This paper answers that question, offering the first rigorous evaluation of the credibility of synthetic (AI-generated) extremist prose. Using an expert survey experiment measuring the credibility of fake incel forum posts and ISIS magazines paragraphs generated through an original workflow for the production of synthetic extremist text, we show that these texts have high credibility scores, confusing world-leading experts. These findings, which are discussed under the broader light of the emerging literature on nefarious “dual-use” of synthetic content, not only define and evaluate the threat of extremists harnessing language models for propaganda, but they also more broadly strengthen our understanding of the role language models are due to play in hostile political communication, and ultimately resurface the debate on the human costs of technological progress

Criminology · Political science · Terrorism · Violent extremism · Law · Psychology · Terrorism, Counterterrorism, and Political Violence

  • Virtual terror? A critical reappraisal of the internet’s direct role in jihadist violence

    Francesco Marone•Global Change Peace & Security•2026

Citations per year1
Citation span2026 - 2026 (1)
Highly citedNo

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae