The Language of AI and Human Poetry

A Comparative Lexicometric Study

Bibliographic Data

ID21439239
AuthorsAfendi Hamat (0000-0003-2060-9203, National University of Malaysia, corresponding author)
Year2024
Volume30
Issue2
Pages1-20
Publication date2024-06-27
Open AccessYes
TypeARTICLE
Venue3L The Southeast Asian Journal of English Language Studies (JOURNAL)
Journal identifiersISSN: 0128-5157 • E-ISSN: 2550-2247
PublisherPenerbit Universiti Kebangsaan Malaysia (UKM Press) (PUBLISHER)
DOI10.17576/3l-2024-3002-01
OpenAlexW4400101847
LanguageEN
Citations received2
References cited12

This study conducts a lexicometric analysis to compare the lexical richness and diversity in poetry generated by AI models with that of human poets. Employing a robust dataset that includes 1,333 AI-generated poems and 517 human-authored poems across seven distinct poetic eras, six key lexical metrics—Maas Index, MTLD, MATTR, HD-D, Hapax Legomenon Ratio, and Lexical Density—were applied for comparative analysis. The lexical characteristics of the poems were studied through a series of statistical tests and machine learning techniques, including Mann-Whitney U tests, Cliff's Delta, and Random Forest classification. The findings reveal a marked lexical superiority in human poetry, evidenced by significant differences and large effect sizes in all metrics except Lexical Density. HD-D emerged as the most discriminating factor, adeptly differentiating human poetry from its AI-generated counterpart. Further analysis identified the GPT-4 model as exhibiting the closest alignment to human poetry in terms of lexical attributes. The study discusses these outcomes in the context of AI's evolving linguistic competencies, shedding light on the inherent challenges and future prospects of AI in creative writing. Thus, this research provides an empirical framework for assessing AI’s language generation abilities and sets the stage for further interdisciplinary exploration into the frontiers of artificial creativity. Keywords: artificial intelligence; lexicometry; machine learning; lexical analysis; poetry

Archaeology · Context (archaeology) · Creativity · Lexical density · Lexical Diversity · Lexical item · Linguistics · Natural language processing · Poetry · Vocabulary · Advanced Text Analysis Techniques · Artificial Intelligence · Computer Science · History · Natural Language Processing Techniques · Philosophy · Psychology · Social Psychology · Topic Modeling

Tools

Open DOIOpen Access