Human-AI collaboration patterns in AI-assisted academic writing

Bibliographic Data

ID4097075
AuthorsAndy Nguyen (0000-0002-0759-9656, University of Oulu, corresponding author), Yvonne Hong (0000-0002-0046-3983, Victoria University of Wellington), Belle Dang (0009-0006-8734-6697, University of Oulu), Xiaoshan Huang (0000-0002-2853-7219, McGill University)
Year2024
Volume49
Issue5
Pages847-864
Publication date2024-05-03
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueStudies in Higher Education (JOURNAL)
Journal identifiersISSN: 0307-5079 • E-ISSN: 1470-174X
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/03075079.2024.2323593
OpenAlexW4392239564
LanguageEN
Citations received111
References cited34

Artificial Intelligence (AI) has increasingly influenced higher education, notably in academic writing where AI-powered assisting tools offer both opportunities and challenges.Recently, the rapid growth of generative AI (GAI) has brought its impacts into sharper focus, yet the dynamics of its utilisation in academic writing remain largely unexplored.This paper focuses on examining the nature of human-AI interactions in academic writing, specifically investigating the strategies doctoral students employ when collaborating with a GAI-powered assisting tool.This study involves 626 recorded activities on how ten doctoral students interact with GAI-powered assisting tool during academic writing.AIdriven learning analytics approach was adopted for three layered analyses: (1) data pre-processing and analysis with quantitative content analysis, (2) sequence analysis with Hidden Markov Model (HMM) and hierarchical sequence clustering, and (3) pattern analysis with process mining.Findings indicate that doctoral students engaging in iterative, highly interactive processes with the GAI-powered assisting tool generally achieve better performance in the writing task.In contrast, those who use GAI merely as a supplementary information source, maintaining a linear writing approach, tend to get lower writing performance.This study points to the need for further investigations into human-AI collaboration in learning in higher education, with implications for tailored educational strategies and solutions

Academic writing · Data science · Generative grammar · Hidden Markov model · Higher education · Learning analytics · Mathematics education · Writing process · Business Process Modeling and Analysis · Computer Science · Engineering · Online Learning and Analytics · Psychology · Software Engineering Research · Artificial Intelligence

Tools

Open DOIOpen Access