How Did the Generative Artificial Intelligence‐Assisted Digital Multimodal Composing Process Facilitate the Production of Quality Digital Multimodal Compositions

Toward a Process‐Genre Integrated Model

Bibliographic Data

ID7169331
AuthorsLianjiang Jiang (0000-0002-6662-5332, Academic Unit of Language and Literacy Education, Faculty of Education The University of Hong Kong Pokfulam Hong Kong, corresponding author), Chun Lai (0000-0002-7915-113X, Academic Unit of Language and Literacy Education, Faculty of Education The University of Hong Kong Pokfulam Hong Kong)
Year2025
Volume59
IssueS1
Publication date2025-12-01
Open AccessYes
TypeARTICLE
VenueTESOL Quarterly (JOURNAL)
Journal identifiersISSN: 0039-8322 • E-ISSN: 1545-7249
PublisherWiley (PUBLISHER • GB)
DOI10.1002/tesq.3390
OpenAlexW4408815526
LanguageEN
Citations received26
References cited33

The past decades witness an ongoing interest in reconceptualizing writing as digital multimodal composing (DMC). The emergence of language and multimodal generative artificial intelligence (GAI) tools leads to new forms of DMC processes and products. Yet prior studies have mostly examined non‐GAI‐assisted DMC, and few have explored how GAI‐assisted DMC processes would facilitate students' authoring of quality DMC products. This study addresses the gaps by conceptualizing the notion of quality DMC product, and comparing the composing processes and products of 14 GAI‐assisted DMC groups against 10 non‐GAI groups across four English classrooms. Multiple sources of data were collected for a mixed method study. The findings show that while non‐GAI groups demonstrated similar performance outcomes with GAI groups in base units, layouts, and rhetorical relations, the GAI groups had significantly higher scores in the development of purpose, outline/navigation skills, and their overall DMC outcomes. A taxonomy of GAI's affordances in facilitating DMC was also identified. Based on the findings, the study develops a process‐genre integrated GAI‐assisted DMC model for future teachers to guide students' GAI‐assisted DMC processes toward quality DMC product. This integrated model links DMC processes to products and specifies the roles of teachers and students when composing with GAI

Epistemology · Generative grammar · Multimodal therapy · Process (computing · Production (economics · Quality (philosophy · Artificial Intelligence · Computer Science · Discourse Analysis in Language Studies · Language, Metaphor, and Cognition · Psychology · Subtitles and Audiovisual Media

Tools

Open DOIOpen Access