John A Bateman

Biographic Data

ID221585
NAMEJohn A Bateman
GIVEN NAMESJohn A
FAMILY NAMEBateman
SIGNATUREBATEMAN J A
AFFILIATIONSUniversity of Bremen
ORCID0000-0002-7209-9295
VERIFIEDYes
TOTAL WORKS41
TOTAL CITATIONS100
AUTHOR COUNT41
EDITOR COUNT0
FIRST PUBLICATION YEAR1989
LATEST PUBLICATION YEAR2026
H-INDEX5

  • Multimodal Corpus‐Based Approaches

    Open AccessJohn A BatemanCHAPTEREncyclopedia of Applied Linguistics2026

    Growing out of earlier corpus work on verbal language, multimodal corpora are specially collected and curated representations of authentic communications where multiple expressive resources are at work. Such expressive resources are usually characterized in terms of “modes,” which is why the corresponding corpora are termed “multimodal.” “Modes” may include sensory modes (i.e., expressive resources distinguished by sight, hearing, touch, etc.), a…

  • Contrasting public, market-driven and populist news videos on Covid-19

    Open AccessChiao-I Tseng, John A Bateman et al.ARTICLEMultimodality & Society2026

    This paper introduces a novel method for investigating how public service, market-driven, and populist news outlets differ in their construction of ideological positions in audiovisual reporting. A semi-automatic framework of multimodal semiotic content analysis is presented that combines computational audiovisual feature detection with theory-driven manual annotation of discourse and narrative elements and shows early results concerning the cons…

  • Multimodal Cohesion

    Open AccessJohn A Bateman, Chiao-I Tseng et al.CHAPTEREncyclopedia of Applied Linguistics2025

    Multimodal cohesion extends the notion of cohesion originally developed for verbal language so as to apply to communicative artefacts or performances constituted by any combination of semiotic systems, such as static and dynamic images, diagrams, gestures, and sounds. The basic tenet of multimodal cohesion is that recurrences of images, sounds, verbal language, written language, camera movements, framings, musical motifs, sounds, shapes, colors, …

  • Multimodality writes back

    Open AccessJohn A BatemanARTICLELanguage, Context and Text. The…2025

    This paper critically engages with the treatment of “context” in SFL, particularly the contextual variable of mode, arguing that approaches to date have been hindered by focusing too narrowly on language. Although this might sound reasonable for a linguistic theory, the discussion here will suggest that overlooking the fact that language never occurs in context alone compromises the task of characterising context appropriately. By drawing on the …

  • Reflections on Cope and Kalantzis and the intrinsic multimodality of generative AI

    Open AccessJohn A BatemanARTICLEMultimodality & Society2025

    In Cope and Kalantzis's recent discussion in this journal concerning the organization and capabilities of Generative AI, they argue that such systems exhibit critical limitations in their ability to engage with meaning and multimodality because of an alleged deep foundation in digitized ‘written texts’. In response to this, I explain why the core components of Generative AI are inherently multimodal and are not restricted to written language, or …

  • Distributed semiosis

    Arash Ghazvineh, Reza Afhami et al.ARTICLEText and Talk2025

    This paper argues that meaning-making in the digital age has undergone a fundamental shift, no longer confined to the province of human actors. In today’s complex digital environments, semiosis – the core mechanism of signification – has become a distributed process, emerging from dynamic interactions among human users, algorithmic agents, and technological affordances. This shift challenges traditional anthropocentric models of semiosis and unde…

  • Linking multimodal cohesion, gaze behaviour and learning outcome in educational videos

    Open AccessFlorian Schmidt-Borcherding, Leandra Thiele et al.ARTICLEVisual Communication2025

    Multimodal design in educational videos is a complex task, requiring the effective integration of various semiotic modalities to promote understanding among recipients. While superficially meeting proposed multimedia design principles, educational videos vary significantly in effectiveness. To explore this variation, the authors conducted a 2 × 2 experimental study with 45 students, examining the impact of instructor presence and dynamic vs stati…

  • All eyes on the signal? - Mapping cohesive discourse structures with eye-tracking data of explanation videos

    Open AccessLeandra Thiele, Florian Schmidt-Borcherding et al.ARTICLEFrontiers in Communication2024

    In this paper, we consider the issue of how the fine-grained multimodal design of educational explanation videos, such as those widely available on YouTube and other platforms, may be made accessible to empirical studies of reception and effectiveness. This is necessary because previous research has often led to conflicting conclusions concerning the roles of particular design elements. We argue that this may largely be due to insufficient charac…

  • Towards semiotically driven empirical studies of ballet as a communicative form

    Open AccessArianna Maiorani, John A Bateman et al.ARTICLEHumanities and Social Sciences…2022

    This paper treats dance as a movement-based semiotic system, focusing on classical ballet as an example in order to show how dance can be made accessible to both detailed description and empirical investigation as a form of communication. The study contributes to a growing tradition of multidisciplinary research that looks at a variety of dance forms from the perspectives of linguistics, communication studies and social semiotics, drawing additio…

  • Multimodality, where next?–Some meta-methodological considerations

    Open AccessJohn A BatemanARTICLEMultimodality & Society2022

    In this position statement, I draw broadly on approaches and theories relevant to the phenomena of multimodality to propose some methodological directions for further cycles of development and application. Two apparently opposed goals are accepted and reconciled: on the one hand, increased attention needs to be paid to empirical studies and, on the other, highly exploratory and smaller scale case studies with more conjectural analyses need to be …

  • The impact of multimodal cohesion on attention and interpretation in film

    Open AccessChiao-I Tseng, Jochen Laubrock et al.ARTICLEDiscourse Context & Media2021Cited by: 2References: 5

  • What are digital media

    Open AccessJohn A BatemanARTICLEDiscourse Context & Media2021Cited by: 1References: 16

  • Explanation videos unravelled

    Open AccessJohn A Bateman, Leandra Thiele et al.ARTICLEJournal of Pragmatics2021Cited by: 1References: 3

    Explanation videos are increasingly common on media websites such as YouTube and are used by school students, university students, and members of the general public alike. Such videos cover all areas of knowledge and aim to provide viewer-appropriate explanations concerning a large variety of topics. It is, however, still far from clear how such videos work and under what conditions they are effective. In this paper, we consider how this can be m…

  • On the track of visual style

    Open AccessJohn A Bateman, Francisco Od Veloso et al.ARTICLEVisual Communication2019Cited by: 3References: 5

    Page layout is one of the most salient features of graphic novels and comics that readers encounter: even before engaging with specific content, an overall impression of the page composition will have already been communicated. In the critical literature on comics and graphic novels, it is also commonly claimed that page composition plays a significant role for narrative construction, pacing, and other aspects of reception. However, in contrast t…

  • Interpreting Text and Image Relations in Violent Extremist Discourse

    Kay L O’halloran, Sabine Tan et al.ARTICLETerrorism and Political Violence2019Cited by: 4

    This article presents a mixed methods approach for analysing text and image relations in violent extremist discourse. The approach involves integrating multimodal discourse analysis with data mining and information visualisation, resulting in theoretically informed empirical techniques for automated analysis of text and image relations in large datasets. The approach is illustrated by a study which aims to analyse how violent extremist groups use…

  • Multimodality and Materiality

    John A BatemanARTICLEPoetics Today2019References: 48

    The study of multimodality is concerned with how multiple expressive resources may be effectively combined in communication. In recent years the potential domains of applications of multimodality studies have expanded considerably. Ever more diverse combinations of expressive resources are employed in a host of media, both new and old. With this expansion it has become increasingly evident that an adequate understanding of the workings of such me…

  • Towards critical multimodal discourse analysis

    John A BatemanARTICLECritical Discourse Studies2018Cited by: 3References: 5

    Ledin and Machin's critique of the use of some current approaches to multimodality for the purposes of critical discourse studies raises some important methodological concerns that need to be addressed. However, both the particular position they develop as well as some of the key points they raise are themselves problematic. In this response, I argue that Ledin and Machin misconstrue some significant aspects of the body of theory they critique an…

  • Multimodality

    John A Bateman, John Bateman et al.BOOKMultimodality2017

    This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many di…

  • Critical discourse analysis and film

    John A BatemanCHAPTERRoutledge Handbook of Critical…2017

    This chapter illustrates how some of the multimodal extensions to discourse analysis just mentioned may provide for an increased connection between film analysis and the concerns and methods of Critical discourse analysis (CDA). It focuses on specifically filmic mechanisms that call equally for critical analysis. Apparatus theory is probably the most far reaching of associations between film and ideology to have been drawn and, as a consequence, …

  • Triangulating transmediality

    Open AccessJohn A BatemanARTICLEDiscourse Context & Media2017Cited by: 3References: 11

  • Towards next-generation visual archives

    John A Bateman, John Bateman et al.ARTICLEVisual Studies2016

    The digital turn in visual studies has played a major role in the terminological overlap between ‘archive’, ‘database’ and ‘corpus’, and it has brought about a number of positive developments such as improved accessibility and availability. At the same time, it has also raised important questions pertaining to the materiality, searchability, annotation and analysis of the data at hand. Through a series of theoretical constructs and empirical exam…

  • Visual archives in the digital age

    Marion G Müller, Marion Müller et al.ARTICLEVisual Studies2016

    This special issue is the outcome of an international symposium on the topic ‘Visual Archives in the Digital Age’, which took place at the Jacobs University in Bremen and was funded by the German F

  • A Digital Mixed Methods Research Design

    Open AccessKay L O’halloran, Sabine Tan et al.ARTICLEJournal of Mixed Methods Research2016Cited by: 13References: 5

    This article demonstrates how a digital environment offers new opportunities for transforming qualitative data into quantitative data in order to use data mining and information visualization for mixed methods research. The digital approach to mixed methods research is illustrated by a framework which combines qualitative methods of multimodal discourse analysis with quantitative methods of data mining and information visualization in a multileve…

  • Category Mistakes

    John A BatemanARTICLEThe Philosophical Quarterly2016

    Journal Article Category Mistakes Get access Category Mistakes.ByMagidor Ofra. (Oxford: OUP, 2013. Pp. xi + 171. Price £30.00.) John A. Bateman John A. Bateman Bremen University, Bremen, Germany E-mail: [email protected] Search for other works by this author on: Oxford Academic Google Scholar The Philosophical Quarterly, Volume 66, Issue 263, April 2016, Pages 402–405, https://doi.org/10.1093/pq/pqv059 Published: 30 June 2015

  • Text and Image

    John A BatemanBOOKText and Image2014

    Text and image are used together in an increasingly flexible fashion and many disciplines and areas of study are now attempting to understand how these combinations work.This introductory textbook explores and analyses the various approaches to multimodality and offers a broad, interdisciplinary survey of all aspects of the text-image relation. It leads students into detailed discussion concerning a number of approaches that are used. It also bri…