Multimodal semiotic content analysis
Combining quantitative large-data analysis with qualitative semiotic coding
Bibliographic Data
| ID | 19224685 |
|---|---|
| Authors | Chiao-I Tseng (0000-0001-6902-7322, University of Gothenburg, corresponding author), Emily Fielder (University of Gothenburg), Luise Charlotte Claire Wenk (University of Gothenburg) |
| Year | 2026 |
| Publication date | 2026-05-22 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Visual Communication (JOURNAL) |
| Journal identifiers | ISSN: 1470-3572 • E-ISSN: 1741-3214 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/14703572261418120 |
| OpenAlex | W7162113247 |
| Language | EN |
| Citations received | 1 |
| References cited | 11 |
This article proposes a mixed-method framework for multimodal semiotic content analysis that systematically integrates qualitative semiotic coding with quantitative large-scale data analysis. Building on earlier frameworks by Bell and Milic (‘Goffman’s gender advertisements revisited: combining content analysis with semiotic analysis’, in Visual Communication , 2002) and Serafini and Reid (‘Multimodal content analysis: expanding analytical approaches to content analysis’, in Visual Communication , 2023), the authors propose a more empirically rigorous method to conduct quantitative analysis. They highlight the limitation of frequency counts through percentage comparisons and advocate for using proper statistical methods for identifying meaningful co-patterning of semiotic resources. Their approach also emphasizes the importance of transparent coding practices, detailed codebooks, pilot coding and intercoder reliability testing to enhance replicability and validity. The framework is illustrated through a case study of 277 depression-related internet memes. Results reveal significant associations across depression themes and semiotic resources of process types and social interaction, highlighting recurring communicative strategies such as infographical, emotional, dialogical and suicidal gaze memes. By demonstrating how multimodal choices co-pattern to construct meaning, this framework offers a practical, statistically grounded method for analysing complex visual and textual datasets beyond descriptive counts
Coding (social sciences) · Content analysis · Gaze · Grounded theory · Multimodality · Qualitative research · Semiotics · Social semiotics · Humor Studies and Applications · Media Influence and Health · Mental Health via Writing
Multimodality
Qualitative Content Analysis in Practice
An Introduction to Functional Grammar
Content Analysis in Mass Communication
Goffman’s Gender Advertisements revisited
A system for image-text relations in new (and old) media
Multimodal content analysis
Gamergate and The Fappening
Humor styles influence the perception of depression-related internet memes in depression
| Citations per year | 1 |
|---|---|
| Citation span | 2026 - 2026 (1) |
| Highly cited | No |