Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Challenges of multimodality

Language and the body in social interaction

Bibliographic Data

ID3612405
AuthorsL Mondada (0000-0002-7543-9769, University of Helsinki Finland, corresponding author)
Year2016
Volume20
Issue3
Pages336-366
Publication date2016-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueJournal of Sociolinguistics (JOURNAL)
Journal identifiersISSN: 1360-6441 • E-ISSN: 1467-9841
PublisherWiley (PUBLISHER • GB)
DOI10.1111/josl.1_12177
OpenAlexW2464690791
LanguageEN
Citations received252
References cited50

This article reflects on recent challenges emerging from the study of language and the body in social interaction. There is a general interest in language and the body across disciplines that has invited a reconceptualization of the broader issues relative to action, cognition, culture, knowledge, social relations and identities, spatiality and temporality. The study of social interaction focuses on how multimodal resources - including language and bodily movements - are holistically and situatedly used in building human action. This article discusses some consequences and challenges of putting the body at the center of attention: it repositions language as one among other modalities, and invites us to consider the involvement of entire bodies in social interaction, overcoming a logo-centric vision of communication, as well as a visuo-centric vision of embodiment. These issues are developed through a series of conversation analytic studies, firstly of classic topics in linguistics like deixis, then of more recent topics, such as mobility and sensoriality

Action (physics · Body language · Cognitive science · Conversation · Conversation analysis · Deixis · Epistemology · Linguistics · Modalities · Multimodality · Social relation · Social science · Sociology · Temporality · Communication · Discourse Analysis in Language Studies · Language, Discourse, Communication Strategies · Language, Metaphor, and Cognition · Psychology

  • Ending the VAR protocol

    Open Access•Mehmet Ali Icbay•Language & Communication•2026

  • Rethinking language through child-wor(l)d sociolinguistics

    Open Access•Khawla Badwan, John Bellamy•Language & Communication•2026

  • Multimodal Revoicing as an Interactional Mechanism for Connecting Scientific and Everyday Concepts

    Open Access•Virginia J Flood•Human Development•2018

  • The Cambridge Handbook of Computing Education Research

    Open Access•Sally A Fincher, Anthony V Robins•Cambridge Handbook of Computing…•2019

  • SLA and the Study of Equitable Multilingualism

    Open Access•Lourdes Ortega•Modern Language Journal•2019

  • Digital tool and material object

    Open Access•Piia Mikkola, Elina Salomaa et al.•Research on Language and Social…•2026

  • Indexing pragmatic functions of kiss-teeth through embodiment and viewpoint construction

    Open Access•Tatjana Schnellinger•Interactional Linguistics•2024

  • On the Multimodal Resolution of a Search Sequence in Virtual Reality

    Open Access•Nils Klowait, Zheng Yan•Human Behavior and Emerging…•2023

  • Talk and gesture in storytelling sequences in Mandarin conversation

    Xin Peng, Wei Zhang•Chinese Language and Discourse An…•2019

  • Language tester identity in policy contexts

    Open Access•Laura Schildt, Dorien Van De Mieroop et al.•Applied Linguistics•2025

  • Data Collection in Multimodal Language and Communication Research

    Open Access•Anastasia Bauer, Patrick C Trettenbrein et al.•Advances in Methods and Practices…•2026

  • Meaning transformation in multimodal digital media and translation strategies

    Open Access•Ya V Boiko, Віра Ніконова•Cognition communication discourse•2026

  • Using Interactional Analysis to Explore Musical Care

    Open Access•Kathryn Emerson•Music & Science•2026

  • Practiced language policy as a collaborative achievement in the family

    Open Access•Daniela Panìco, Antonia Rubino•Journal of Multilingual and…•2026

  • Modality, Multimodality

    Open Access•Mark A Sicoli•The International Encyclopedia of…•2020

  • Deixis and Indexicals

    Open Access•N Williams•The International Encyclopedia of…•2020

  • The types and functions of humor in the work of a United States Senator

    Open Access•Angela Cora Garcia•Language and Dialogue•2021

  • Negotiating leader identities through indirect mockery in talk about decision-making in a distributed leadership context

    Open Access•Elina Salomaa, Dorien Van De Mieroop et al.•Language and Dialogue•2024

  • El gesto es parte del discurso y apoya el aprendizaje

    Open Access•Leidy Vanessa Alarcón Lesmes, Ana Graciela Cifuentes Gualtero et al.•Trans-pasando Fronteras•2020

  • Variations of Multimodality in Design

    Open Access•Yuliya V Kalaikova•Articult•2021

  • Inspiração Etnográfica E O Papel Da Multimodalidade Na Análise De Uma Sequência De Fala-Em-Interação Institucional

    Open Access•Roberto Perobelli, Luana Santos Lemos•Revista (Con)Textos Linguísticos•2022

  • Dá zoom na imagem

    Open Access•Fernanda Miranda Da Cruz, Rosana Kelly Baldan et al.•Revista do GEL•2024

  • Multimodales Erzählen in der Orchesterprobe

    Open Access•Michael Messner, Monika Messner•Linguistik Online•2020

  • Ações corporificadas e construção de turnos em uma interação entre terapeuta e criança com Transtorno do Espectro Autista (TEA)

    Open Access•Fernanda Miranda Da Cruz, Ana Caroline Lopes Gomes Guerra et al.•Estudos Linguísticos (São Paulo…•2021

  • Alternativen namentlicher Anrede als Ressourcen sozialen Handelns

    Open Access•Pepe Droste•Namenkundliche Informationen•2020

  • Multimodal methods for managing deontic rights in interdisciplinary trials

    Open Access•Emilie Munch Nicolaisen, Gitte Rasmussen•Multimodality & Society•2023

  • Embodying intercultural communicative competence in French L2 video reflections

    Open Access•Julia A Gorham, Natalie Amgott•Multimodality & Society•2024

  • From Inanimate Object to Agent

    Open Access•Damien Rudaz, Karen Tatarian et al.•ACM Transactions on Human-Robot…•2023

  • The multimodal organization of feedback and its documentation

    Open Access•Joseph S Tomasine•Frontiers in Communication•2024

  • The Grammar of Obviousness

    Open Access•Olivia H Marrese, Chase Wesley Raymond et al.•Frontiers in Communication•2021

  • Turn Continuations and Gesture

    Open Access•Sara Rönnqvist, Jan Lindstrom•Frontiers in Communication•2021

  • Multimodal Gestalts and Their Change Over Time

    Open Access•Anja Stukenbrock•Frontiers in Communication•2021

  • “Abbiamo detto con te no che tu hai ta da di da dim (Moves Right Hand on the Beat)”—The Interplay of Semiotic Modes in Chamber Music Lessons Under a Multimodal and Interactional Perspective

    Open Access•Michael Messner, Monika Messner•Frontiers in Communication•2022

  • Devenir le King

    Open Access•Luca Greco•Signata•2020

  • Características sistemáticas de recursos multimodais mobilizados por uma criança com TEA em turnos de fala corporificados

    Open Access•Douglas Vidal Santiago•Domínios de Lingu gem•2020

  • Leading voices

    Open Access•Andy Lücking, Jonathan Ginzburg•Language and Cognition•2023

  • The sociality of minimizing involvement in self-service shops in Denmark

    Open Access•Gitte Rasmussen, Elisabeth Dalby Kristiansen•Discourse & Communication•2022

  • Appealing to the senses

    Open Access•L Mondada•Discourse & Communication•2022

  • Interactionally Embedded Gestalt Principles of Multimodal Human Communication

    Open Access•James P Trujillo, Judith Holler•Perspectives on Psychological…•2023

  • Persuasion in practice

    Open Access•Elin Nilsson, Anna Olaison•Qualitative Social Work•2022

  • Introducing the object of learning in interaction

    Open Access•Nina Kilbrink, Stig-Börje Asplund et al.•Journal of Vocational Education…•2023

  • Culturally and Linguistically Sustaining Formative Assessment in science and engineering

    Shakhnoza Kayumova, Akira Harper et al.•Journal of the Learning Sciences•2025

  • Configuring the Professional Touch in Physical Examinations in Chinese Outpatient Clinical Interaction

    Wen Ma, Shuai Zhang et al.•Health Communication•2024

  • Establishing Common Ground Using Low Technology Communication Aids in Intermediary Mediated Police Investigative Interviews of Witnesses with an Intellectual Disability

    Open Access•Tina Pereira•International Journal for the…•2024

  • What can ‘professional vision’ tell us about teachers’ language alternation? A multimodal study of Chinese L2 classrooms

    Xiaoyun Wang•Language and Education•2026

  • The embodied work of teaching grammar and pronunciation in IELTS speaking tutorials

    Open Access•Eunseok Ro•Linguistics and Education•2021

  • Instructing embodied exercises in theatre rehearsals and virtual improvisation workshops – the affordances and constraints of different spatiomaterial environments

    Open Access•Marjo Savijärvi, Pilvi Heinonen•Linguistics and Education•2026

  • The co-construction of competence

    Open Access•Vivien Heller, Friederike Kern•Linguistics and Education•2021

  • Epistemic status as an analytic tool

    Open Access•Melita Morales•Linguistics and Education•2021

  • Accomplishing feedback through inscription during reading assessment interaction

    Open Access•Joseph S Tomasine•Linguistics and Education•2024

  • Visual Embodied Actions in Interview-Based Writing Research

    Open Access•Andrea R Olinger•Written Communication•2020

  • Emotion regulation as an interactional achievement

    Open Access•Claire Polo, Kristine Lund•European Journal of Psychology of…•2026

  • Orchestrating children’s action

    Open Access•Marilena Fatigante, Lilia Antici et al.•European Journal of Psychology of…•2022

  • Ideology, Policy, and Potentials for Dialogue

    Open Access•Stephen Daniel Looney•Modern Language Journal•2022

  • The interplay of nonverbal behavior, affect, and language in perceptions of second language ability

    Open Access•J Dylan Burton•Modern Language Journal•2025

  • Le déterminant démonstratif ce

    Walter De Mulder•Langue française•2021

  • Dramas of Reconciliation. A performance approach to the analysis of political apologies in international relations, written by Michel-André Horelt

    Open Access•Emile Reber, Elisabeth Reber•Contrastive Pragmatics•2021

  • Promoting multimodal practices in multilingual classes of Italian in Canada and in Italy

    Open Access•Giuliana Salvato•Translation and Translanguaging…•2020

  • Non-convergent boundaries and action ascription in multimodal interaction

    Open Access•Verónica González Temer, Richard Ogden•Open Linguistics•2021

  • “Don't touch”

    Open Access•Ulla Karvonen, Sara Routarinne et al.•Learning Culture and Social…•2023

  • Instructions in horseback riding - The collaborative achievement of an instructional space

    Open Access•Susanne Lundesjö Kvart•Learning Culture and Social…•2020

  • Learning to perform

    Open Access•Antonia Ivaldi, Alice Sanderson et al.•Learning Culture and Social…•2021

  • No place for remote students? Navigating transitions of hybrid co-presence in seminar rooms and lecture halls

    Open Access•Kenan Hochuli, Johanna Jud•Learning Culture and Social…•2025

  • Rapport-building attempts in technology-mediated job interviews during the Covid-19 crisis

    Melina De Dijn, Dorien Van De Mieroop•Linguistics Vanguard•2025

  • Monitoring and evaluating body knowledge

    M Stevanovic•Linguistics Vanguard•2021

  • Situating embodied instruction – proxemics and body knowledge

    Darren J Reed•Linguistics Vanguard•2021

  • The (near) absence of English in Flemish dinner table conversations

    Eline Zenner, Dorien Van De Mieroop•Applied Linguistics Review•2021

  • Using PowerPoint slides as a resource for coordinating understanding during presentation consultations at an L2 speaking center

    Open Access•Eunseok Ro•Applied Linguistics Review•2023

  • La vidéo-ethnographie des rencontres et côtoiements de trafic dans les nouvelles formes de mobilités urbaines

    Open Access•C Licoppe•Parcours anthropologiques•2020

  • Exploring the intersection between collective and hierarchical leadership in online team meetings in Turkey

    Open Access•Özlem Özbakış, Hale Işık Güler et al.•Discourse & Communication•2026

  • Interactionism in the age of ubiquitous telecommunication

    Nils Klowait•Information Communication & Society•2019

  • Materializing assessment

    Sarah Sok, Qian Du et al.•International Journal of…•2023

  • Beyond language fluidity

    Lupe Rincon-Mendoza•International Journal of…•2023

  • Exploring the status of filled pauses as pragmatic markers

    Open Access•Loulou Kosmala•Pragmatics & Cognition•2022

  • O trabalho técnico-metodológico e analítico com dados interacionais audiovisuais

    Open Access•Fernanda Miranda Da Cruz, Ana Cristina Ostermann et al.•DELTA Documentação de Estudos em…•2019

  • Talking without a Voice

    Open Access•Maria A Erofeeva, Nils Klowait et al.•Sociology of power•2021

  • Initiating interactions in the toddler peer group

    Bryndís Gunnarsdóttir, A Bateman•Research on Children and Social…•2022

  • Becoming skilled at explaining and arguing

    Vivien Heller, Martin Luginbühl et al.•Research on Children and Social…•2020

  • ‘Yes, we’re done’ – ‘except Ricardo’

    Daniel Müller-Feldmeth, Tamara Koch et al.•Research on Children and Social…•2023

  • A Teacher’s Multimodal Corrective Feedback

    Open Access•Mokarrameh Bayat, Majid Elahi Shirvan et al.•Polish Psychological Bulletin•2020

  • The International Conference on Conversation Analysis

    J S Robles•QMiP Bulletin•2019

  • Rethinking linguistic feedback

    Open Access•Anastasia Bauer, Sonja Gipper et al.•Glossa a journal of general…•2026

  • How to Speak Silently - Rethinking Materiality, Agency, and Communicative Competence in Virtual Reality

    Open Access•Maria Erofeeva, Nils Klowait et al.•Sociology of power•2023

  • Mobilizing picture books

    Open Access•Keisuke Kasuya•Linguistics and Education•2026

  • More Than Words

    Open Access•Yujong Park•International Journal of Applied…•2026

  • Revisiting presentative particles

    Open Access•Leon Shor, Anna Inbar et al.•Linguistics•2026

  • Making sense of conduct

    Open Access•Lele Xu, Wen Ma et al.•Journal of Pragmatics•2026

  • Interactional Adjustment

    Open Access•J Gasiorek, Ann Weatherall et al.•Journal of Language and Social…•2021

  • Team leadership in leisure sports groups

    Open Access•Sylvie Lacoste, Jiachen Yang•Leadership•2026

  • Knowledge-Building in Classroom

    Open Access•Qian Zhao, Zezhi Zheng•SAGE Open•2024

  • Reflection/Commentary on a Past Article

    Open Access•C Davidson•International Journal of…•2018

  • Early Responses

    Open Access•Arnulf Deppermann, L Mondada et al.•Discourse Processes•2021

  • Multiactivity in adult-child interaction

    Anna Vatanen, Pentti Haddington•Text and Talk•2021

  • Using written task answer sheets as notes while speaking

    Eunseok Ro•Text and Talk•2021

  • Monitoring the swimzone while finding south

    Harrison, Robert F Williams•Text and Talk•2017

  • Note-taking/making as a resource for substantiating advice at a second language speaking center

    Eunseok Ro•Text and Talk•2021

  • The forms and functions of “Breaking into song” during in-group conversations

    Rosie Oxbury•Text and Talk•2020

  • The chair’s use of address terms in workplace meetings

    I Park•Text and Talk•2022

  • Syntax and music for interaction

    Open Access•Yuval Geva•Pragmatics Quarterly Publication…•2025

  • Perceiving the organisation through a coding scheme

    Open Access•Riikka Nissi, Esa Lehtinen•Pragmatics Quarterly Publication…•2024

  • Conducting interaction

    Adam Kendon•Conducting interaction•1990

  • Structures of Social Action

    Open Access•John Heritage, J Maxwell Atkinson•Structures of Social Action•1985

  • Technology in Action

    Open Access•C Heath, Paul Luff•Technology in Action•2000

  • Body Movement and Speech in Medical Interaction

    Open Access•C Heath, Katherine Nicholls•Body Movement and Speech in…•1986

  • Interaction and Grammar

    Open Access•Elinor Ochs, Emanuel A Schegloff et al.•Interaction and Grammar•1996

  • The Handbook of Conversation Analysis

    Open Access•Jack Sidnell, Tanya Stivers•Handbook of Conversation Analysis•2012

  • Intercorporeality

    Christian Meyer, Jürgen Streeck et al.•Intercorporeality•2017

  • Multiactivity in Social Interaction

    Pentti Haddington, Tiina Keisanen et al.•Multiactivity in social interaction•2014

  • A Companion to Linguistic Anthropology

    Alessandro Duranti•A Companion to Linguistic…•2005

  • Studies in ethnomethodology

    Harold Garfinkel•Studies in ethnomethodology•1984

  • Lectures on Conversation

    Open Access•Harvey Sacks•Lectures on conversation•1995

  • Sequence Organization in Interaction

    Open Access•Emanuel A Schegloff•Sequence Organization in…•2007

  • Prosody in Conversation

    Open Access•John J Gumperz, Marjorie Harness Goodwin et al.•Prosody in Conversation•1996

  • Handbücher zur Sprach- und Kommunikationswissenschaft / Handbooks of Linguistics and Communication Science (HSK) 38/1

    Alan J Cienki, Silva H Ladewig et al.•Body - Language - Communication.…•2013

  • Relations in Public. Microstudies of the Public Order

    Open Access•Michael Dellwing•Goffman-Handbuch•2022

  • Syntax and Lexis in Conversation

    Auli Hakulinen, Margret Selting•Syntax and lexis in conversation•2005

  • Writing-in-interaction

    L Mondada, Kimmo Svinhufvud•Language and Dialogue•2016

  • Bodies in action

    L Mondada•Language and Dialogue•2014

  • Being There

    Andy Clark•Being There•1996

  • The Social Body

    N Crossley•The Social Body•2001

  • The Body and Social Theory

    Chris Shilling•The body and social theory•2003

  • Home position

    Harvey Sacks, Emanuel A Schegloff•Gesture•2002

  • Conversing While Massaging

    Aug Nishizaka, Masafumi Sunaga•Research on Language and Social…•2015

  • The Coordination of Talk and Touch in Adults’ Directives to Children

    Asta Cekaite•Research on Language and Social…•2015

  • From Talk to Text

    Martha L Komter•Research on Language and Social…•2006

  • The Organization of Turn-Taking in Pool Skate Sessions

    Jonas Ivarsson, C Greiffenhagen•Research on Language and Social…•2015

  • The social history of the natural history of an interview

    Wendy Leeds-Hurwitz, Wendy Leeds‐hurwitz•Research on Language and Social…•1987

  • The Embodied Turn in Research on Language and Social Interaction

    Maurice Nevile•Research on Language and Social…•2015

  • Hand Touching Hand

    Open Access•Aug Nishizaka•Human Studies•2007

  • Multimodal resources for turn-taking

    Open Access•L Mondada•Discourse Studies•2007

  • Embodied reference

    Open Access•J Hindmarsh, C Heath•Journal of Pragmatics•2000

  • Communicating place, space and mobility

    Open Access•Paul Mcilvenny, Mathias Broth et al.•Journal of Pragmatics•2009

  • The local constitution of multimodal resources for social interaction

    L Mondada•Journal of Pragmatics•2014

  • Walking away

    Open Access•Mathias Broth, L Mondada•Journal of Pragmatics•2013

  • Multimodal interaction from a conversation analytic perspective

    Open Access•Arnulf Deppermann•Journal of Pragmatics•2013

  • Emergent focused interactions in public places

    Open Access•L Mondada•Journal of Pragmatics•2009

  • Action and embodiment within situated human interaction

    Open Access•Charles Goodwin•Journal of Pragmatics•2000

  • A Simplest Systematics for the Organization of Turn-Taking for Conversation

    Open Access•Harvey Sacks, Emanuel A Schegloff et al.•Language•2025

  • Relations in Public

    Erving Goffman, Philip Manning•Relations in public•2017

  • Professional Vision

    Open Access•Charles Goodwin•American Anthropologist•1994

Unique citing works252
Citations per year25,2
Citation span2016 - 2026 (11)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 249

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae