Semiotic Analysis of Robot Sounds in Films

Implications for Sound Design in Social Robotics

Bibliographic Data

ID21199879
AuthorsAdrian Benigno Latupeirissa (0000-0003-3572-6429, KTH Royal Institute of Technology, corresponding author), Akshata Murdeshwar (0000-0002-3827-7705, KTH Royal Institute of Technology), Roberto Bresin (0000-0002-3086-0322, KTH Royal Institute of Technology)
Year2025
Volume17
Issue1
Pages39-58
Publication date2025-01-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueInternational Journal of Social Robotics (JOURNAL)
Journal identifiersISSN: 1875-4791 • E-ISSN: 1875-4805
PublisherSpringer Science and Business Media LLC (PUBLISHER)
DOI10.1007/s12369-024-01186-2
OpenAlexW4404887853
LanguageEN
References cited35

This paper investigates the sound design of robots in films and their potential influence on the field of social robotics. Cinematic robot portrayals have inspired researchers and practitioners in Human-Robot Interaction (HRI). While the non-verbal sounds of iconic film robots like R2-D2 and Wall-E have been explored, this study takes a more comprehensive approach. We explore a broader selection of 15 films featuring humanoid robots across decades through a semiotic analysis of their non-verbal communication sounds, including those related to movements and internal mechanisms . Informed by Bateman and Schmidt’s multimodal film analysis framework, which draws on Saussure’s organization of signs through paradigmatic and syntagmatic relations, our analysis interprets the paradigmatic axis as an examination of the sound and the syntagmatic axis as an exploration of the events surrounding the sound. The findings uncover two primary film robot sound materials: mechanical and synthetic. Furthermore, the analysis revealed several narrative themes, categorized into two groups based on the syntagmatic focus: sounds associated with the robots’ visual appearances and sounds linked to the broader elements within the scene. The discussion section explores the implications of these findings for social robotics, including the importance of sound materials, the role of movement sounds in communication and emotional expression, and the significance of narrative and context in human-robot interaction. The paper also acknowledges the challenges in translating film sound design into practical applications in social robotics. This study provides valuable insights for HRI researchers, practitioners, and sound designers seeking to enhance non-verbal auditory expressions in social robots

Acoustics · Cognitive science · Linguistics · Mechatronics · Mobile robot · Physics · Robot · Robot control · Robotics · Semiotics · Social robot · Sound design · Computer Science · Engineering · Multisensory perception and integration · Music Technology and Sound Studies · Philosophy · Psychology · Social Robot Interaction and HRI · Artificial Intelligence

Tools

Open DOIOpen Access