Robots’ “Woohoo” and “Argh” Can Enhance Users’ Emotional and Social Perceptions

An Exploratory Study on Non-lexical Vocalizations and Non-linguistic Sounds

Bibliographic Data

ID8070833
AuthorsXiaozhen Liu (0009-0005-8675-9935, Virginia Tech, corresponding author), Jiayuan Dong (0000-0002-7253-8868, Virginia Tech), Myounghoon Jeon (0000-0003-2908-671X, Virginia Tech)
Year2023
Volume12
Issue4
Pages1-20
Publication date2023-10-17
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueACM Transactions on Human-Robot Interaction (JOURNAL)
Journal identifiersISSN: 2573-9522 • E-ISSN: 2573-9522
PublisherAssociation for Computing Machinery (PUBLISHER • US)
DOI10.1145/3626185
OpenAlexW4387708086
LanguageEN
Citations received2
References cited58

As robots have become more pervasive in our everyday life, social aspects of robots have attracted researchers’ attention. Because emotions play a crucial role in social interactions, research has been conducted on conveying emotions via speech. Our study sought to investigate the synchronization of multimodal interaction in human-robot interaction (HRI). We conducted a within-subjects exploratory study with 40 participants to investigate the effects of non-speech sounds (natural voice, synthesized voice, musical sound, and no sound) and basic emotions (anger, fear, happiness, sadness, and surprise) on user perception with emotional body gestures of an anthropomorphic robot (Pepper). While listening to a fairytale with the participant, a humanoid robot responded to the story with recorded emotional non-speech sounds and gestures. Participants showed significantly higher emotion recognition accuracy from the natural voice than from other sounds. The confusion matrix showed that happiness and sadness had the highest emotion recognition accuracy, which is in line with previous research. The natural voice also induced higher trust, naturalness, and preference compared to other sounds. Interestingly, the musical sound mostly showed lower perception ratings, even compared to no sound. Results are discussed with design guidelines for emotional cues from social robots and future research directions

Active listening · Anger · Cognitive psychology · Emotion Perception · Exploratory research · Facial expression · Gesture · Happiness · Natural (archaeology · Perception · Prosody · Sadness · Speech recognition · Surprise · Computer Science · Emotion and Mood Recognition · Infant Health and Development · Psychology · Social Robot Interaction and HRI · Communication · Social Psychology

Tools

Open DOIOpen Access