Towards Culture-Aware Co-Speech Gestures for Social Robots

Datos Bibliográficos

ID8075232
AutoresAriel Gjaci (0000-0001-9794-5200, autor de correspondencia), Carmine Tommaso Recchiuto (0000-0001-9550-3740), Antonio Sgorbissa (0000-0001-7789-4311)
Año2022
Volumen14
Número6
Páginas1493-1506
Fecha de publicación2022-06-03
Peer ReviewedSí
Open AccessSí
TipoARTICLE
RevistaInternational Journal of Social Robotics (JOURNAL)
Identificadores de la revistaISSN: 1875-4791 • E-ISSN: 1875-4805
EditorialSpringer Science+Business Media (PUBLISHER • DE)
DOI10.1007/s12369-022-00893-y
OpenAlexW4281639830
IdiomaEN
Citas recibidas2
Referencias citadas40

Embedding social robots with the capability of accompanying their sentences with natural gestures may be the key to increasing their acceptability and their usage in real contexts. However, the definition of natural communicative gestures may not be trivial, since it strictly depends on the culture of the person interacting with the robot. The proposed work investigates the possibility of generating culture-dependent communicative gestures, by proposing an integrated approach based on a custom dataset composed exclusively of persons belonging to the same culture, an adversarial generation module based on speech audio features, a voice conversion module to manage the multi-person dataset, and a 2D-to-3D mapping module for generating three-dimensional gestures. The approach has eventually been implemented and tested with the humanoid robot Pepper. Preliminary results, obtained through a statistical analysis of the evaluations made by human participants identifying themselves as belonging to different cultures, are discussed.

Adversarial system · Embedding · Gesture · Human–computer interaction · Human–robot interaction · Humanoid robot · Key (lock · Natural (archaeology · Natural language processing · Robot · Speech recognition · Computer Science · Hand Gesture Recognition Systems · Multimodal Machine Learning Applications · Social Robot Interaction and HRI · Artificial Intelligence