Towards Culture-Aware Co-Speech Gestures for Social Robots

Dados Bibliográficos

ID8075232
AutoresAriel Gjaci (0000-0001-9794-5200, autor correspondente), Carmine Tommaso Recchiuto (0000-0001-9550-3740), Antonio Sgorbissa (0000-0001-7789-4311)
Ano2022
Volume14
Fascículo6
Páginas1493-1506
Data de publicação2022-06-03
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoInternational Journal of Social Robotics (JOURNAL)
Identificadores do periódicoISSN: 1875-4791 • E-ISSN: 1875-4805
EditoraSpringer Science+Business Media (PUBLISHER • DE)
DOI10.1007/s12369-022-00893-y
OpenAlexW4281639830
IdiomaEN
Citações recebidas2
Referências citadas40

Embedding social robots with the capability of accompanying their sentences with natural gestures may be the key to increasing their acceptability and their usage in real contexts. However, the definition of natural communicative gestures may not be trivial, since it strictly depends on the culture of the person interacting with the robot. The proposed work investigates the possibility of generating culture-dependent communicative gestures, by proposing an integrated approach based on a custom dataset composed exclusively of persons belonging to the same culture, an adversarial generation module based on speech audio features, a voice conversion module to manage the multi-person dataset, and a 2D-to-3D mapping module for generating three-dimensional gestures. The approach has eventually been implemented and tested with the humanoid robot Pepper. Preliminary results, obtained through a statistical analysis of the evaluations made by human participants identifying themselves as belonging to different cultures, are discussed.

Adversarial system · Embedding · Gesture · Human–computer interaction · Human–robot interaction · Humanoid robot · Key (lock · Natural (archaeology · Natural language processing · Robot · Speech recognition · Computer Science · Hand Gesture Recognition Systems · Multimodal Machine Learning Applications · Social Robot Interaction and HRI · Artificial Intelligence