Improving the Transparency of Robot Policies Using Demonstrations and Reward Communication

Bibliographic Data

ID22190847
AuthorsM H Lee (0000-0003-2896-4840, Carnegie Mellon University), Michael S Lee (0000-0001-8407-3423, Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA), Reid Simmons (0000-0003-3153-0453, Carnegie Mellon University), Henny Admoni (0000-0003-1796-2196, Carnegie Mellon University)
Year2025
Volume14
Issue4
Pages1-31
Publication date2025-12-31
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueACM Transactions on Human-Robot Interaction (JOURNAL)
Journal identifiersISSN: 2573-9522 • E-ISSN: 2573-9522
PublisherAssociation for Computing Machinery (ACM) (PUBLISHER)
DOI10.1145/3743150
OpenAlexW4411176198
LanguageEN
References cited39

Demonstrations are a powerful way to teach robot decision-making to humans. Although informative demonstrations may be selected a priori using the machine teaching framework, student learning may deviate from the pre-selected curriculum in situ. This article thus explores augmenting a curriculum of pre-selected demonstrations with a closed-loop teaching framework inspired by principles from the education literature, such as the zone of proximal development and the testing effect. We utilize tests accordingly to close the loop and maintain a novel particle filter model of human beliefs throughout the learning process, allowing us to provide demonstrations that are targeted at the human’s current understanding in real time. A user study finds that our proposed closed-loop teaching framework reduces the regret (i.e., the suboptimality) of human test responses by 43% over an open-loop baseline. We also compare our closed-loop teaching framework against another baseline of directly communicating the robot’s reward function in a second user study. We find that our closed-loop teaching outperforms direct reward communication by 64%, but we also observe synergies from the use of both teaching forms. Finally, we observe strong interaction effects between the teaching form and the domains considered in both user studies, seeing increased learning outcomes from well-designed demonstration-based teaching in the more challenging domain

Business · Computer security · Human–computer interaction · Robot · Computer Science · Ethics and Social Impacts of AI · Psychology · Reinforcement Learning in Robotics · Robot Manipulation and Learning · Artificial Intelligence

Tools

Open DOI