Scarecrows in Oz
The Use of Large Language Models in HRI
Bibliographic Data
| ID | 22190872 |
|---|---|
| Authors | Tom Williams (0000-0002-7901-4987, Colorado School of Mines), Cynthia Matuszek (0000-0003-1383-8120, University of Maryland, Baltimore County), Ross Mead (0000-0002-5664-4687, Semio, Inc., USA), Nick DePalma (0000-0003-0531-743X, Plus One Robotics, USA) |
| Year | 2024 |
| Volume | 13 |
| Issue | 1 |
| Pages | 1-11 |
| Publication date | 2024-03-31 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | ACM Transactions on Human-Robot Interaction (JOURNAL) |
| Journal identifiers | ISSN: 2573-9522 • E-ISSN: 2573-9522 |
| Publisher | Association for Computing Machinery (ACM) (PUBLISHER) |
| DOI | 10.1145/3606261 |
| OpenAlex | W4391351849 |
| Language | EN |
| Citations received | 2 |
| References cited | 31 |
The proliferation of Large Language Models (LLMs) presents both a critical design challenge and a remarkable opportunity for the field of Human–Robot Interaction (HRI). While the direct deployment of LLMs on interactive robots may be unsuitable for reasons of ethics, safety, and control, LLMs might nevertheless provide a promising baseline technique for many elements of HRI. Specifically, in this article, we argue for the use of LLMs as Scarecrows : “brainless,” straw-man black-box modules integrated into robot architectures for the purpose of quickly enabling full-pipeline solutions, much like the use of “Wizard of Oz” (WoZ) and other human-in-the-loop approaches. We explicitly acknowledge that these Scarecrows, rather than providing a satisfying or scientifically complete solution, incorporate a form of the wisdom of the crowd and, in at least some cases, will ultimately need to be replaced or supplemented by a robust and theoretically motivated solution. We provide examples of how Scarecrows could be used in language-capable robot architectures as useful placeholders and suggest initial reporting guidelines for authors, mirroring existing guidelines for the use and reporting of WoZ techniques
Human–computer interaction · Human–robot interaction · Interactor · Mirroring · Robot · Software deployment · Software engineering · Wizard · Wizard of oz · World Wide Web · Computer Science · Ethics and Social Impacts of AI · Multimodal Machine Learning Applications · Psychology · Reinforcement Learning in Robotics · Social Psychology · Artificial Intelligence
| Unique citing works | 2 |
|---|---|
| Citations per year | 2 |
| Citation span | 2026 - 2026 (1) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 2 |