Linguistic Adaptations During Spoken and Multimodal Error Resolution
Bibliographic Data
| ID | 10255269 |
|---|---|
| Authors | Sharon Oviatt (0000-0003-4664-1412, Oregon Graduate Institute of Science and Technology, corresponding author), Jon Bernard (Oregon Graduate Institute of Science and Technology), Gina-Anne Levow (Oregon Graduate Institute of Science and Technology), Gina‐Anne Levow (Oregon Museum of Science and Industry) |
| Year | 1998 |
| Volume | 41 |
| Issue | 3-4 |
| Pages | 419-442 |
| Publication date | 1998-07-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Language and Speech (JOURNAL) |
| Journal identifiers | ISSN: 0023-8309 • E-ISSN: 1756-6053 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/002383099804100409 |
| PMID | 10746365 |
| OpenAlex | W1899604934 |
| Language | EN |
| Citations received | 3 |
| References cited | 24 |
Fragile error handling in recognition-based systems is a major problem that degrades their performance, frustrates users, and limits commercial potential. The aim of the present research was to analyze the types and magnitude of linguistic adaptation that occur during spoken and multimodal human-computer error resolution. A semiautomatic simulation method with a novel error-generation capability was used to collect samples of users' spoken and pen-based input immediately before and after recognition errors, and at different spiral depths in terms of the number of repetitions needed to resolve an error. When correcting persistent recognition errors, results revealed that users adapt their speech and language in three qualitatively different ways. First, they increase linguistic contrast through alternation of input modes and lexical content over repeated correction attempts. Second, when correcting with verbatim speech, they increase hyperarticulation by lengthening speech segments and pauses, and increasing the use of final falling contours. Third, when they hyperarticulate, users simultaneously suppress linguistic variability in their speech signal's amplitude and fundamental frequency. These findings are discussed from the perspective of enhancement of linguistic intelligibility. Implications are also discussed for corroboration and generalization of the Computer-elicited Hyperarticulate Adaptation Model (CHAM), and for improved error handling capabilities in next-generation spoken language and multimodal systems
Adaptation (eye · Alternation (linguistics · Intelligibility (philosophy · Linguistics · Natural language processing · Perspective (graphical · Speech recognition · Spoken language · Artificial Intelligence · Computer Science · Neurobiology of Language and Bilingualism · Phonetics and Phonology Research · Psychology · Speech and dialogue systems
| Citations per year | 0.12 |
|---|---|
| Citation span | 2000 - 2013 (14) |
| Highly cited | No |