A Process Evaluation Examining the Performance, Adherence, and Acceptability of a Physical Activity and Diet Artificial Intelligence Virtual Health Assistant

Bibliographic Data

ID15497366
AuthorsCourtney R Davis (0000-0002-3866-2603, University of South Australia), Karen Murphy (0000-0002-2589-1319, University of South Australia), Rachel G Curtis (0000-0002-1341-7804, University of South Australia), Carol Maher (0000-0002-8676-0224, University of South Australia, corresponding author)
Year2020
Volume17
Issue23
Pages9137-9137
Publication date2020-12-07
Open AccessYes
TypeARTICLE
VenueInternational Journal of Environmental Research and Public Health (JOURNAL)
Journal identifiersISSN: 1661-7827 • E-ISSN: 1660-4601
PublisherMultidisciplinary Digital Publishing Institute (PUBLISHER • CH)
DOI10.3390/ijerph17239137
PMID33297456
OpenAlexW3111693918
LanguageEN
References cited4

Artificial intelligence virtual health assistants are a promising emerging technology. This study is a process evaluation of a 12-week pilot physical activity and diet program delivered by virtual assistant "Paola". This single-arm repeated measures study ( n = 28, aged 45-75 years) was evaluated on technical performance (accuracy of conversational exchanges), engagement (number of weekly check-ins completed), adherence (percentage of step goal and recommended food servings), and user feedback. Paola correctly asked scripted questions and responded to participants during the check-ins 97% and 96% of the time, respectively, but correctly responded to spontaneous exchanges only 21% of the time. Participants completed 63% of weekly check-ins and conducted a total of 3648 exchanges. Mean dietary adherence was 91% and was lowest for discretionary foods, grains, red meat, and vegetables. Participants met their step goal 59% of the time. Participants enjoyed the program and found Paola useful during check-ins but not for spontaneous exchanges. More in-depth knowledge, personalized advice and spontaneity were identified as important improvements. Virtual health assistants should ensure an adequate knowledge base and ability to recognize intents and entities, include personality and spontaneity, and provide ongoing technical troubleshooting of the virtual assistant to ensure the assistant remains effective

Medical education · Process (computing · Troubleshooting · AI in Service Interactions · Applied Psychology · Computer Science · Digital Mental Health Interventions · Medicine · Mobile Health and mHealth Applications · Psychology

Tools

Open DOIOpen Access