Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Exploring student anxiety and experience in performance-based assessments using AIvaluate

An LLM-augmented emotionally intelligent pedagogical AI conversational agent

Bibliographic Data

ID21618288
AuthorsHabeeb Yusuf (0000-0001-5121-9641, University of London), Arthur Money (0000-0003-1063-3680, University of London, corresponding author), Damon Daylamani-Zad (0000-0001-7849-458X, University of London)
Year2026
Publication date2026-06-02
Open AccessYes
TypeARTICLE
VenueEducational Technology Research and Development (JOURNAL)
Journal identifiersISSN: 1042-1629 • E-ISSN: 1556-6501
PublisherSpringer Science and Business Media LLC (PUBLISHER)
DOI10.1007/s11423-026-10634-x
OpenAlexW7163204086
LanguageEN
References cited90

Performance-based assessments such as oral presentations and viva voce exams are valued for their pedagogical benefits but can also be associated with heightened student anxiety, which may affect a range of learners and hinder student motivation and overall assessment experience. This study explores the potential of AIvaluate; an emotionally intelligent, LLM-augmented conversational agent, to provide a more supportive assessment environment for such learners. Using a counterbalanced quasi-experimental, within-subjects design with 35 pre-university students, we compared experiences of traditional face-to-face assessments with AIvaluate-mediated sessions. Emotional state reports, usability ratings and qualitative feedback were analysed to evaluate anxiety, system usability and learner perceptions. Results indicated that students experienced significantly lower anxiety during AIvaluate sessions, and usability scores for the tool were rated in the “good” range. Thematic analysis further revealed perceived advantages such as reduced social pressure, flexible pacing and ease of use, alongside limitations including technical challenges and a lack of dynamic human interaction. Importantly, while these findings suggest that AI-mediated PBAs may reduce student anxiety, which may be beneficial for learners who experience heightened levels of anxiety that exceeds the individual zone of optimal functioning, further investigation is necessary to ascertain whether this is ultimately beneficial for learning and whether AI-mediated assessments can improve student attainment. Future research could explore the value of hybrid models that combine AI conversational agent-based and face-to-face assessment formats, and examine the long-term effects of AI-led assessments on student performance and well-being

Anxiety · Dynamic assessment · Qualitative research · Thematic analysis · Usability · AI in Service Interactions · Artificial Intelligence in Healthcare and Education · Intelligent Tutoring Systems and Adaptive Learning

  • Innovations and Challenges in Language Learning Motivation

    Zoltán Dörnyei•Innovations and Challenges in…•2020

  • A cognitive-behavioral model of anxiety in social phobia

    Open Access•Ronald M Rapee, Richard G Heimberg•Behaviour Research and Therapy•1997

  • An Empathy-Driven, Conversational Artificial Intelligence Agent (Wysa) for Digital Mental Well-Being

    Open Access•Becky Inkster, Shubhankar Sarda et al.•JMIR mHealth and uHealth•2018

  • Conversational agents in healthcare

    Open Access•Liliana Laranjo, Adam G Dunn et al.•Journal of the American Medical…•2018

  • ChatGPT and the rise of generative AI

    Open Access•Damian Eke•Journal of Responsible Technology•2023

  • Variability of worked examples and transfer of geometrical problem-solving skills

    Fred Paas, Fred G W C Paas et al.•Journal of Educational Psychology•1994

  • Eliza—a computer program for the study of natural language communication between man and machine

    Open Access•Joseph Weizenbaum•Communications of the ACM•1966

  • An overview of the features of chatbots in mental health

    Open Access•Alaa A Abd-alrazaq, Alaa Abd‐Alrazaq et al.•International Journal of Medical…•2019

  • Anxiety and cognitive performance

    Michael W Eysenck, Nazanin Derakshan et al.•Emotion•2007

  • Cognitive Load Theory and Complex Learning

    Open Access•Jeroen J G Van Merriënboer, John Sweller•Educational Psychology Review•2005

  • Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot)

    Open Access•Kathleen Kara Fitzpatrick, Alison Darcy et al.•JMIR Mental Health•2017

  • Effects of artificial intelligence on English speaking anxiety and speaking performance

    Open Access•Reham El Shazly•Expert Systems•2021

  • Opinion Paper

    Open Access•Yogesh K Dwivedi, Nir Kshetri et al.•International Journal of…•2023

  • Chatbots

    Open Access•Eleni Adamopoulou, Lefteris Moussiades•Machine Learning with Applications•2020

  • Why Teachers Adopt a Controlling Motivating Style Toward Students and How They Can Become More Autonomy Supportive

    Johnmarshall Reeve•Educational Psychologist•2009

  • The relation of strength of stimulus to rapidity of habit‐formation

    Open Access•Robert M Yerkes, John Dodson et al.•Journal of Comparative Neurology…•1908

  • Thematic analysis.

    Braun, Victoria Clarke•APA Handbook of Research Methods…•2012

  • A Theoretical Extension of the Technology Acceptance Model

    Open Access•Vivek Venkatesh, Viswanath Venkatesh et al.•Management Science•2000

  • The Control-Value Theory of Achievement Emotions

    Open Access•Reinhard Pekrun•Educational Psychology Review•2006

  • Cognitive Load During Problem Solving

    Open Access•John Sweller•Cognitive Science•1988

  • Pedagogical AI conversational agents in higher education

    Open Access•Habeeb Yusuf, Arthur Money et al.•Educational Technology Research…•2025

  • Impacts of an AI-based chabot on college students’ after-class review, academic performance, self-efficacy, learning attitude, and motivation

    Open Access•Yen-Fen Lee, Gwo-Jen Hwang et al.•Educational Technology Research…•2022

  • Rethinking assessment in response to generative artificial intelligence

    Open Access•Jacob Pearce, Neville Chiavaroli•Medical Education•2023

  • A worked example of Braun and Clarke’s approach to reflexive thematic analysis

    Open Access•David Byrne•Quality & Quantity•2022

  • Assessing student perceptions and use of instructor versus AI ‐generated feedback

    Open Access•Erkan Er, Gökhan Akçapınar et al.•British Journal of Educational…•2025

  • When less is more

    Open Access•Yaniv Hanoch, Oliver Vitouch•Theory & Psychology•2004

  • Reflecting on reflexive thematic analysis

    Braun, Virginia Braun et al.•Qualitative Research in Sport and…•2019

  • Stress and Resilience Experiences during the Transition to Parenthood among Belgian Lesbian Mothers through Donor Insemination

    Open Access•Salvatore D’Amore, Alexandre Maurisse et al.•International Journal of…•2023

  • Inductive/Deductive Hybrid Thematic Analysis in Mixed Methods Research

    Open Access•Kevin Proudfoot•Journal of Mixed Methods Research•2022

  • One size fits all? What counts as quality practice in (reflexive) thematic analysis

    Braun, Victoria Clarke•Qualitative Research in Psychology•2020

  • Teacher anger

    Open Access•Irena Burić, Anne C Frenzel•Teaching and Teacher Education•2019

  • What Influences Successful Communication? An Examination of Cognitive Load and Individual Differences

    Ester Navarro, Brooke N Macnamara et al.•Discourse Processes•2020

  • Working Memory Capacity

    Open Access•Earl K Miller, Timothy J Buschman•Daedalus•2015

  • Using thematic analysis in psychology

    Open Access•Braun, Virginia Braun et al.•Qualitative Research in Psychology•2006

  • Positive affect facilitates creative problem solving

    Alice M Isen, Kimberly A Daubman et al.•Journal of Personality and Social…•1987

  • Model-based performance assessment

    Eva L Baker•Theory Into Practice•1997

  • Implicit Theories, Working Memory, and Cognitive Load

    Open Access•Jenni L Redifer, Christine Lee Bae et al.•SAGE Open•2019

Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae