Bridging the gap in oral language assessment

OratoR, a comprehensive tool for measuring oral summarization competence

Bibliographic Data

ID22435580
AuthorsChristine Wiertz (0000-0001-5719-6612, UCLouvain, corresponding author), Thibault Coppe (0000-0001-5886-5435, Université Libre de Bruxelles), Maël Pire (UCLouvain), Benoît Galand (0000-0003-3387-4305, UCLouvain), Stéphane Colognesi (0000-0001-5763-5873, UCLouvain)
Year2026
Volume14
Pages103178
Publication date2026-12-01
Open AccessYes
TypeARTICLE
VenueSocial Sciences & Humanities Open (JOURNAL)
Journal identifiersISSN: 2590-2911 • E-ISSN: 2590-2911
PublisherElsevier BV (PUBLISHER)
DOI10.1016/j.ssaho.2026.103178
OpenAlexW7168373208
LanguageEN
References cited38

Oral communication is a fundamental skill in education, yet its assessment remains a significant challenge due to the lack of valid and reliable tools designed for children, particularly for research purposes. This gap limits both the understanding and study of oral skills in educational contexts. In response, we developed ORAToR (Oral Recap Assessment Tool with Reliability), a comprehensive and rigorously validated tool designed specifically for researchers to assess pupils' proficiency in orally summarizing knowledge. This paper details the 10-step process involved in constructing ORAToR, highlighting the importance of expert consultation and pilot studies to ensure robust content validity. Exploratory factor analysis revealed three factors: Informational Content, Interaction with the Interlocutor, and Clarity of the Message Conveyed. While inter-rater reliability was strong for most criteria, evaluation of the relevance of the message and paraverbal elements needs further attention. These findings underscore the need for validated tools such as ORAToR to advance research on oral communication.

Automatic summarization · Second Language Acquisition and Learning · Text Readability and Simplification · Topic Modeling

Tools

Open DOIOpen Access