Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Calp-Bloom’s evaluation rubric for EMI classrooms

A Delphi study

Bibliographic Data

ID17832151
AuthorsW Z Chang (National Taiwan University of Science and Technology), Shao‐Ting Alan Hung (0000-0002-9718-6838, National Taiwan University of Science and Technology, corresponding author)
Year2026
Publication date2026-04-20
Open AccessYes
TypeARTICLE
VenueHumanities and Social Sciences Communications (JOURNAL)
Journal identifiersISSN: 2662-9992 • E-ISSN: 2662-9992
PublisherPalgrave Macmillan (PUBLISHER • GB)
DOI10.1057/s41599-026-07242-8
OpenAlexW7155002503
LanguageEN
References cited18

Assessment plays a key role in shaping student learning, particularly in English-medium instruction (EMI) classrooms where students must process a non-native language to access and master content, underscoring the critical nature of Cognitive Academic Language Proficiency (CALP). However, few assessment tools in higher education—particularly in EMI contexts—integrate academic language proficiency and cognitive skills within a single framework. This study addresses that gap by developing and validating a formative assessment rubric that combines CALP with Bloom’s revised taxonomy to evaluate EMI students’ presentations. The rubric provides explicit criteria for both slides and oral delivery, enabling students and instructors to assess how each cognitive level is demonstrated through academic English, using a calibrated 1–5 CALP scale and recommended weightings across cognitive domains. A three-round Delphi study involving 17 multidisciplinary experts in EMI, assessment, and bilingual education iteratively evaluated the 24 rubric items for practicality and importance on a 5-point Likert scale. High consensus was achieved for all but one descriptor (‘0 Points’), which was removed to ensure the tool’s practical validity and fairness. Other key refinements included making the cognitive-level weights “suggested” for disciplinary flexibility and adding an annotation prioritizing “effective communication” over language precision. By linking language use with higher-order thinking, the rubric promotes equitable and transparent assessment while also supporting students’ development of evaluative judgment and feedback literacy. The study contributes to higher education by offering a validated instrument for formative assessment in EMI, with implications for classroom practice, teacher training, and policy in multilingual education worldwide

Authentic assessment · Cognition · Curriculum · Delphi method · Formative assessment · Language assessment · Likert scale · Rubric · EFL/ESL Teaching and Learning · Multilingual Education and Policy · Second Language Learning and Teaching

  • Developing evaluative judgement

    Open Access•Jeanne Tai, Joanna Tai et al.•Higher Education•2018

  • Flexible learning dimensions in higher education

    Open Access•Asil El Galad, Dean H Betts et al.•Frontiers in Education•2024

  • Teacher feedback literacy and its interplay with student feedback literacy

    David Carle, Naomi E Winstone•Teaching in Higher Education•2023

  • Issues and agency

    Hugo Santiago Sanchez, Katie Dunworth•Assessment & Evaluation in Higher…•2015

  • Conceptualising evaluative judgement in the context of holistic competency development

    Open Access•Jiahui Luo, Cecilia K Y Chan•Assessment & Evaluation in Higher…•2023

  • Developing evaluative judgement for a time of generative artificial intelligence

    Open Access•Margaret Bearman, Jeanne Tai et al.•Assessment & Evaluation in Higher…•2024

  • The development of student feedback literacy

    David Carle, David Boud•Assessment & Evaluation in Higher…•2018

  • English Medium Instruction

    Open Access•Ernesto Macaro•Language Teaching•2022

  • At the Crossroads of Tesol and English Medium Instruction

    Open Access•Diane Pecorari, Hans Malmström•TESOL Quarterly•2018

Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae