Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Measuring Cognitive Load

Are There More Valid Alternatives to Likert Rating Scales

Bibliographic Data

ID22165697
AuthorsKim Ouwehand (0000-0002-5434-0188, Erasmus University Rotterdam, corresponding author), Avalon van der Kroef (Erasmus University Rotterdam), Jacqueline Wong (0000-0002-5387-7696, Delft University of Technology), Fred Paas (0000-0002-1647-5305, Erasmus University Rotterdam)
Year2021
Volume6
Publication date2021-09-20
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueFrontiers in Education (JOURNAL)
Journal identifiersISSN: 2504-284X • E-ISSN: 2504-284X
PublisherFrontiers Media SA (PUBLISHER • CH)
DOI10.3389/feduc.2021.702616
OpenAlexW3199729108
LanguageEN
Citations received14
References cited38

Cognitive load researchers have used varying subjective techniques based on rating scales to quantify experienced cognitive load. Although it is generally assumed that subjects can introspect on their cognitive processes and have no difficulty in assigning numerical values to the imposed cognitive load, little is known about how visual characteristics of the rating scales influence the validity of the cognitive load measure. In this study we look at validity of four subjective rating scales (within groups) differing in visual appearance by participants rating perceived difficulty and invested mental effort in response to working on simple and complex weekday problems. We used two numerical scales (the nine-point Likert scale most often used in Cognitive load theory research and a Visual Analogue Scale ranging between 0–100%) and two pictorial scales (a scale consisting of emoticons ranging from a relaxed blue-colored face to a stressed red-colored face and an “embodied” scale picturing nine depicted weights from 1–9 kg). Results suggest that numerical scales better reflect cognitive processes underlying complex problem solving while pictorial scales Underlying simple problem solving. This study adds to the discussion on the challenges to quantify cognitive load through various measurement methods and whether subtleties in measurements could influence research findings

Cognition · Cognitive Load · Cognitive psychology · Developmental psychology · Embodied cognition · Face validity · Likert scale · Psychometrics · Rating scale · Computer Science · Creativity in Education and Neuroscience · Neural and Behavioral Psychology Studies · Psychology · Visual and Cognitive Learning Processes · Artificial Intelligence

  • Comparing cognitive load during video versus traditional classroom instruction based on heart rate variability measures

    Open Access•Enqi Fan, Matt Bower et al.•Computers & Education•2026

  • A Comparative Study of Short-Term Social Media Use with Face-to-Face Interaction in Adolescence

    Open Access•Inês Mendonça, Franz Coelho et al.•Children•2025

  • Analysing the Relationship Between Mental Load or Mental Effort and Metacomprehension Under Different Conditions of Multimedia Design

    Open Access•Lenka Schnaubert, Sascha Schneider•Frontiers in Education•2022

  • The use of augmented reality for inquiry-based activity about the phenomenon of seasons

    Open Access•Elena Martín Ortega, Elena Martín et al.•Frontiers in Education•2023

  • Cooperative Learning and Academic Writing Skills

    Open Access•Dita Surwanti, Sofie M M Loyen et al.•Education Sciences•2025

  • Procedural Learning in Mixed Reality

    Open Access•Ghislain Mugisha, Amaël Arguel•Education Sciences•2025

  • Planning under load

    Open Access•Daniel Scholl, Simon Küth•Teaching and Teacher Education•2026

  • Differentiated effects of pre-filled-in and to-fill-in graphic organizer on primary school children’s retention of text

    Tiphaine Colliot, Franck Amadieu•Discourse Processes•2026

  • Concurrent versus terminal feedback

    Anna Liu, Melissa Duffy et al.•Medical Teacher•2023

  • Why is secondary mathematics difficult to learn? Perspectives from in-service teachers and cognitive load theory

    Open Access•Àlex Miró, Marc Alier et al.•Journal of Curriculum Studies•2025

  • External and internal smartphone distractions

    Open Access•Hui-Hsin Liao, Tzu‐Chien Liu et al.•Instructional Science•2026

  • Turkish adaptation and psychometric evaluation of cognitive load scale for middle school students

    Open Access•Zeynep Çiğdem Özcan, Ayşe Tuğba Öner•Acta Psychologica•2026

  • A new framework about exercise, functionality and health

    Open Access•Marcos Raphael Pereira Monteiro, Marcos Raphael Pereira-Monteiro et al.•Acta Psychologica•2026

  • Visualizing the Black-Box

    Open Access•Stefan Bargheer•The American Sociologist•2025

  • Cognitive Architecture and Instructional Design

    Open Access•John Sweller, Jeroen J G Van Merriënboer et al.•Educational Psychology Review•2019

  • Training strategies for attaining transfer of problem-solving skill in statistics

    Fred Paas, Fred G W C Paas•Journal of Educational Psychology•1992

  • Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load

    Open Access•John Sweller•Educational Psychology Review•2010

  • Cognitive Load Measurement as a Means to Advance Cognitive Load Theory

    Fred Paas, Juhani E Tuovinen et al.•Educational Psychologist•2003

  • Working Memory

    Open Access•Alan Baddeley•Science•1992

  • Self-Assessment of Knowledge

    Traci Sitzmann, Katherine Ely et al.•Academy of Management Learning &…•2010

  • Cocor

    Open Access•Birk Diedenhofen, Jochen Musch et al.•PLoS ONE•2015

  • Toward a Rational and Mechanistic Account of Mental Effort

    Amitai Shenhav, Sebastian Musslick et al.•Annual Review of Neuroscience•2017

  • Cognitive Load Theory and Complex Learning

    Open Access•Jeroen J G Van Merriënboer, John Sweller•Educational Psychology Review•2005

  • The episodic buffer

    Open Access•Alan Baddeley•Trends in Cognitive Sciences•2000

  • Statistical power analyses using G*Power 3.1

    Open Access•Franz Faul, Edgar Erdfelder et al.•Behavior Research Methods•2009

  • Cognitive Architecture and Instructional Design

    Open Access•John Sweller, Jeroen J G Van Merriënboer et al.•Educational Psychology Review•1998

  • Artificial intelligence in cyber physical systems

    Open Access•Petar Radanliev, David De Roure et al.•AI & Society•2021

  • Coding qualitative data

    Open Access•Mai Skjøtt Linneberg, Steffen Korsgaard•Qualitative Research Journal•2019

  • Operant behavior

    B F Skinner, Brittany Skinner•American Psychologist•1963

  • Grounded Cognition

    Lawrence W Barsalou•Annual Review of Psychology•2007

Unique citing works14
Citations per year3,5
Citation span2022 - 2026 (5)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 13

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae