Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

The End is the Beginning is the End

The closed-loop learning analytics framework

Bibliographic Data

ID21563341
AuthorsMichael Sailer (0000-0001-6831-5429, University of Augsburg), Manuel Ninaus (0000-0002-4664-8430, University of Graz, corresponding author), Stefan E Huber (0000-0001-5057-0376, University of Graz), Elisabeth Bauer (0000-0003-4078-0999, Technical University of Munich), Samuel Greiff (0000-0003-2900-3734, University of Luxembourg)
Year2024
Volume158
Pages108305
Publication date2024-09-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueComputers in Human Behavior (JOURNAL)
Journal identifiersISSN: 0747-5632 • E-ISSN: 1873-7692
PublisherElsevier BV (PUBLISHER)
DOI10.1016/j.chb.2024.108305
OpenAlexW4396950990
LanguageEN
Citations received14
References cited167

This article provides a comprehensive review of current practices and methodologies within the field of learning analytics, structured around a dedicated closed-loop framework. This framework effectively integrates various aspects of learning analytics into a cohesive framework, emphasizing the interplay between data collection, processing and analysis, as well as adaptivity and personalization, all connected by the learners involved and underpinned by educational and psychological theory. In reviewing each step of the closed loop, the article delves into the advancements in data collection, exploring how technological progress has expanded data collection methods, particularly focusing on the potential of multimodal data acquisition and how theory can inform this step. The processing and analysis step is thoroughly reviewed, highlighting a range of methods including machine learning and AI, and discussing the critical balance between prediction accuracy and interpretability. The adaptivity and personalization step examines the current state of research, underscoring significant gaps and the necessity for theory-informed, personalized learning interventions. Overall, the article underscores the importance of interdisciplinarity in learning analytics, advocating for the integration of insights from various fields to address challenges such as ethical data usage and the creation of quality learning experiences. This framework and review aim to guide future research and practice in learning analytics, promoting the development of effective, learner-centric educational environments driven by balancing data-driven insights and theoretical understanding

Analytics · Closed loop · Control engineering · Data science · Dead end · End user · End-to-end principle · World Wide Web · Big Data and Business Intelligence · Computer Science · Engineering · Intelligent Tutoring Systems and Adaptive Learning · Mathematics · Online Learning and Analytics · Psychology · Social Psychology · Artificial Intelligence

  • How gaze and proxemics shape and signal shared regulatory processes during AI-supported collaborative learning

    Open Access•Ridwan Whitehead, Andy Nguyen et al.•International Journal of…•2026

  • Adaptive online course design

    Open Access•Gediminas Lipnickas, Joanne Harris et al.•The Internet and Higher Education•2025

  • AI-based avatars are changing the way we learn and teach

    Open Access•Maximilian C Fink, Seth A Robinson et al.•Frontiers in Education•2024

  • Structural Study of Post-Covid-19 Use Based on LMS Log Data Analysis from the University of Extremadura

    Open Access•Francisco Ignacio Revuelta-Domínguez, Francisco-Ignacio Revuelta-Domínguez et…•Education Sciences•2026

  • A meta-analysis on the effect of learning analytics interventions on students’ academic performance

    Mehmet Kokoç, Suphi Önder Bütüner et al.•Journal of Research on Technology…•2025

  • Using machine learning for continuous updating of meta-analysis in educational context

    Open Access•Olga Chernikova, Matthias Stadler et al.•Computers in Human Behavior•2024

  • Exploring the relationship between LMS interactions and academic performance

    Open Access•Ángel Hernández-García, Carlos Cuenca-Enrique et al.•Computers in Human Behavior•2024

  • Decoding a decade. Trends and evolution in learning analytics

    Open Access•Dorin Stanciu, Ángel Hernández-García et al.•Computers in Human Behavior•2025

  • On the role of engagement in automated feedback effectiveness

    Open Access•Ronja Schiller, Johanna Fleckenstein et al.•Computers & Education•2025

  • Understanding the effectiveness of automated feedback

    Open Access•Ronja Schiller, Johanna Fleckenstein et al.•Computers & Education•2024

  • Measuring task-level behavioral learning engagement during text revision

    Open Access•Ronja Schiller, Johanna Fleckenstein et al.•Computers & Education•2026

  • Expert inputs on prompt completions

    Open Access•Gerald Njuguna, Qingfei Min•AI & Society•2026

  • Personalizing teacher professional development through learning analytics

    Open Access•Anucha Somabut, Kulthida Tuamsuk et al.•Teaching and Teacher Education•2026

  • Beyond the average

    Open Access•Mukhtar Axmed Cumar, Abdisalam Hassan Muse et al.•International Journal of…•2026

  • Handbook of Research on Educational Communications and Technology

    Open Access•J Michael Spector, M David Merrill et al.•Handbook of research on…•2014

  • Handbook of Self-Regulation of Learning and Performance

    Barry J Zimmerman, Dale H Schunk et al.•Handbook of Self-Regulation of…•2017

  • Measuring student engagement in technology-mediated learning

    Open Access•Curtis R Henrie, Lisa R Halverson et al.•Computers & Education•2015

  • Understanding the benefits of providing peer feedback

    Open Access•Melissa M Patchan, Christian D Schunn•Instructional Science•2015

  • Analyzing Multimodal Multichannel Data about Self-Regulated Learning with Advanced Learning Technologies

    Open Access•Roger Azevedo, Dragan Gašević•Computers in Human Behavior•2019

  • Toward a Script Theory of Guidance in Computer-Supported Collaborative Learning

    Frank Fischer, Ingo Kollar et al.•Educational Psychologist•2013

  • Heart rate variability

    Open Access•Gary G Berntson, J Thomas Bigger et al.•Psychophysiology•1997

  • The Expertise Reversal Effect

    Slava Kalyuga, Paul Ayres et al.•Educational Psychologist•2003

  • Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load

    Open Access•John Sweller•Educational Psychology Review•2010

  • Toward an Instructionally Oriented Theory of Example‐Based Learning

    Open Access•Alexander Renkl•Cognitive Science•2014

  • The Power of Feedback Revisited

    Open Access•Benedikt Wisniewski, Klaus Zierer et al.•Frontiers in Psychology•2020

  • The Icap Framework

    Michelene T H Chi, T H Michelene et al.•Educational Psychologist•2014

  • The current landscape of learning analytics in higher education

    Open Access•Olga Viberg, Mathias Hatakka et al.•Computers in Human Behavior•2018

  • Application and theory gaps during the rise of Artificial Intelligence in Education

    Open Access•Xieling Chen, Haoran Xie et al.•Computers and Education:…•2020

  • A Systematic Review of Empirical Studies on Learning Analytics Dashboards

    Open Access•Wannisa Matcha, Nora’ayu Ahmad Uzir et al.•IEEE Transactions on Learning…•2020

  • Dynamics of affective states during complex learning

    Open Access•Sidney D’Mello, Sidney K D’Mello et al.•Learning and Instruction•2012

  • Synthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education

    Open Access•Brian R Belland, Andrew Walker et al.•Review of Educational Research•2017

  • A Systematic Review of Research on Personalized Learning

    Open Access•Matthew L Bernacki, Meghan J Greene et al.•Educational Psychology Review•2021

  • Socio-Cognitive Scaffolding with Computer-Supported Collaboration Scripts

    Open Access•Freydis Vogel, Christof Wecker et al.•Educational Psychology Review•2017

  • Intelligent tutoring systems and learning outcomes

    Wenting Ma, Olusola O Adesope et al.•Journal of Educational Psychology•2014

  • Cognitive Tutors

    John R Anderson, Albert T Corbett et al.•Journal of the Learning Sciences•1995

  • Measuring emotions during epistemic activities

    Reinhard Pekrun, Elisabeth Vogl et al.•Cognition & Emotion•2017

  • Are We There Yet? - A Systematic Literature Review on Chatbots in Education

    Open Access•Sebastian Wollny, Jan Schneider et al.•Frontiers in Artificial…•2021

  • The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems

    KURT VanLEHN•Educational Psychologist•2011

  • Expertise Reversal Effect and Its Implications for Learner-Tailored Instruction

    Open Access•Slava Kalyuga•Educational Psychology Review•2007

  • A Critical Review of Research on Student Self-Assessment

    Open Access•Heidi Andrade, Heidi L Andrade•Frontiers in Education•2019

  • Feedback and Self-Regulated Learning

    Open Access•Deborah L Butler, Philip H Winne•Review of Educational Research•1995

  • Do learning protocols support learning strategies and outcomes? The role of cognitive and metacognitive prompts

    Open Access•Kirsten Berthold, Matthias Nückles et al.•Learning and Instruction•2007

  • The theoretical status of latent variables.

    Denny Borsboom, Gideon J Mellenbergh et al.•Psychological Review•2003

  • A Scaffolding Design Framework for Software to Support Science Inquiry

    Chris Quintana, Brian J Reiser et al.•Journal of the Learning Sciences•2004

  • What’s the Problem with Learning Analytics?

    Open Access•Neil Selwyn•Journal of Learning Analytics•2019

  • ChatGPT for good? On opportunities and challenges of large language models for education

    Open Access•Enkelejda Kasneci, Kathrin Sessler et al.•Learning and Individual Differences•2023

  • The Role of Tutoring in Problem Solving

    Open Access•David Wood, Jerome S Bruner et al.•Journal of Child Psychology and…•1976

  • The Cambridge Handbook of the Learning Sciences

    Open Access•R Keith Sawyer•Cambridge Handbook of the…•2005

  • Quantifying Scientific Thinking Using Multichannel Data With Crystal Island

    Open Access•Juliana M A L Andres, Daryn A Dever et al.•Frontiers in Education•2020

  • Diagnostic argumentation in teacher education

    Open Access•Elisabeth Bauer, Michael Sailer et al.•Frontiers in Education•2022

  • A Theoretical and Evidence-Based Conceptual Design of MetaDash

    Open Access•Megan D Wiedbusch, Megan Wiedbusch et al.•Frontiers in Education•2021

  • A Systematic Literature Review of Analytics for Adaptivity Within Educational Video Games

    Open Access•Manuel Ninaus, Steve Nebel•Frontiers in Education•2021

  • The Theory Crisis in Psychology

    Open Access•Markus I Eronen, Laura F Bringmann•Perspectives on Psychological…•2021

  • Toward a taxonomy of adaptivity for learning

    Jan L Pla, Shashank Pawar•Journal of Research on Technology…•2020

  • The effect of chatbots on learning

    Ecenaz Alemdag•Journal of Research on Technology…•2025

  • Using clickstream data to measure, understand, and support self-regulated learning in online courses

    Open Access•Qiujie Li, Rachel Baker et al.•The Internet and Higher Education•2020

  • Fitbit for learning

    Open Access•Michail N Giannakos, Kshitij Sharma et al.•International Journal of…•2020

  • It takes two to tango

    Open Access•Yoana Omarchevska, Andreas Lachner et al.•Journal of the Learning Sciences•2022

  • The equalizing effect of teacher dashboards on feedback in K-12 classrooms

    Open Access•Carolien A N Knoop-van Campen, Alyssa Friend Wise et al.•Interactive Learning Environments•2023

  • Educational Data Mining versus Learning Analytics

    Clare Baek, Tenzin Doleck•Interactive Learning Environments•2023

  • When the brain comes into play

    Open Access•Simon Greipl, Elise Klein et al.•Computers in Human Behavior•2021

  • No Pain, no Gain? Investigating motivational mechanisms of game elements in cognitive tasks

    Open Access•Katharina Bernecker, Manuel Ninaus•Computers in Human Behavior•2021

  • Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning

    Open Access•Lyn Lim, Maria Bannert et al.•Computers in Human Behavior•2023

  • Making strides towards AI-supported regulation of learning in collaborative knowledge construction

    Open Access•Fan Ouyang, Mian Wu et al.•Computers in Human Behavior•2023

  • Measuring self-regulated learning and the role of AI

    Open Access•Inge Molenaar, Susanne de Mooij et al.•Computers in Human Behavior•2023

  • A cognitive definition of computational thinking in primary education

    Open Access•Katerina Tsarava, Korbinian Moeller et al.•Computers & Education•2022

  • Effectiveness of online regulation scaffolds on peer feedback provision and uptake

    Open Access•Ecenaz Alemdag, Zahide Yıldırım et al.•Computers & Education•2022

  • The effect of automated feedback on revision behavior and learning gains in formative assessment of scientific argument writing

    Open Access•M Zhu, Ou Lydia Liu et al.•Computers & Education•2020

  • Learning analytics for online game-Based learning

    Open Access•Seyyed Kazem Banihashem, Hojjat Dehghanzadeh et al.•Behaviour and Information…•2024

  • Towards hybrid human‐AI learning technologies

    Open Access•Inge Molenaar•European Journal of Education•2022

  • Exploring new depths

    Open Access•Paul P Martin, David Kranz et al.•Journal of Research in Science…•2024

  • Using natural language processing to support peer‐feedback in the age of artificial intelligence

    Open Access•Elisabeth Bauer, Martin Greisel et al.•British Journal of Educational…•2023

  • Staying on target

    Open Access•Neiva Valle, Pavlo Antonenko et al.•British Journal of Educational…•2021

  • The role of learning theory in multimodal learning analytics

    Open Access•Michail N Giannakos, Michail Giannakos et al.•British Journal of Educational…•2023

  • Designing personalised instruction

    Open Access•N Kucirkova, Libby Gerard et al.•British Journal of Educational…•2021

  • Multimodal learning analytics for game‐based learning

    Open Access•Andrew Emerson, Juliana M A L Andres et al.•British Journal of Educational…•2020

  • Multimodal Learning Analytics research with young children

    Open Access•Lucrezia Crescenzi-Lanna•British Journal of Educational…•2020

  • Using causal models to bridge the divide between big data and educational theory

    Open Access•Kirsty Kitto, Ben Hicks et al.•British Journal of Educational…•2023

  • Multimodal data capabilities for learning

    Open Access•Kshitij Sharma, Michail N Giannakos et al.•British Journal of Educational…•2020

  • Impact of sender and peer-feedback characteristics on performance, cognitive load, and mindful cognitive processing

    Open Access•Markus Berndt, Jan-Willem Strijbos et al.•Studies In Educational Evaluation•2022

  • AutoTutor

    Open Access•Arthur C Graesser, Patrick Chipman et al.•IEEE Transactions on Education•2005

  • The power of internal feedback

    Open Access•David Nicol•Assessment & Evaluation in Higher…•2021

  • A systematic review and meta-analysis of discrepancies between logged and self-reported digital media use

    Open Access•Douglas A Parry, Brittany I Davidson et al.•Nature Human Behaviour•2021

  • Act-R

    Jared R Anderson, John R Anderson et al.•Human-Computer Interaction•1997

  • Let’s not forget

    Open Access•Dragan Gašević, Shane Dawson et al.•TechTrends•2014

  • Exploring the diagnostic process of pre-service teachers using a simulation – A latent profile approach

    Open Access•Anika Radkowitsch, Daniel Sommerhoff et al.•Teaching and Teacher Education•2023

  • Between authenticity and cognitive demand

    Open Access•Elias Codreanu, Daniel Sommerhoff et al.•Teaching and Teacher Education•2020

  • The two disciplines of scientific psychology

    Lee J Cronbach•American Psychologist•1957

  • The Social and Technological Dimensions of Scaffolding and Related Theoretical Concepts for Learning, Education, and Human Activity

    Roy Pea, ROY D PEA•Journal of the Learning Sciences•2004

  • Discovery With Models

    Open Access•Arnon Hershkovitz, Ryan S Baker et al.•American Behavioral Scientist•2013

  • The Power of Feedback

    Open Access•John Hattie, Helen Timperley•Review of Educational Research•2007

  • Becoming a Self-Regulated Learner

    Barry J Zimmerman•Theory Into Practice•2002

  • Seven steps toward more transparency in statistical practice

    Open Access•Eric-Jan Wagenmakers, Alexandra Sarafoglou et al.•Nature Human Behaviour•2021

  • Computational Grounded Theory

    Open Access•Livingston Krumah Nelson•Sociological Methods & Research•2020

Unique citing works14
Citations per year7
Citation span2024 - 2026 (3)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 14

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae