The role of indoor positioning analytics in assessment of simulation‐based learning
Datos Bibliográficos
Simulation‐based learning provides students with unique opportunities to develop key procedural and teamwork skills in close‐to‐authentic physical learning and training environments. Yet, assessing students' performance in such situations can be challenging and mentally exhausting for teachers. Multimodal learning analytics can support the assessment of simulation‐based learning by making salient aspects of students' activities visible for evaluation. Although descriptive analytics have been used to study students' motor behaviours in simulation‐based learning, their validity and utility for assessing performance remain unclear. This study aims at addressing this knowledge gap by investigating how indoor positioning analytics can be used to generate meaningful insights about students' tasks and collaboration performance in simulation‐based learning. We collected and analysed the positioning data of 304 healthcare students, organised in 76 teams, through correlation, predictive and epistemic network analyses. The primary findings were (1) large correlations between students' spatial‐procedural behaviours and their group performances; (2) predictive learning analytics that achieved an acceptable level (0.74 AUC) in distinguishing between low‐performing and high‐performing teams regarding collaboration performance; and (3) epistemic networks that can be used for assessing the behavioural differences across multiple teams. We also present the teachers' qualitative evaluation of the utility of these analytics and implications for supporting formative assessment in simulation‐based learning. Practitioner notes What is currently known about this topic Assessing students' performance in simulation‐based learning is often challenging and mentally exhausting. The combination of learning analytics and sensing technologies has the potential to uncover meaningful behavioural insights in physical learning spaces. Observational studies have suggested the potential value of analytics extracted from positioning data as indicators of highly‐effective behaviour in simulation‐based learning. What this paper adds Indoor positioning analytics for supporting teachers' formative assessment and timely feedback on students' group/team‐level performance in simulation‐based learning. Empirical evidence supported the potential use of epistemic networks for assessing the behavioural differences between low‐performing and high‐performing teams. Teachers' positively validated the utility of indoor positioning analytics in supporting reflective practices and formative assessment in simulation‐based learning. Implications for practitioners Indoor positioning tracking and spatial analysis can be used to investigate students' teamwork and task performance in simulation‐based learning. Predictive learning analytics should be developed based on features that have direct relevance to teachers' learning design. Epistemic networks analysis and comparison plots can be useful in identifying and assessing behavioural differences across multiple teams.
Analytics · Data science · Formative assessment · Knowledge management · Learning analytics · Mathematics education · Teamwork · Computer Science · Educational Games and Gamification · Online and Blended Learning · Psychology · Simulation-Based Education in Healthcare
Deconstructing the Normalization of Data Colonialism in Educational Technology
A systematic review of multimodal learning analytics in computer-supported collaborative learning
A learning analytics dashboard to support students' reflection on collaboration
Optimizing Formative Assessment with Learning Analytics
Assessing cognitive presence in online inquiry‐based discussion through text classification and epistemic network analysis
Evidence‐based multimodal learning analytics for feedback and reflection in collaborative learning
Towards automated transcribing and coding of embodied teamwork communication through multimodal learning analytics
Learning analytics and assessment
Multimodal learning analytics—In‐between student privacy and encroachment
How more-improvement and less-improvement groups differ in peer feedback giving and receiving practice-an exploratory study
Handbook of Formative Assessment
Statistical Power Analysis for the Behavioral Sciences
Applied Logistic Regression
The Role of Debriefing in Simulation-Based Learning
Learning analytics should not promote one size fits all
Features and uses of high-fidelity medical simulations that lead to effective learning
Assessment in the age of artificial intelligence
Learning Analytics for Learning Design
The assessment of clinical skills/competence/performance
Teachers' occupational well-being and quality of instruction
A Tutorial on Epistemic Network Analysis
The science of team science
Smote
Explaining prediction models and individual predictions with feature contributions
Standards of Validity and the Validity of Standards in Performance Asessment
Accuracy of Physician Self-assessment Compared With Observed Measures of Competence
A five-dimensional framework for authentic assessment
Towards strengthening links between learning analytics and assessment
Assessing the validity of a learning analytics expectation instrument
Challenges and opportunities of multimodal data in human learning
Simulation-Based Learning in Higher Education
Mapping from proximity traces to socio‐spatial behaviours and student progression at the school
Multimodal Learning Analytics research with young children
What does physiological synchrony reveal about metacognitive experiences and group performance
Multimodal data capabilities for learning
Simulation
The impact of institutional surveillance technologies on student behaviour
Rethinking assessment in a digital age
Assessment – Summative and Formative – Some Theoretical Reflections
Becoming Friends by Chance
Developmental sequence in small groups
Preferred Interpersonal Distances
| Obras citantes distintas | 10 |
|---|---|
| Citas por año | 3,33 |
| Intervalo de citas | 2023 - 2026 (4) |
| Velocidad de citación | current |
| Altamente citado | No |
| Tipos de cita | Neutras: 10 |