Neural oscillations and learning performance vary with an instructor's gestures and visual materials in video lectures
Bibliographic Data
Instructors' speech and gestures are tightly integrated. However, little is known about the neural mechanisms by which different types of gestures affect learning. We conducted two experiments on the effects of gestures in video lectures that included an instructor and slides, with English vocabulary as the topic. In Experiment 1, we manipulated the instructor's gestures (beat gestures vs. pointing gestures vs. depictive gestures) on neural oscillations and learning performance. The electroencephalogram results showed that students had higher alpha power and higher beta power when the instructor used pointing gestures, suggesting lower sensorimotor involvement in processing. Pointing gestures produced lower learning performance than beat gestures and depictive gestures. In Experiment 2, we manipulated the instructor's pointing gestures and the richness of visual materials in video lectures. The results showed that the effectiveness of pointing gestures was moderated by the richness of the visual materials on the slide. Specifically, pointing gestures were more effective for complex versus simple learning materials. The findings suggest that electroencephalogram oscillations and learning performance vary with the type of gesture the instructor uses and the richness of visual materials in video lectures. This study has applied value for designing effective video lectures in many disciplines: (1) When a video lecture includes simple visual materials, a beat gesture and depictive gesture would be better; (2) when a video lecture includes complex visual materials, the instructor can produce pointing gestures to single out the learning content they are talking about. Practitioner notes What is already known about this topic Instructors commonly produce gestures while they teach, and their gestures and speech are tightly integrated. Instructors often use three types of gestures: beat gestures, pointing gestures and depictive gestures. Different types of gestures influence learning via different neural mechanisms. What this paper adds Students' alpha power and beta power had lower amplitudes when observing an instructor's beat gestures, compared to pointing and depictive gestures. Students showed higher learning performance after viewing the video lectures with the instructor's beat and depictive gestures. An instructor's pointing gestures facilitated learning performance primarily in video lectures with complex visual materials (CVM) rather than simple visual material (SVM). Implications for practice and/or policy When a video lecture includes SVM, the instructor is encouraged to produce beat gestures and depictive gestures rather than pointing gestures. When a video lecture includes CVM, the instructor is encouraged to produce pointing gestures to single out the learning content they are talking about.
Cognitive psychology · Gesture · Linguistics · Vocabulary · Artificial Intelligence · Communication · Computer Science · Hearing Impairment and Communication · Multisensory perception and integration · Psychology · Visual and Cognitive Learning Processes
Teaching enthusiasm in video lectures
AI-powered VR/AR/metaverse integration for sustainable higher education (SDG4)
Neural mechanisms of cognitive load in Multimedia Learning
Learning declarative and procedural knowledge through instructor-present videos
Bridging Concrete to Idealized
Generative learning supports learning from video lectures
Happy facial expressions and mouse pointing enhance EFL vocabulary learning from instructional videos
Video Education through the Lens of Educational Neuroscience
One Model or Six Models in Video Presentations When Viewing Alone and in Pairs
Alpha-band oscillations, attention, and controlled access to stored information
Nonparametric statistical testing of EEG- and MEG-data
Eta squared and partial eta squared as measures of effect size in educational research
Two Sides of the Same Coin
Teachers’ gestures facilitate students’ learning
Instructor presence in video lectures
Learning by explaining to oneself and a peer enhances learners’ theta and alpha oscillations while watching video lectures
| Unique citing works | 9 |
|---|---|
| Citations per year | 3 |
| Citation span | 2023 - 2026 (4) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 9 |