Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Evaluation of an immersive virtual learning environment for operator training in mechanical and plant engineering using video analysis

Bibliographic Data

ID21297166
AuthorsCarolin Pletz (corresponding author), Bernd Zinn (0000-0003-0167-8238)
Year2020
Volume51
Issue6
Pages2159-2179
Publication date2020-11-01
Open AccessYes
TypeARTICLE
VenueBritish Journal of Educational Technology (JOURNAL)
Journal identifiersISSN: 0007-1013 • E-ISSN: 1467-8535
PublisherWiley (PUBLISHER • GB)
DOI10.1111/bjet.13024
OpenAlexW3080464830
LanguageEN
Citations received4
References cited50

A structural evaluation is imperative for developing an effective virtual learning environment. Understanding the extent to which content that has been learned virtually can be applied practically holds particular importance. A group of persons from the technical field of mechanical and plant engineering ( N = 13) participated in a virtual operator training for a case application of additive manufacturing. To evaluate the virtual learning environment the participants answered quantitative questionnaires and were asked to apply what they had learned virtually to the real machine. Both the virtual training and testing phase on the real machine were recorded by video (800 minutes in total). The category system resulting from a structured qualitative video analysis with a total of 568 codes contains design‐, instruction‐ and interaction‐related optimisation potentials for further development of the virtual learning sequence. Mistakes, difficulties and other anomalies during the application on the real machine provide further revision options. The study uses video data for the first time to derive optimisation potentials and to investigate the learning transfer of virtually learned action knowledge to the real‐world activity. Practitioner Notes What is already known about the topic? A combination of quantitative and qualitative data for formative evaluation is feasible to improve the quality of virtual learning environments and maintain critical constructive feedback. Relevant aspects for evaluating virtual learning environments include usability, technology acceptance, motivation and learning efficiency. Different methods for measuring the learning efficiency of VR training exist, eg, subjective measures or pretests/posttests. What this paper adds: An immersive virtual environment with its specific methodical‐didactic concept is introduced. Video data are used for the first time to derive optimisation potentials in a formative evaluation. The procedure of extracting and analysing the data in a structured video analysis is introduced in the paper. Learning transfer of the virtually learned content to the real‐world context of action is assessed and applied in the field of mechanical and plant engineering on a complex real machine for the first time. Implications for practice and/or policy: The described methodical procedure using video analysis enables deriving design‐, instruction‐ and interaction‐related optimisation potentials. The results show that spatial information was transferred to the real machine without any issues, whereby the main difficulties appeared during steps that require haptic feedback. The use of IVR should be critically assessed due to the effort required in creation

Constructive · Formative assessment · Human–computer interaction · Instructional simulation · Mathematics education · Multimedia · Process (computing) · Quality (philosophy) · Usability · Virtual learning environment · Virtual machine · Virtual reality · Virtual training · Computer Science · Educational Games and Gamification · Psychology · Virtual Reality Applications and Impacts · Visual and Cognitive Learning Processes

  • Diverse approaches to learning with immersive Virtual Reality identified from a systematic review

    Open Access•Mihye Won, Dewi Ayu Kencana Ungu et al.•Computers & Education•2023

  • Video–based observation in impact evaluation

    Open Access•Simon Borg•Evaluation and Program Planning•2021

  • Immersive virtual reality in education

    Open Access•Matt Bower, Morris Siu‐Yung Jong•British Journal of Educational…•2020

  • Designing a Co-creation System for the Development of Work-process-related Learning Material in Manufacturing

    Open Access•Tim Weinert, Matthias Billert et al.•Computer Supported Cooperative…•2023

  • Communities of Practice

    Open Access•Etienne Wenger•Communities of Practice•1998

  • From Text to Codings

    Laila Burla, Birte Knierim et al.•Nursing Research•2008

  • Immersive VR and Education

    Open Access•Mina C Johnson‐Glenberg, Mina C Johnson-Glenberg•Frontiers in Robotics and AI•2018

  • Embodiment as a unifying perspective for psychology

    Open Access•Arthur Glenberg, Arthur M Glenberg•WIREs Cognitive Science•2010

  • Schema induction and analogical transfer

    Open Access•Mary L Gick, Keith J Holyoak•Cognitive Psychology•1983

  • Transfer of Training

    Open Access•Brian D Blume, J Kevin Ford et al.•Journal of Management•2010

  • Chapter 3

    Open Access•John D Bransford, Daniel L Schwartz•Review of Research in Education•1999

  • Learning and transfer

    Dedre Gentner, Jeffrey Loewenstein et al.•Journal of Educational Psychology•2003

  • A review of the use of virtual reality head-mounted displays in education and training

    Open Access•Lasse X Jensen, Flemming Konradsen•Education and Information…•2018

  • Enhancing learning and engagement through embodied interaction within a mixed reality simulation

    Open Access•Robb Lindgren, Michael Tscholl et al.•Computers & Education•2016

  • Virtual laboratories for education in science, technology, and engineering

    Open Access•Veljko Potkonjak, Michael Gardner et al.•Computers & Education•2016

  • A Reconsideration of Cognitive Load Theory

    Open Access•Wolfgang Schnotz, Christian Kürschner•Educational Psychology Review•2007

  • Conducting Video Research in the Learning Sciences

    Sharon J Derry, Roy Pea et al.•Journal of the Learning Sciences•2010

  • What are the learning affordances of 3‐D virtual environments?

    Open Access•Barney Dalgarno, Mark J W Lee•British Journal of Educational…•2010

  • The influence of improvement in one mental function upon the efficiency of other functions. (I).

    R S Woodworth, Edward L Thorndike•Psychological Review•1901

  • Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology

    Fred D Davis•MIS Quarterly•1989

  • Cognitive Load During Problem Solving

    Open Access•John Sweller•Cognitive Science•1988

  • A systematic review of immersive virtual reality applications for higher education

    Open Access•Jaziar Radianti, Tim A Majchrzak et al.•Computers & Education•2020

  • How do virtual world experiences bring about learning? A critical review of theories

    Open Access•Swee‐Kin Loke, Swee-Kin Loke•Australasian Journal of…•2015

  • How Design Experiments Can Inform a Rethinking of Transfer andViceVersa

    Open Access•Joanne Lobato•Educational Researcher•2003

  • When and where do we apply what we learn

    Susan M Barnett, Stephen J Ceci•Psychological Bulletin•2002

  • Situated Learning

    Open Access•Jean Lave, Etienne Wenger•Situated Learning•1991

  • Process guidelines for establishing Intercoder Reliability in qualitative studies

    Open Access•Catherine Macphail, Nomhle Khoza et al.•Qualitative Research•2016

Citations per year0.67
Citation span2020 - 2023 (4)
Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae