Measuring leadership development in workplace learning using automated assessments

Learning analytics and measurement theory approach

Bibliographic Data

ID21297754
AuthorsAbhinava Barthakur (0000-0002-2437-6892, University of South Australia Adelaide South Australia Australia, corresponding author), Vitomir Kovanovic (0000-0001-9694-6033, University of South Australia Adelaide South Australia Australia), Srecko Joksimovic (0000-0001-6999-3547, University of South Australia Adelaide South Australia Australia), Zhonghua Zhang (0000-0002-0073-9548, The University of Melbourne Melbourne Victoria Australia), Michael Richey (0000-0001-8293-5720, University of South Australia Adelaide South Australia Australia), Abelardo Pardo (0000-0002-6857-0582, University of South Australia Adelaide South Australia Australia)
Year2022
Volume53
Issue6
Pages1842-1863
Publication date2022-11-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueBritish Journal of Educational Technology (JOURNAL)
Journal identifiersISSN: 0007-1013 • E-ISSN: 1467-8535
PublisherWiley (PUBLISHER • GB)
DOI10.1111/bjet.13218
OpenAlexW4220871021
LanguageEN
Citations received3
References cited57

Technological affordances have shown promising potential in advancing the delivery of corporate learning programmes designed for professional leadership development. However, there is a considerable challenge in evaluating learners' skill acquisition, with most of the past research relying on pre‐ and post‐tests or other forms of self‐reports to measure leadership development. In that sense, these approaches measure leadership development before and after the programme, while being inefficient for measuring the development during the learning process. This study collected self‐reflection answers from a professional development MOOC that allows learners to express their stepwise learning and reflect on their professional experience on leadership fronts. We developed a novel methodology and an automated system for the evaluation of leadership skills' mastery based on the depth of reflection exhibited during the learning process. We identified four groups of learners based on their course content mastery and explored the differences within groups. The results also highlight relevant insights about instructional design and provide promising avenues for future research. Practitioner notes What is already known about this topic Professional leadership programmes have become increasingly common in workplace learning. Programmes mainly use manual/introspective measures to assess skill acquisition. What this paper adds An automated assessment system to evaluate leadership skill mastery. Evidence‐based and leadership driven inferences about skill acquisition. Use of a novel multidisciplinary methodology for complex skills assessment. Implications of practice and/or policy Assessing leadership development should include more than course grades. Assessing differences in content mastery requires evaluation of various skills. Developed assessment system provides promise for other similar domains.

Affordance · Dreyfus model of skill acquisition · Introspection · Knowledge management · Leadership development · Management · Mathematics education · Pedagogy · Process (computing) · Professional development · Computer Science · Evaluation of Teaching Practices · Higher Education and Employability · Online Learning and Analytics · Psychology

Tools

Open DOIOpen Access