Identifying the response process validity of clinical vignette-type multiple choice questions
An eye-tracking study
Bibliographic Data
| ID | 21447698 |
|---|---|
| Authors | Francisco Carlos Specian Junior (0000-0002-4220-2642, Universidade Estadual de Campinas (UNICAMP), corresponding author), Thiago Martins Santos (0000-0002-3595-4088, Universidade Estadual de Campinas (UNICAMP)), John Sandars (0000-0003-3930-387X, Health Research Institute, Edge Hill University, Ormskirk, UK), Eliana Martorano Amaral (0000-0001-9151-3108, Universidade Estadual de Campinas (UNICAMP)), Dario Cecilio-Fernandes (0000-0002-8746-1680, Universidade Estadual de Campinas (UNICAMP)) |
| Year | 2023 |
| Volume | 45 |
| Issue | 8 |
| Pages | 845-851 |
| Publication date | 2023-08-03 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Medical Teacher (JOURNAL) |
| Journal identifiers | ISSN: 0142-159X • E-ISSN: 1466-187X |
| Publisher | Informa UK Limited (PUBLISHER • GB) |
| DOI | 10.1080/0142159x.2023.2182662 |
| PMID | 36840707 |
| OpenAlex | W4321996949 |
| Language | EN |
| Citations received | 2 |
| References cited | 36 |
Introduction Clinical vignette-type multiple choice questions (CV-MCQs) are widely used in assessment and identifying the response process validity (RPV) of questions with low and high integration of knowledge is essential. Answering CV-MCQs of different levels of knowledge application and integration can be understood from a cognitive workload perspective and this can be identified by using eye-tracking. The aim of the pilot study was to identify the cognitive workload and RPV of CV-MCQs of different levels of knowledge application and integration by the use eye-tracking.Methods Fourteen fourth-year medical students answered a test with 40 CV-MCQs, which were equally divided into low-level and high-level complexity (knowledge application and integration). Cognitive workload was measured using screen-based eye tracking, with the number of fixations and revisitations for each area of interest.Results We found a higher cognitive workload for high-level complexity (M = 121.74) compared with lower-level complexity questions (M = 51.94) and also for participants who answered questions incorrectly (M = 94.31) compared with correctly (M = 79.36).Conclusion Eye-tracking has the potential to become a useful and practical approach for helping to identify the RPV of CV-MCQs. This approach can be used for improving the design and development of CV-MCQs, and to provide feedback to inform teaching and learning.Practice pointsClinical vignette- type multiple choice questions (CV-MCQs) are widely used in assessment.Identifying the response process validity (RPV) of CV-MCQs with low and high complexity is essential.Low and high complexity CV-MCQs have different cognitive workloads that can be practically identified using eye-tracking.Eye-tracking has the potential for identifying the RPV of CV-MCQs
Cognition · Eye tracking · Multiple choice · Pedagogy · Psychiatry · Tracking (education) · Vignette · Workload · Artificial Intelligence · Clinical Reasoning and Diagnostic Skills · Computer Science · Innovations in Medical Education · Internal Medicine · Medicine · Psychology · Simulation-Based Education in Healthcare · Social Psychology
| Unique citing works | 2 |
|---|---|
| Citations per year | 0,67 |
| Citation span | 2023 - 2026 (4) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 2 |