Relative Robustness of CDMs and (M)IRT in Measuring Growth in Latent Skills
Bibliographic Data
| ID | 20282015 |
|---|---|
| Authors | Qi Huang (0000-0002-4616-5308, University of Wisconsin–Madison, corresponding author), Daniel M Bolt (0000-0001-7593-4439, University of Wisconsin–Madison) |
| Year | 2023 |
| Volume | 83 |
| Issue | 4 |
| Pages | 808-830 |
| Publication date | 2023-08-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/00131644221117194 |
| PMID | 37398840 |
| OpenAlex | W4293068987 |
| Language | EN |
| Citations received | 1 |
| References cited | 25 |
Previous studies have demonstrated evidence of latent skill continuity even in tests intentionally designed for measurement of binary skills. In addition, the assumption of binary skills when continuity is present has been shown to potentially create a lack of invariance in item and latent ability parameters that may undermine applications. In this article, we examine measurement of growth as one such application, and consider multidimensional item response theory (MIRT) as a competing alternative. Motivated by prior findings concerning the effects of skill continuity, we study the relative robustness of cognitive diagnostic models (CDMs) and (M)IRT models in the measurement of growth under both binary and continuous latent skill distributions. We find CDMs to be a less robust way of quantifying growth under misspecification, and subsequently provide a real-data example suggesting underestimation of growth as a likely consequence. It is suggested that researchers should regularly attend to the assumptions associated with the use of latent binary skills and consider (M)IRT as a potentially more robust alternative if unsure of their discrete nature
Binary number · Cognitive psychology · Confirmatory factor analysis · Econometrics · Item response theory · Latent growth modeling · Measurement invariance · Psychometrics · Robustness (evolution) · Statistics · Structural equation modeling · Cognitive Abilities and Testing · Computer Science · Grit, Self-Efficacy, and Motivation · Mathematics · Psychology · Psychometric Methodologies and Testing
LTM
Mirt
A new look at the statistical model identification
Estimating the Dimension of a Model
The Effects of Q-Matrix Design on Classification Accuracy in the Log-Linear Cognitive Diagnosis Model
Assessing Change in Latent Skills Across Time With Longitudinal Cognitive Diagnosis Modeling
A Latent Transition Analysis Model for Assessing Change in Cognitive Skills
| Unique citing works | 1 |
|---|---|
| Citations per year | 1 |
| Citation span | 2026 - 2026 (1) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 1 |