A Nondiagnostic Assessment for Diagnostic Purposes

Q-Matrix Validation and Item-Based Model Fit Evaluation for the TIMSS 2011 Assessment

Bibliographic Data

ID16914280
AuthorsRagip Terzi (0000-0003-3976-5054, Harran University, corresponding author), Sedat Şen (0000-0001-6962-4960, Harran University)
Year2019
Volume9
Issue1
Publication date2019-01-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSAGE Open (JOURNAL)
Journal identifiersISSN: 2158-2440 • E-ISSN: 2158-2440
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/2158244019832684
OpenAlexW2916978547
LanguageEN
Citations received2
References cited35

Large-scale assessments are generally designed for summative purposes to compare achievement among participating countries. However, these nondiagnostic assessments have also been adapted in the context of cognitive diagnostic assessment for diagnostic purposes. Following the large amount of investments in these assessments, it would be cost-effective to draw finer-grained inferences about the attribute mastery. Nonetheless, the correctness of attribute specifications in the Q-matrix has not been verified, despite being designed by domain experts. Furthermore, the underlying process of TIMSS (Trends in International Mathematics and Science Study) assessment is unknown as it was not developed for diagnostic purposes. Thus, this study suggests an initial validating attribute specifications in the Q-matrix and thereafter defining specific reduced or saturated models for each item. In doing so, the two analyses were validated across 20 countries that were selected randomly for TIMSS 2011 data. Results show that attribute specifications can differ from expert opinions and the underlying model for each item can vary

Algorithm · Correctness · Econometrics · Formative assessment · Mathematics education · Summative assessment · Cognitive Science and Mapping · Computer Science · Mathematics · Multi-Criteria Decision Making · Psychology · Psychometric Methodologies and Testing

Tools

Open DOISci-HubOpen Access