Hypothetical Use of Multidimensional Adaptive Testing for the Assessment of Student Achievement in the Programme for International Student Assessment
Bibliographic Data
| ID | 20286796 |
|---|---|
| Authors | Andreas Frey (0000-0001-5334-9538, Leibniz Institute for Science and Mathematics Education (IPN), Kiel, Germany,, corresponding author), Nicki-Nils Seitz (Leibniz Institute for Science and Mathematics Education (IPN), Kiel, Germany) |
| Year | 2011 |
| Volume | 71 |
| Issue | 3 |
| Pages | 503-522 |
| Publication date | 2011-06-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0013164410381521 |
| OpenAlex | W2031788179 |
| Language | EN |
| Citations received | 2 |
| References cited | 24 |
The usefulness of multidimensional adaptive testing (MAT) for the assessment of student literacy in the Programme for International Student Assessment (PISA) was examined within a real data simulation study. The responses of N = 14,624 students who participated in the PISA assessments of the years 2000, 2003, and 2006 in Germany were used to simulate MAT with different restrictions (unrestricted, treatment of link items, treatment of open items, content balance, unitwise item selection, all restrictions). Compared with conventional testing based on the booklet design of PISA 2006, unrestricted MAT increases measurement efficiency by 74% and reduces the average number of presented items from 55 to 26 without a loss in measurement precision. The incorporation of restrictions reduces the advantages of MAT. MAT is recommended for the assessment of newly introduced constructs but not for the assessment of the literacy domains in PISA
Alternative assessment · Computerized adaptive testing · Educational assessment · Item analysis · Item response theory · Literacy · Mathematics education · Pedagogy · Psychometrics · Standardized test · Statistics · Test (biology) · Applied Psychology · Clinical Psychology · Educational Assessment and Improvement · Mathematics · Psychology · Psychometric Methodologies and Testing · School Choice and Performance
| Citations per year | 0.25 |
|---|---|
| Citation span | 2018 - 2021 (4) |
| Highly cited | No |