How Does Calibration Timing and Seasonality Affect Item Parameter Estimates
Bibliographic Data
| ID | 20286288 |
|---|---|
| Authors | Adam E Wyse (0000-0002-1719-9461, The American Registry of Radiologic Technologists, St. Paul, MN, USA, corresponding author), Ben Babcock (0000-0003-4107-8894, The American Registry of Radiologic Technologists, St. Paul, MN, USA) |
| Year | 2016 |
| Volume | 76 |
| Issue | 3 |
| Pages | 508-527 |
| Publication date | 2016-06-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0013164415588947 |
| PMID | 29795876 |
| OpenAlex | W2341444600 |
| Language | EN |
| References cited | 26 |
Continuously administered examination programs, particularly credentialing programs that require graduation from educational programs, often experience seasonality where distributions of examine ability may differ over time. Such seasonality may affect the quality of important statistical processes, such as item response theory (IRT) item calibration and equating. The lead time required for producing pre-equated test forms in the continuous testing framework further complicates issues. This study examines the effect of seasonality in test data on Rasch IRT item parameter estimates. Data came from four credentialing examination programs that represented both programs with and without seasonality, as well as medium and low examinee volume. Results showed that calibrating items during certain times can lead to quite poor item parameter estimates. While certain programs could conduct IRT calibrations without waiting for the full examination cycle to be completed, other types of programs should wait as long as possible before calibrating items
Affect (linguistics) · Calibration · Credentialing · Econometrics · Equating · Graduation (instrument) · Item response theory · Medical education · Psychometrics · Rasch model · Seasonality · Statistics · Test (biology) · Advanced Statistical Modeling Techniques · Computer Science · Mathematics · Medicine · Psychology · Psychometric Methodologies and Testing
Test Equating, Scaling, and Linking
Invariant Measurement
Developing a Common Metric in Item Response Theory
Conditional Versus Unconditional Procedures for Sample-Free Item Analysis
Item Parameter Recovery, Standard Error Estimates, and Fit Statistics of the Winsteps Program for the Family of Rasch Models
| Citation velocity | historical |
|---|---|
| Highly cited | No |