What Affects the Quality of Score Transformations? Potential Issues in True-Score Equating Using the Partial Credit Model
Bibliographic Data
| ID | 20282961 |
|---|---|
| Authors | Carolina Fellinghauer (0000-0002-0042-9945, University of Zurich, corresponding author), Rudolf Debelak (0000-0001-8900-2106, University of Zurich), Carolin Strobl (0000-0003-0952-3230, University of Zurich) |
| Year | 2023 |
| Volume | 83 |
| Issue | 6 |
| Pages | 1249-1290 |
| Publication date | 2023-12-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/00131644221143051 |
| PMID | 37970488 |
| OpenAlex | W4316193312 |
| Language | EN |
| Citations received | 1 |
| References cited | 73 |
This simulation study investigated to what extent departures from construct similarity as well as differences in the difficulty and targeting of scales impact the score transformation when scales are equated by means of concurrent calibration using the partial credit model with a common person design. Practical implications of the simulation results are discussed with a focus on scale equating in health-related research settings. The study simulated data for two scales, varying the number of items and the sample sizes. The factor correlation between scales was used to operationalize construct similarity. Targeting of the scales was operationalized through increasing departure from equal difficulty and by varying the dispersion of the item and person parameters in each scale. The results show that low similarity between scales goes along with lower transformation precision. In cases with equal levels of similarity, precision improves in settings where the range of the item parameters is encompassing the person parameters range. With decreasing similarity, score transformation precision benefits more from good targeting. Difficulty shifts up to two logits somewhat increased the estimation bias but without affecting the transformation precision. The observed robustness against difficulty shifts supports the advantage of applying a true-score equating methods over identity equating, which was used as a naive baseline method for comparison. Finally, larger sample size did not improve the transformation precision in this study, longer scales improved only marginally the quality of the equating. The insights from the simulation study are used in a real-data example
Econometrics · Equating · Operationalization · Rasch model · Robustness (evolution) · Sample (material) · Sample size determination · Scale (ratio) · Similarity (geometry) · Statistic · Statistics · Transformation (genetics) · Artificial Intelligence · Behavioral Health and Interventions · Computer Science · Mathematics · Mental Health Research Topics · Psychometric Methodologies and Testing
Test Equating, Scaling, and Linking
Effects of Local Item Dependence on the Fit and Equating Performance of the Three-Parameter Logistic Model
A Rasch Model for Partial Credit Scoring
Estimation of IRT graded response models
The Rasch measurement model in rheumatology
Mirt
Optimal number of response categories in rating scales
A Comparison of two Methods of Test Equating in the Rasch Model
Linking scores from multiple health outcome instruments
Longitudinal Stability of IRT and Equivalent-Groups Linear and Equipercentile Equating
Item Response Theory and Health Outcomes Measurement in the 21st Century
Which Model is Best? Robustness Properties to Justify Model Choice Among Unidimensional IRT Models under Item Parameter Drift
| Citations per year | 1 |
|---|---|
| Citation span | 2025 - 2025 (1) |
| Highly cited | No |