Improvement of Norm Score Quality via Regression-Based Continuous Norming
Bibliographic Data
| ID | 20286233 |
|---|---|
| Authors | Wolfgang Lenhard (0000-0002-8184-6889, University of Wuerzburg, Wuerzburg, Germany, corresponding author), Alexandra Lenhard (0000-0001-8680-4381, Psychometrica, Dettelbach, Germany) |
| Year | 2021 |
| Volume | 81 |
| Issue | 2 |
| Pages | 229-261 |
| Publication date | 2021-04-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0013164420928457 |
| PMID | 37929259 |
| OpenAlex | W3034855494 |
| Language | EN |
| Citations received | 3 |
| References cited | 26 |
The interpretation of psychometric test results is usually based on norm scores. We compared semiparametric continuous norming (SPCN) with conventional norming methods by simulating results for test scales with different item numbers and difficulties via an item response theory approach. Subsequently, we modeled the norm scores based on random samples with varying sizes either with a conventional ranking procedure or SPCN. The norms were then cross-validated by using an entirely representative sample of N = 840,000 for which different measures of norming error were computed. This process was repeated 90,000 times. Both approaches benefitted from an increase in sample size, with SPCN reaching optimal results with much smaller samples. Conventional norming performed worse on data fit, age-related errors, and number of missings in the norm tables. The data fit in conventional norming of fixed subsample sizes varied with the granularity of the age brackets, calling into question general recommendations for sample sizes in test norming. We recommend that test norms should be based on statistical models of the raw score distributions instead of simply compiling norm tables via conventional ranking procedures
Econometrics · Norm (philosophy) · Raw data · Raw score · Sample size determination · Statistics · Type I and type II errors · Advanced Statistical Modeling Techniques · Mathematics · Psychology · Psychometric Methodologies and Testing · Statistical Methods and Inference
Diagnostic and Statistical Manual of Mental Disorders
The measurement of adult intelligence.
The measurement of intelligence.
Age differences in fluid and crystallized intelligence
Item response theory.
Generalized Additive Models for Location, Scale and Shape
Smoothing reference centile curves
Regularization Paths for Generalized Linear Models via Coordinate Descent
Statistical power analyses using G*Power 3.1
| Citations per year | 0.6 |
|---|---|
| Citation span | 2021 - 2025 (5) |
| Highly cited | No |