Reliability

Arguments for Multiple Perspectives and Potential Problems with Generalization across Studies

Bibliographic Data

ID20284236
AuthorsDimiter M Dimitrov (0000-0003-1256-4842, Kent State University, corresponding author)
Year2002
Volume62
Issue5
Pages783-801
Publication date2002-10-01
Open AccessYes
TypeARTICLE
VenueEducational and Psychological Measurement (JOURNAL)
Journal identifiersISSN: 0013-1644 • E-ISSN: 1552-3888
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/001316402236878
OpenAlexW2100640223
LanguageEN
Citations received9
References cited60

The present article addresses reliability issues in light of recent studies and debates focused on psychometrics versus datametrics terminology and reliability generalization (RG) introduced by Vacha-Haase. The purpose here was not to moderate arguments presented in these debates but to discuss multiple perspectives on score reliability and how they may affect research practice, editorial policies, and RG across studies. Issues of classical error variance and reliability are discussed across models of classical test theory, generalizability theory, and item response theory. Potential problems with RG across studies are discussed in relation to different types of reliability, different test forms, different number of items, misspecifications, and confounding independent variables in a single RG analysis

Classical test theory · Confounding · Econometrics · Economics · Generalizability theory · Generalization · Item response theory · Linguistics · Psychometrics · Reliability (semiconductor) · Reliability theory · Statistics · Terminology · Test (biology) · Variance (accounting) · Advanced Statistical Modeling Techniques · Computer Science · Mathematics · Psychology · Psychometric Methodologies and Testing · Reliability and Agreement in Measurement

Tools

Open DOISci-Hub