On the Benefits of Using Maximal Reliability in Educational and Behavioral Research

Bibliographic Data

ID20283952
AuthorsTenko Raykov (0000-0002-8911-5116, Michigan State University, East Lansing, USA, corresponding author)
Year2024
Volume84
Issue5
Pages994-1011
Publication date2024-10-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational and Psychological Measurement (JOURNAL)
Journal identifiersISSN: 0013-1644 • E-ISSN: 1552-3888
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/00131644231215771
PMID39318478
OpenAlexW4390273513
LanguageEN
Citations received3
References cited13

This note is concerned with the benefits that can result from the use of the maximal reliability and optimal linear combination concepts in educational and psychological research. Within the widely used framework of unidimensional multi-component measuring instruments, it is demonstrated that the linear combination of their components that possesses the highest possible reliability can exhibit a level of consistency considerably exceeding that of their overall sum score that is nearly routinely employed in contemporary empirical research. This optimal linear combination can be particularly useful in circumstances where one or more scale components are associated with relatively large error variances, but their removal from the instrument can lead to a notable loss in validity due to construct underrepresentation. The discussion is illustrated with a numerical example

Component (thermodynamics) · Consistency (knowledge bases) · Construct (python library) · Econometrics · Empirical research · Internal consistency · Psychometrics · Reliability (semiconductor) · Reliability engineering · Scale (ratio) · Statistics · Artificial Intelligence · Computer Science · Early Childhood Education and Development · Engineering · Mathematics · Psychology · Psychometric Methodologies and Testing · School Choice and Performance

Tools

Open DOIOpen Access