An exploratory reliability study of PLAAFP quality scores

Bibliographic Data

ID21723131
AuthorsChristopher M Claude (0000-0001-5799-215X, Rehabilitation Research & Training Center Virginia Commonwealth University Richmond Virginia USA, corresponding author), Gino D Binkert (College of Education University of Mary Washington Fredericksburg Virginia USA), Frederick J Brigham (Department of Special Education George Mason University Fairfax Virginia USA), Sarah A Nagro (0000-0002-7277-4270, Department of Educational Psychology Texas A&M University College Station Texas USA)
Year2026
Volume26
Issue2
Publication date2026-04-01
Open AccessYes
TypeARTICLE
VenueJournal of Research in Special Educational Needs (JOURNAL)
Journal identifiersISSN: 1471-3802 • E-ISSN: 1471-3802
PublisherWiley (PUBLISHER • GB)
DOI10.1111/1471-3802.70086
OpenAlexW7142496565
LanguageEN
References cited27

This study evaluated the psychometric properties of a rubric designed to measure the quality of Present Levels of Academic Achievement and Functional Performance (PLAAFP) statements for students with disabilities. Interrater reliability was assessed through non‐parametric analyses among ratings from three raters scoring PLAAFP statements. Results indicated high interrater consistency, with a significant average Kendall's τ of 0.82, Spearman's ρ of 0.91, Pearson correlations ranging from 0.87 to 0.96 between rater pairs and a rank ICC of 0.91, demonstrating the reliability across raters in differentiating PLAAFP quality using the rubric. The rubric's internal structure was examined through internal consistency measures and exploratory factor analysis (EFA). McDonald's ω (0.82) and Cronbach's α (0.79) indicated acceptable internal consistency for the overall rubric, though we recognize the former is more appropriate as the EFA suggested a potential three‐factor model. These findings provide initial evidence of the rubric's strong interrater reliability and internally consistent factor structure for evaluating PLAAFP statement quality. We conclude by discussing how psychometrically sound PLAAFP measurement may support teacher preparation and enable future researchers to relate quality scores to student outcomes

Exploratory factor analysis · Inter-rater reliability · Internal consistency · Psychometrics · Rubric · Behavioral and Psychological Studies · Disability Education and Employment · Psychometric Methodologies and Testing

Tools

Open DOIOpen Access