Overcoming the Volatility in School-Level Gain Scores

A New Approach to Identifying Value Added With Cross-Sectional Data

Bibliographic Data

ID9735304
AuthorsSean Kelly (0000-0002-2415-0375, Assistant professor of sociology at the University of Notre Dame and the Center for Research on Educational Opportunity, 1015 Flanner Hall, University of Notre Dame, Notre Dame, IN 46556-5611; . His research has focused on several educational issues facing America’s schools, including problems of student engagement, the process of matching teachers to classrooms, the assignment of diverse students to course sequences in high..., corresponding author), Laura Monczunski (Graduate of the University of Notre Dame and a graduate student in the Department of Speech, Language, and Hearing Sciences, Purdue University, Heavilon Hall, 500 Oval Drive, West Lafayette, IN 437907-2038)
Year2007
Volume36
Issue5
Pages279-287
Publication date2007-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational Researcher (JOURNAL)
Journal identifiersISSN: 0013-189X • E-ISSN: 1935-102X
PublisherAmerican Educational Research Association (AERA) (PUBLISHER)
DOI10.3102/0013189x07306557
OpenAlexW2110469034
LanguageEN
Citations received5
References cited15

Traditionally, state accountability systems have measured school-level achievement gains using cross-sectional data, for example, by comparing scores of one year’s eighth graders to scores of the next year’s eighth graders. This approach produces extremely volatile estimates of value added from year to year. This volatility suggests that the traditional use of cross-sectional data cannot reliably estimate the production of achievement by schools, and therefore schools may be unfairly sanctioned under such a system. In this analysis, the authors consider an alternative use of cross-sectional data, identifying differences in relative subject matter performance within schools. They illustrate this approach using data on public middle schools in Wisconsin during the years 1998 to 2001. Compared to school-level gain scores, relative subject matter performance is much more stable from year to year. The authors conclude that in lieu of more reliable measures of value added, state educational agencies should consider alternative uses of standardized test data

Academic achievement · Accountability · Cross-sectional data · Cross-sectional study · Econometrics · Economics · Mathematics education · Political science · Statistics · Value (mathematics · Volatility (finance · Educational Assessment and Improvement · Higher Education Research Studies · Mathematics · Psychology · School Choice and Performance