The importance of adjusting for pupil background in school value‐added models
A study of Progress 8 and school accountability in England
Bibliographic Data
| ID | 11159367 |
|---|---|
| Authors | Glenn Leckie (0000-0003-1486-745X, Centre for Multilevel Modelling and School of Education University of Bristol UK, corresponding author), Harvey Goldstein (0000-0003-3878-4122, Centre for Multilevel Modelling and School of Education University of Bristol UK) |
| Year | 2019 |
| Volume | 45 |
| Issue | 3 |
| Pages | 518-537 |
| Publication date | 2019-06-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | British Educational Research Journal (JOURNAL) |
| Journal identifiers | ISSN: 0141-1926 • E-ISSN: 1469-3518 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1002/berj.3511 |
| OpenAlex | W2914880710 |
| Language | EN |
| Citations received | 18 |
| References cited | 28 |
In the UK , USA and elsewhere, school accountability systems increasingly compare schools using value‐added measures of school performance derived from pupil scores in high‐stakes standardised tests. Rather than naïvely comparing school average scores, which largely reflect school intake differences in prior attainment, these measures attempt to compare the average progress or improvement pupils make during a year or phase of schooling. Schools, however, also differ in terms of their pupil demographic and socioeconomic characteristics and these factors also predict why some schools subsequently score higher than others. Many therefore argue that value‐added measures unadjusted for pupil background are biased in favour of schools with more ‘educationally advantaged’ intakes. But others worry that adjusting for pupil background entrenches socioeconomic inequities and excuses low‐performing schools. In this article we explore these theoretical arguments and their practical importance in the context of the ‘Progress 8’ secondary school accountability system in England, which has chosen to ignore pupil background. We reveal how the reported low or high performance of many schools changes dramatically once adjustments are made for pupil background, and these changes also affect the reported differential performances of regions and of different school types. We conclude that accountability systems which choose to ignore pupil background are likely to reward and punish the wrong schools and this will likely have detrimental effects on pupil learning. These findings, especially when coupled with more general concerns surrounding high‐stakes testing and school value‐added models, raise serious doubts about their use in school accountability systems
Accountability · Context (archaeology) · Economic growth · Economics · Educational attainment · Geography · Political science · Population · Pupil · Socioeconomic status · Sociology · Value (mathematics) · Worry · Demography · Educational Assessment and Improvement · Parental Involvement in Education · Psychology · School Choice and Performance · Social Psychology
How Rare and How Stable? Resilient and Vulnerable School Profiles in Hungary Before and After the Covid-19 Pandemic
Challenges and validation in estimating teacher value-added in English secondary schools
Future-Oriented Science Education
Accountability, performance management and inspection
What drives postgraduate awarding gaps? Modelling master’s degree outcomes
Good schools or good students? The importance of selectivity for school rankings
How comparing school performance data can support sensemaking for school development
Character education and academic progression in English schools
Local Geographic Variations in Children’s School Readiness - A Multilevel Analysis of the Development Gaps in England
We pamper them and suddenly reality hits them
Does school effectiveness differentially benefit boys and girls? Evidence from Ethiopia, India and Vietnam
The evaluation of students’ progression in lower secondary education in Brazil
Differential effect of university entrance scores on graduates’ performance
Historical Development of Value-Added Assessment
Intervention culture, grouping and triage
Should value‐added school effects models include student‐ and school‐level covariates? Evidence from Australian population assessment data
Student mobility
Sociodemographic Inequalities in Student Achievement
The Testing Charade
Educational effectiveness research (EER)
Statistical Modelling Issues in School Effectiveness Studies
The Estimation of School Effects
Multilevel Statistical Models
The dynamics of school attainment of England’s ethnic minorities
Phantom’ compositional effects in English school value-added measures
Ethnicity, gender, social class and achievement gaps at age 16
Revisiting free school meal eligibility as a proxy for pupil socio‐economic deprivation
Trends in examination performance and exposure to standardised tests in England and Wales
Gender, Ethnic and Socio‐economic Differences in Attainment and Progress
The evolution of school league tables in England 1992–2016
English Value‐Added Measures
High stakes testing, accountability, incentives and consequences in English schools
| Unique citing works | 18 |
|---|---|
| Citations per year | 3 |
| Citation span | 2020 - 2026 (7) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 18 |