Inefficiency, Subsample Selection Bias, and Nonrobustness

A Response to Paul E. Peterson and William G. Howell

Dados Bibliográficos

ID4744950
AutoresAlan B Krueger, Pei Zhu (0000-0001-9257-5394, Princeton University)
Ano2004
Volume47
Fascículo5
Páginas718-728
Data de publicação2004-01-01
Peer ReviewedSim
Open AccessSim
TipoARTICLE
PeriódicoAmerican Behavioral Scientist (JOURNAL)
Identificadores do periódicoISSN: 0002-7642 • E-ISSN: 1552-3381
EditoraSAGE Publications Inc (PUBLISHER)
DOI10.1177/0002764203260150
OpenAlexW2014013776
IdiomaEN
Citações recebidas14
Referências citadas8

This article responds to Peterson and Howell's (PH's) defense of their voucher research. We show that PH's rationales for excluding some 815 students-more than 40% of their sample-because they lacked baseline data in a randomized experiment are unconvincing. For example, PH's assertion that students with missing baseline scores had a greater risk of mismatch is based on a misunderstanding of the way the experiment was conducted; the organization that conducted the experiment believes the procedures actually used precluded such a problem. Including students with missing baseline data renders the effect of vouchers insignificant for Black students, even using PH's nonstandard racial classification scheme. PH also give the misleading impression that our reanalysis shows their results to be robust. In fact, only 7 out of the 27 of our estimates that did not simply reuse PH's original, incomplete sample of Black students are positive and statistically significant

Assertion · Baseline (sea) · Developmental psychology · Economics · Equating · Inefficiency · Microeconomics · Missing data · Political science · Sample (material) · Selection (genetic algorithm) · Selection bias · Statistics · Voucher · Advanced Causal Inference Techniques · Artificial Intelligence · Computer Science · Higher Education Research Studies · Law · Mathematics · Psychology · School Choice and Performance · Social Psychology