Can Nonexperimental Estimates Replicate Estimates Based on Random Assignment in Evaluations of School Choice? A Within‐Study Comparison
Dados Bibliográficos
| ID | 11680383 |
|---|---|
| Autores | Robert Bifulco (autor correspondente) |
| Ano | 2012 |
| Volume | 31 |
| Fascículo | 3 |
| Páginas | 729-751 |
| Data de publicação | 2012-04-26 |
| Peer Reviewed | Sim |
| Open Access | Sim |
| Tipo | ARTICLE |
| Periódico | Journal of Policy Analysis and Management (JOURNAL) |
| Identificadores do periódico | ISSN: 0276-8739 • E-ISSN: 1520-6688 |
| Editora | Wiley (PUBLISHER • GB) |
| DOI | 10.1002/pam.20637 |
| OpenAlex | W2051063248 |
| Idioma | EN |
| Citações recebidas | 37 |
| Referências citadas | 16 |
The ability of nonexperimental estimators to match impact estimates derived from random assignment is examined using data from the evaluation of two interdistrict magnet schools. As in previous within‐study comparisons, nonexperimental estimates differ from estimates based on random assignment when nonexperimental estimators are implemented without pretreatment measures of academic performance. With comparison groups consisting of students drawn from the same districts or districts with similar student body characteristics as the districts where treatment group students reside, using pretreatment test scores reduces the bias in nonexperimental methods between 64 and 96 percent. Adding pretreatment test scores does not achieve as much bias reduction when the comparison group consists of students drawn from districts with different student body characteristics than the treatment group students’ districts. The results suggest that using pretreatment outcome measures and comparison groups that are geographically aligned with the treatment group greatly improves the performance of nonexperimental estimators
Biology · Econometrics · Estimator · Random assignment · Replicate · Statistics · Test (biology · Advanced Causal Inference Techniques · Mathematics · Psychology · School Choice and Performance · Spatial and Panel Data Analysis
Quasi-Experimental Designs
Reaching the Finish Line
Evaluating Contradictory Experimental and Nonexperimental Estimates of Neighborhood Effects on Economic Outcomes for Adults
Do virtual schools deliver in rural areas? A longitudinal analysis of academic outcomes
A quasi-experimental approach to evaluating magnet schools
A framework to analyse inclusiveness of urban policy
The Effect of Register, Direction, and Magnitude on Musicians’ Evaluations of Chamber Ensemble Intonation
Voucher Pathways and Student Achievement in Indiana’s Choice Scholarship Program
A Within-Study Approach to Evaluating the Role of Moderators of Impact in Limiting Generalizations from “Large to Small”
How Within-Study Comparisons can Inform Research and Evaluation Design for the Third Sector
Broadening Benefits from Natural Resource Extraction
What Works Best and When
Environmental Tax, Polluting Plants’ Strategies and Effectiveness
Empirical Strategies in International Development Research
Improving the Implementation and Effectiveness of Out-of-School-Time Tutoring
The Currents Beneath the “Rising Tide” of School Choice
The Art and Science of Scholarly Publishing
The Internal and External Validity of the Regression Discontinuity Design
Lurking Inferential Monsters? Quantifying Selection Bias in Evaluations of School Programs
Strengthening the Regression Discontinuity Design Using Additional Design Elements
Charter High Schools’ Effects on Long‐Term Attainment and Earnings
Can Quasi‐experimental Evaluations That Rely on State Longitudinal Data Systems Replicate Experimental Results
Impact of the Indiana Choice Scholarship Program
Early Colleges at Scale
Examining Variation Within the Charter School Sector
Private School Choice and Crime
Making Catholic Schools Research Relevant
Virtual Illusion
Short Comparative Interrupted Time Series Using Aggregate School-Level Data in Education Research
The Impacts of Virtual Charter High Schools on Secondary and Postsecondary Outcomes
The Role of College-Bound Friends in College Enrollment Decisions by Race, Ethnicity, and Gender
Insufficient Accountability? Heterogeneous Effects of Charter Schools Across Authorizing Agencies
Combining a Local Comparison Group, a Pretest Measure, and Rich Covariates
Teacher Merit Pay
Empirical Innovations in Policy Analysis
School Vouchers and Student Attainment
Learning from Schools
Characterizing Selection Bias Using Experimental Data
The impact of school choice on student outcomes
The Effect of School Choice on Participants
Private School Vouchers and Student Achievement
Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions
Estimation of Average Treatment Effects Based on Propensity Scores
The Economics and Econometrics of Active Labor Market Programs
Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments
Matching As An Econometric Evaluation Estimator
Are Experiments the Only Option? A Look at Dropout Prevention Programs
How close is close enough? Evaluating propensity score matching using data from a class size reduction experiment
School vouchers and academic performance
Three conditions under which experiments and observational studies produce comparable causal estimates
Nonexperimental Versus Experimental Estimates of Earnings Impacts
| Obras citantes distintas | 37 |
|---|---|
| Citações por ano | 2,85 |
| Intervalo de citações | 2013 - 2025 (13) |
| Velocidade de citação | recent |
| Altamente citado | Não |
| Tipos de citação | Neutras: 37 |