Modeling Trajectories in Social Program Outcomes for Performance Accountability

Government and public focus on accountability for program outcomes, combined with practical and ethical constraints on experimental designs, make nonexperimental studies of social programs an increasingly common approach to producing information on program performance. In this paper, we compare the effectiveness of alternative nonexperimental evaluation methods used with longitudinal data to produce information about social program outcomes. The analysis is applied in an evaluation of a demonstration program designed to help young parents and their partners make the transition from receiving public transfer income to earned income. Empirical findings indicate that modeling outcome trajectories using multilevel methods generates more complete information about the nature of the program effects, relative to standard econometric alternatives as commonly applied in evaluations. With increased access to sources of administrative and management information system data covering multiple time points, we urge researchers to help social policy and program decision-makers appropriately model and produce more accurate information on program outcomes

Accountability · Actuarial science · Business · Economics · Government (linguistics · Logic model · Management science · Outcome (game theory · Political science · Program evaluation · Advanced Causal Inference Techniques · Computer Science · Income, Poverty, and Inequality · School Choice and Performance

• Does State Unemployment Insurance Modernization Explain the Trajectories of Economic Security Among Working Households? Longitudinal Evidence from the 2008 Survey of Income and Program Participation

  Open Access•Yu-Ling Chang•Journal of Family and Economic…•2020

  Incluir item

• Multiple factor analysis for time-varying two-mode networks

  Open Access•Giancarlo Ragozini, Domenico De Stefano et al.•Network Science•2015

  Incluir item

• Are Local Public Health Department Services Related to Racial Disparities in Mortality

  Open Access•Betty Bekemeier, David Grembowski et al.•SAGE Open•2014

  Incluir item

• User-Centered Policy Evaluations of Section 508 of the Rehabilitation Act

  Open Access•Paul T Jaeger•Journal of Disability Policy…•2008

  Incluir item

• Are local health department expenditures related to racial disparities in mortality

  Open Access•David Grembowski, Betty Bekemeier et al.•Social Science & Medicine•2010

  Incluir item

• Characterizing Selection Bias Using Experimental Data

  James Heckman, Hidehiko Ichimura et al.•Econometrica•1998

  Incluir item

• Choosing among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs

  James J Heckman, Joseph Hotz et al.•Journal of the American…•1989

  Incluir item

• The Economics and Econometrics of Active Labor Market Programs

  Open Access•James J Heckman, Robert J Lalonde et al.•Handbook of labor economics•1999

  Incluir item

• Alternative methods for evaluating the impact of interventions

  Open Access•James J Heckman, Richard Robb et al.•Longitudinal analysis of labor…•1985

  Incluir item

• Using SAS PROC Mixed to Fit Multilevel Models, Hierarchical Models, and Individual Growth Models

  Judith D Singer•Journal of Educational and…•1998

  Incluir item

• Estimating the Effect of Training Programs on Earnings

  Orley Ashenfelter•The Review of Economics and…•1978

  Incluir item

• Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs

  Orley Ashenfelter, David Card•The Review of Economics and…•1985

  Incluir item

• Using Performance Measurement Systems for Assessing the Merit and Worth of Reforms

  Open Access•Steve A Harkreader, Gary T Henry•American Journal of Evaluation•2000

  Incluir item

• Getting More “Bang” for Your Performance Measures “Buck”

  Open Access•Mary Ann Scheirer•American Journal of Evaluation•2000

  Incluir item

• Linking program implementation and effectiveness

  Open Access•Howard S Bloom, Carolyn J Hill et al.•Journal of Policy Analysis and…•2003

  Incluir item

• The interaction between single mothers' living arrangements and welfare participation

  Open Access•Rebecca A London•Journal of Policy Analysis and…•2000

  Incluir item

• Moving Up, Moving Out, or Going Nowhere? A Study of the Employment Patterns of Young Women and the Implications for Welfare Mothers

  Open Access•LaDonna Pavetti, Gregory Acs•Journal of Policy Analysis and…•2001

  Incluir item

• A Multilevel Model of Client Participation in Intensive Family Preservation Services

  Julia H Littell, Emiko A Tajima et al.•Social Service Review•2000

  Incluir item

• Spline Functions Fitted by Standard Regression Methods

  Daniel B Suits, Andrew Mason et al.•The Review of Economics and…•1978

  Incluir item

• Assessing the Case for Social Experiments

  Open Access•James J Heckman, Jeffrey A Smith•The Journal of Economic…•1995

  Incluir item