Finding the Impact in a Messy Intervention
Using an Integrated Design to Evaluate a Comprehensive Citywide Health Initiative
Bibliographic Data
| ID | 12470977 |
|---|---|
| Authors | Beth C Weitzman (0009-0001-0574-9470, New York University, corresponding author), Tod Mijanovich (0000-0001-8454-3018, New York University), Diana Silver (0000-0002-8135-0306, New York University), Charles Brecher (New York University) |
| Year | 2009 |
| Volume | 30 |
| Issue | 4 |
| Pages | 495-514 |
| Publication date | 2009-11-10 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1098-2140 • E-ISSN: 1557-0878 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1098214009347555 |
| OpenAlex | W1994871352 |
| Language | EN |
| Citations received | 8 |
| References cited | 11 |
This article uses the evaluation of the Robert Wood Johnson Foundation’s (RWJF) Urban Health Initiative (UHI), a 10-year effort to improve health and safety outcomes in distressed cities, to demonstrate the strength of an evaluation design that integrates theory of change and quasi-experimental approaches, including the use of comparison cities. This paper focuses on the later stages of implementation and, especially, our methods for estimating program impacts. While the theory of change was used to make preliminary identification of intended outcomes, we used the sites’ plans and early implementation to refine this list and revisit our strategy for estimating impacts. Using our integrated design, differences between program and comparison cities are considered impacts only if they were predicted by program theory, local plans for action, and early implementation. We find small, measurable changes in areas of greatest programmatic effort. We discuss the importance of the integrated design in identifying impacts
Economics · Environmental planning · Health impact assessment · Identification (biology · Impact evaluation · Intervention (counseling · Management · Political science · Program Design Language · Program evaluation · Public health · Statistics · Theory of change · Transport engineering · Community Health and Development · Computer Science · Engineering · Environmental Science · Evaluation and Performance Assessment · Homelessness and Social Issues · Mathematics · Medicine · Nursing · Public Administration
Theory of Change
Using theory of change to design and evaluate public health interventions
Mainstreaming the framework of ecosystem services to enhance China's policy implementation for sponge city development
An evaluation of the California community intervention
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
The Good, the Bad, and the Evaluator
Formal Theory Versus Stakeholder Theory
From priority to endgame
Experimental Analysis of Neighborhood Effects
Strong theory, flexible methods
How Would We Know What Works
Integrating a Comparison Group Design into a Theory of Change Evaluation
Integrating a Comparison Group Design into a Theory of Change Evaluation
Systems change as an outcome and a process in the work of community collaboratives for health
Efforts to Improve Public Policy and Programs through Data Practice
Setting an Agenda for Local Action
The Pros and Cons of Comprehensive Community Initiatives at the City Level
| Unique citing works | 8 |
|---|---|
| Citations per year | 0,5 |
| Citation span | 2010 - 2023 (14) |
| Citation velocity | historical |
| Highly cited | No |
| Citation types | Neutral: 8 |