Integrating a Comparison Group Design into a Theory of Change Evaluation
The Case of the Urban Health Initiative
Bibliographic Data
| ID | 12470615 |
|---|---|
| Authors | Beth C Weitzman (0009-0001-0574-9470, New York University, corresponding author), Diana Silver (0000-0002-8135-0306), Keri-Nicole Dillman |
| Year | 2002 |
| Volume | 23 |
| Issue | 4 |
| Pages | 371-385 |
| Publication date | 2002-12-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1098-2140 • E-ISSN: 1557-0878 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/109821400202300402 |
| OpenAlex | W4235445187 |
| Language | EN |
| Citations received | 22 |
| References cited | 8 |
This paper describes how we strengthened the theory of change approach to evaluating a complex social initiative by integrating it with a quasi-experimental, comparison group design. We also demonstrate the plausibility of selecting a credible comparison group through the use of cluster analysis, and describe our work in validating that analysis with additional measures. The integrated evaluation design relies on two points of comparison: (1) program theory to program experience; and (2) program cities to comparison cities. We describe how we are using this integrated design to evaluate the Robert Wood Johnson Foundation’s Urban Health Initiative, an effort that aims to improve health and safety outcomes for children and youth in five distressed urban areas through a process of citywide, multi-sector planning and changed public and private systems. We also discuss how the use of two research frameworks and multiple methods can enrich our ability to test underlying assumptions and evaluate overall program effects. Using this integrated approach has provided evidence that the earliest phases of this initiative are unfolding as the theory would predict, and that the comparison cities are not undergoing a similar experience to those in UHI. Despite many remaining limitations, this integrated evaluation can provide greater confidence in assessing whether future changes in health and safety outcomes may have resulted from the Urban Health Initiative (UHI)
Civil engineering · Environmental planning · Geography · Management science · Political science · Program Design Language · Program evaluation · Public health · Sociology · Test (biology · Theory of change · Urban design · Urban planning · Work (physics · Applied Psychology · Community Health and Development · Computer Science · Engineering · Evaluation and Performance Assessment · Health Policy Implementation Science · Medicine · Nursing · Psychology · Public Administration
Theory of Change
Using theory of change to design and evaluate public health interventions
Community pandemic prevention and control measures and their influence on citizen satisfaction during the Covid-19 pandemic in China
Evaluating theory of change to improve the functioning of the network for improving quality of care for maternal, newborn and child health
The Pros and Cons of Comprehensive Community Initiatives at the City Level
Scope, Scale, and Sustainability
Following the Money
Does Paid Family Leave Reduce Nursing Home Use? The California Experience
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Theories of Change and Realistic Evaluation
Who Owns the Theory of Change
The Practice and the Theory
Evaluating the Legacy of Community Health Initiatives
The Development and Use of a Theory of Change to Align Programs and Evaluation in a Complex, National Initiative
An Assessment of Evaluation Designs
Finding the Impact in a Messy Intervention
Accountability and Performance in Charter Schools in Florida
Systemic Education Evaluation
Shoestring Evaluation
Tackling the Wider Determinants of Health Disparities in England
Efforts to Improve Public Policy and Programs through Data Practice
Understanding the Political Context of "New" Policy Issues
| Unique citing works | 22 |
|---|---|
| Citations per year | 0,96 |
| Citation span | 2003 - 2024 (22) |
| Citation velocity | recent |
| Highly cited | No |
| Citation types | Neutral: 22 |