Evaluating unintended consequences
New insights into solving practical, ethical and political challenges of evaluation
Bibliographic Data
| ID | 12567965 |
|---|---|
| Authors | Kathryn Oliver (0000-0002-4326-5258, London School of Hygiene & Tropical Medicine, corresponding author), Theo Lorenc (0000-0001-8937-6378, University of York), Jane Tinkler (The Nine Dots Prize, UK) |
| Year | 2019 |
| Volume | 26 |
| Issue | 1 |
| Pages | 61-75 |
| Publication date | 2019-06-10 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1356-3890 • E-ISSN: 1461-7153 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1356389019850847 |
| OpenAlex | W2950129335 |
| Language | EN |
| Citations received | 22 |
| References cited | 42 |
Evaluating complex interventions and policies is challenging. This is particularly true for the identification of unintended consequences, whether negative or positive. This article uses data from a workshop with policymakers and evaluators to explore the evaluation of unintended consequences. We identify three main challenges for policymakers and evaluators: being able to identify and evaluate unintended effects, to avoid creating unintended effects and being able to explain these effects. We discuss practical, political and ethical issues for each of these challenges and identify recommendations for evaluators who want to consider unintended consequences. First, use a broader range of methods to explore how policies play out; second, use theory to plan evaluations; and third, discuss both methods and theory with relevant stakeholders to make these as useful as possible. We offer novel insights into recent debates about theory-led and co-produced interventions and policies
Economics · Engineering ethics · Identification (biology · Management science · Political science · Politics · Positive economics · Psychological intervention · Public economics · Public relations · Unintended consequences · Community Health and Development · Engineering · Evaluation and Performance Assessment · Health Policy Implementation Science · Law · Psychology
Reducing alcohol harms whilst minimising impact on hospitality businesses
Condições para avaliação de resultados em políticas públicas
Conditions for outcomes evaluation in public policies
Trust in healthcare
What Mental Health and Wellbeing Interventions Work for Which Children and Young People in Care? Systematic Review of Potential Outcome Inequities
The manifestations of politics in evaluation
Community-Based Crime Prevention Programs and Central American Migration
Community engagement to support public health
Progress and pitfalls when evaluating the unintended effects of public policy
Improving a framework for evaluating participatory science
Creating With , Not For People
Unintended effects of private tutoring restrictions on property prices in high-quality school districts
Policy shifts and drifts
An evaluation case study of village-based relational community engagement activities in Lao PDR
Collateral benefits from a school‐readiness intervention on breastfeeding
The use of technology to address loneliness and social isolation among older adults
Understanding the unintended consequences of public health policies
Does evaluation quality enhance evaluation use
Lessening the unknown
Unintended Consequences
Locked up While Locked Down
Local Alien Enfranchisement and External Efficacy Perceptions
Complexity Theory and the Social Sciences
Lessons from Complex Interventions to Improve Health
The need for a complex systems model of evidence for public health
What Constitutes “Good” Evidence for Public Health and Social Policy-making? From Hierarchies to Appropriateness
How do we collaborate? Social science researchers’ experience of multidisciplinarity in biomedical settings
What theory, for whom and in which context? Reflections on the application of theory in the development and evaluation of complex population health interventions
The Realist Foundations of Evidence-Based Medicine
Acting together in determining value
The politics of evaluation and the evaluation of politics
Policy experiments
Evaluation in Complex Policy Systems
Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions
The politics of performance measurement
Theories of Change and Realistic Evaluation
Strengthening the ethical expertise of evaluators
Have We Learned Anything New About the Use of Evaluation
Invisible Mechanisms
Adverse effects of public health interventions
Dark logic’
From Public Administration to Public Management
What’s Measured Is What Matters
Evaluation, Policy Learning and Evidence-Based Policy Making
The Unanticipated Consequences of Purposive Social Action
What are the components of complex interventions in healthcare? Theorizing approaches to parts, powers and the whole intervention
Realist randomised controlled trials
Possibilism
Minimal, negligible and negligent interventions
Comprehensive Planning and Coordination
Promoting Social Change
Unintended but not unanticipated consequences
| Unique citing works | 22 |
|---|---|
| Citations per year | 3,14 |
| Citation span | 2019 - 2026 (8) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 21 |