Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Going Beyond Mixed Methods to Mixed Approaches

A Systems Perspective for Asking the Right Questions

Bibliographic Data

ID11471069
AuthorsJeneen R Garcia (Evaluation Officer at the Global Environment Facility Independent Evaluation Office (GEF IEO).), Aaron Zazueta (Chief Evaluation Officer at the Global Environment Facility Independent Evaluation Office (GEF IEO) where he leads a team that has developed approaches to evaluate impact in complex global processes.), Aaron E Zazueta (0000-0003-4618-8275, Global Environment Facility)
Year2015
Volume46
Issue1
Pages30-43
Publication date2015-01-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueIDS Bulletin (JOURNAL)
Journal identifiersISSN: 0265-5012 • E-ISSN: 1759-5436
PublisherInstitute of Development Studies (PUBLISHER • GB)
DOI10.1111/1759-5436.12119
OpenAlexW2164692920
LanguageEN
Citations received8
References cited23

An impact evaluation's primary task is to determine which impacts were caused by an intervention, distinguishing them from those produced by other causes. However, in complex systems, interventions may contribute towards less apparent forms of impact (such as negative, unintended, indirect and secondary) that are no less significant, but which require a different way of asking questions. Rather than advocating for a particular evaluation approach or methodology, we propose that (1) beyond the intervention's theory of change (TOC), the complex system within which the intervention has taken place and intends to make an impact must also be examined, and (2) specific elements of an intervention's TOC and the larger system must be understood to have a systematic basis for determining what evaluation questions need to be asked. Only then can the appropriate evaluation approaches and methods be identified, and adapted as this understanding increases over the course of the evaluation

Economics · Impact evaluation · Political science · Psychological intervention · Unintended consequences · Community Health and Development · Complex Systems and Decision Making · Computer Science · Evaluation and Performance Assessment · Law · Medicine · Psychology · Artificial Intelligence

  • Systemic perspectives on scaling agricultural innovations. A review

    Open Access•Seerp Wigboldus, Laurens Klerkx et al.•Agronomy for Sustainable…•2016

  • Using a systems lens in evaluations at the nexus of environment and development

    Open Access•Jeneen R Garcia, Juha I Uitto•Evaluation and Program Planning•2025

  • Policy evaluation for a complex world

    Open Access•Peter Barbrook-Johnson, Pete Barbrook-Johnson et al.•Evaluation•2021

  • How do policy evaluators understand complexity

    Open Access•Peter Barbrook-Johnson, Amy Proctor et al.•Evaluation•2020

  • Reverse Evaluation to Enhance Strategies (Reves)

    Open Access•Laura Tagle, Serafino Celano•Evaluation•2018

  • Program, complexity, and system when evaluating sustainable development

    Open Access•Nicoletta Stame•Evaluation•2022

  • Checking up to keep on track

    Open Access•Linda Kelly, Mary Whiteside et al.•Evaluation Journal of Australasia•2021

  • More prioritisation on food security’ – exploring what initiative leaders envision for a food secure regional Australia

    Open Access•Isabelle Chiera, Jess Doe et al.•Health & Place•2025

  • Theory-based impact evaluation

    Howard White•Journal of Development…•2009

  • Connectivity and the Governance of Multilevel Social-Ecological Systems

    Open Access•E S Brondizio, Elinor Ostrom et al.•Annual Review of Environment and…•2009

  • A General Framework for Analyzing Sustainability of Social-Ecological Systems

    Open Access•Elinor Ostrom, Элинор Остром•Science•2009

  • Beyond Markets and States

    Elinor Ostrom•American Economic Review•2010

  • Understanding the Complexity of Economic, Ecological, and Social Systems

    Open Access•C S Holling•Ecosystems•2001

  • The Tragedy of the Commons

    Open Access•David Feeny, F Berkes et al.•Human Ecology•1990

  • Stakeholder analysis

    Open Access•Ruairı́brugha, R Brugha•Health Policy and Planning•2000

  • Network Governance of the Commons

    Open Access•Lars Gunnar Carlsson, Annica Sandström•International Journal of the…•2007

  • Theories of Change and Realistic Evaluation

    Open Access•Avril Blamey, Margaret Mackenzie•Evaluation•2007

  • The Practice and the Theory

    Open Access•Margaret Mackenzie, Avril Blamey•Evaluation•2005

  • From Community-Based Resource Management to Complex Systems

    Open Access•F Berkes•Conservation Ecology•2006

  • The Problem of Fit between Ecosystems and Institutions

    Open Access•Carl Folke, Lowell Pritchard et al.•Conservation Ecology•2007

  • Scale and Cross-Scale Dynamics

    Open Access•David W Cash, W Neil Adger et al.•Conservation Ecology•2006

  • Managing Change toward Adaptive Water Management through Social Learning

    Open Access•Claudia Pahl-Wostl, Claudia Pahl‐wostl et al.•Conservation Ecology•2007

  • A Framework to Analyze the Robustness of Social-ecological Systems from an Institutional Perspective

    Open Access•John M Anderies, Marco A Janssen et al.•Conservation Ecology•2004

Unique citing works8
Citations per year0,8
Citation span2016 - 2025 (10)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 8

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae