Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Why Aren’t Evaluations Working and What to Do About It

A Framework for Negotiating Meaningful Evaluation in Nonprofits

Bibliographic Data

ID12471304
AuthorsKellie Liket (Erasmus University Rotterdam, corresponding author), Kellie C Liket (Erasmus Centre for Strategic Philanthropy, Erasmus University, Rotterdam, Netherlands), Marta Rey-Garcia (Universidade da Coruña), Marta Rey‐garcía (0000-0002-9453-8551, Universidade da Coruña), Karen Maas (Erasmus University Rotterdam), Karen E H Maas (Erasmus School of Economics, Erasmus University Rotterdam)
Year2014
Volume35
Issue2
Pages171-188
Publication date2014-03-18
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueAmerican Journal of Evaluation (JOURNAL)
Journal identifiersISSN: 1098-2140 • E-ISSN: 1557-0878
PublisherSAGE Publishing (PUBLISHER • US)
DOI10.1177/1098214013517736
OpenAlexW2107614605
LanguageEN
Citations received32
References cited50

Nonprofit organizations are under great pressure to use evaluations to show that their programs “work” and that they are “effective.” However, empirical evidence indicates that nonprofits struggle to perform useful evaluations, especially when conducted under accountability pressures. An increasing body of evidence highlights the crucial role of a participatory negotiation process between nonprofits and stakeholders on the purpose and design of evaluations in achieving evaluation utility. However, conceptual confusion about the evaluation objectives, unclear evaluation purposes, a lack of appropriate evaluation questions, and normative ideas about superior evaluation designs and methods, complicate the process. In response, we provide practical conceptualizations of the central objectives of evaluations and propose a framework that can guide negotiation processes. It presents the relationships between the evaluation purpose, evaluation question, and the different levels of effects that should be measured. The selection of the evaluation method is contingent on the choices made within this framework

Accountability · Business · Conceptual framework · Confusion · Economics · Evaluation methods · Knowledge management · Management science · Negotiation · Normative · Participatory evaluation · Political science · Process (computing · Process management · Selection (genetic algorithm · Sociology · Work (physics · Computer Science · Evaluation and Performance Assessment · Nonprofit Sector and Volunteering · Psychology · Public Administration · Public Policy and Administration Research

  • Capturing Collaborative Challenges

    Open Access•Rob Van Tulder, Nienke Keen•Journal of Business Ethics•2018

  • Developing a vulnerability-based conceptual model for managing risk in non-profit projects

    Márcia R C Santos, Raul Laureano•Public Management Review•2023

  • Enhancing the effects of university education for sustainable development on social sustainability

    Open Access•Marta Rey-Garcia, Marta Rey‐garcía et al.•International Journal of…•2020

  • Building Legitimacy and Learning Lessons

    Open Access•Marjelle Vermeulen, Karen Maas•The Journal of Arts Management…•2021

  • Diversifying the Pipeline of Social Work Students Prepared to Implement Performance Measurement

    Karen Hopkins, Megan Meyer et al.•Journal of Social Work Education•2022

  • Uncovering the impact of food sharing platform business models

    Open Access•Laura Michelini, Cecilia Grieco et al.•British Food Journal•2020

  • Siames

    Open Access•Daniel Hernandez Marin, Marta Solórzano García et al.•IEEE Technology and Society…•2021

  • Identifying the merits of bottom-up urban development

    Open Access•Jeroen Mens, Ellen Van Bueren et al.•Planning Practice and Research•2023

  • The Centrality of Use

    Open Access•Jean A King, Marvin C Alkin•American Journal of Evaluation•2018

  • Evaluation Capacity Building Through Community-University Partnership

    Open Access•Sarah V Suiter, Kathryn Y Morgan et al.•American Journal of Evaluation•2024

  • Evaluation Policy in a Nonprofit Foundation

    Open Access•Lisa M Dillman, Christina A Christie•American Journal of Evaluation•2016

  • Indicators of buy-in to gauge evaluation success

    Open Access•K Becker, Karin L Becker et al.•Evaluation Journal of Australasia•2015

  • The Capacity Development Evaluation Framework

    Open Access•Fiona Kotvojs•Evaluation Journal of Australasia•2017

  • Comprehensive Ingo Accountability to Strengthen Perceived Program Effectiveness

    Open Access•Alice Hengevoss•Voluntas Revista Internacional de…•2023

  • Data driven social partnerships

    Open Access•Iryna Susha, Åke Grönlund et al.•Government Information Quarterly•2018

  • Constructing Accountability

    Maoz Brown•Social Service Review•2019

  • Supporting health promotion practitioners to undertake evaluation for program development

    Open Access•Roanna Lobo, Mark Petrich et al.•BMC Public Health•2014

  • Examining Youth Sector Stakeholders’ Experiences in an Online Program Evaluation Certificate

    Corliss Bean, Caroline Hummell et al.•Canadian Journal of Program…•2023

  • Mapping Evaluation Use

    Open Access•Michelle Searle, Amanda Cooper et al.•American Journal of Evaluation•2024

  • A Systematic Review of Meta-Evaluations

    Open Access•Joanne Xiaolei Qian, Kiros Hiruy et al.•American Journal of Evaluation•2022

  • Policy Brief

    Open Access•Katherine R Cooper, Michelle Shumate•Nonprofit Policy Forum•2015

  • Instrumental Philanthropy, Nonprofit Theory, and Information Costs

    Open Access•Glenford E Mitchell, Thad D Calabrese•Nonprofit Policy Forum•2020

  • Training and capacity development

    L M Richter, Julia Louw et al.•Vulnerable Children and Youth…•2015

  • A Co-Learning Model for Community-Engaged Program Evaluation

    Sarah V Suiter, Amie Thurber et al.•Progress in community health…•2016

  • Negotiating effectiveness in transnational advocacy evaluation

    Open Access•Bodille Arensman, Margit Van Wessel•Evaluation•2017

  • Social entrepreneurship and social innovation

    Francisco do Adro, Cristina I Fernandes•Innovation The European Journal…•2021

  • Complicity Revisited

    Open Access•Keith M Sturges, Keith Sturges•American Journal of Evaluation•2015

  • Data and Decision Making

    Open Access•Nan L Maxwell, Dana Rotz et al.•American Journal of Evaluation•2016

  • Analysis of Evaluation Policies in the Philanthropic Sector

    Open Access•Alana R Kinarsky, Christina A Christie•American Journal of Evaluation•2021

  • Life beyond Refuge

    Open Access•R Janzen, Mischa Taylor et al.•Refuge Canada s Journal on Refuge•2022

  • Social Innovation Impacts and Their Assessment

    Open Access•Marina Novikova•Social Sciences•2022

  • Implementation and Impact of Results-Based Accountability Learning

    Open Access•Karen Hopkins, Megan Meyer et al.•Race and Justice•2019

  • Measuring Corporate Social Performance

    Open Access•Donna J Wood•International Journal of…•2010

  • Current Empirical Research on Evaluation Utilization

    Open Access•J Bradley Cousins, Kenneth A Leithwood et al.•Review of Educational Research•1986

  • Strategic Performance Measurement and Management in Nonprofit Organizations

    Open Access•Robert S Kaplan•Nonprofit Management and Leadership•2001

  • Handbook Of Development Economics

    T Paul Schultz•Handbook Of Development Economics•2008

  • The Nonprofit sector

    Walter W Powell•Choice Reviews Online•2007

  • The Nonprofit Sector

    Walter W Powell, Patricia Bromley•Nonprofit Sector•2020

  • Fourth-Generation Evaluation

    Anne Neufeld, Alan Ryan et al.•Canadian Journal of Program…•1988

  • The Impact of Microfinance in Sub-Saharan Africa

    Open Access•C Van Rooyen, R Stewart et al.•World Development•2012

  • A Contribution to Current Debates in Impact Evaluation

    Open Access•Howard White•Evaluation•2010

  • What Doesn’t Work? Three Failures, Many Answers

    Open Access•Nicoletta Stame•Evaluation•2010

  • Experimentalism and development evaluation

    Open Access•Robert Picciotto•Evaluation•2012

  • The mixing of methods

    Open Access•Giel Ton•Evaluation•2012

  • Evaluation, Knowledge Management, Best Practices, and High Quality Lessons Learned

    Open Access•Michael Quinn Patton•American Journal of Evaluation•2001

  • Evaluation Practice Among Community-Based Organizations

    Open Access•Joanne G Carman•American Journal of Evaluation•2007

  • Developmental Impact Evaluation for Facilitating Learning in Innovation Networks

    Open Access•Eveliina Saari, Katri Kallio•American Journal of Evaluation•2010

  • Negotiating Measurement

    Open Access•Marc T Braverman•American Journal of Evaluation•2013

  • Evaluability Assessment From 1986 to 2006

    Open Access•Michael S Trevisan•American Journal of Evaluation•2007

  • An Assessment of Evaluation Designs

    Open Access•Embry M Howell, Embry Howell et al.•American Journal of Evaluation•2006

  • Evaluation, knowledge management, best practices, and high quality lessons learned

    Open Access•Michael J Patton, M Patton•American Journal of Evaluation•2001

  • Evaluation Capacity and Nonprofit Organizations

    Open Access•Joanne G Carman, Kimberly A Fredericks•American Journal of Evaluation•2009

  • Mainstreaming Microfinance

    Open Access•James Copestake•World Development•2007

  • Why Measure Performance? Different Purposes Require Different Measures

    Open Access•Robert D Behn•Public Administration Review•2003

  • Toward a Platinum Standard for Evidence‐Based Assessment by 2020

    Open Access•Sanjeev Khagram, Craig W Thomas•Public Administration Review•2010

  • Drowning in Data

    Open Access•Janice M Morse•Qualitative Health Research•1993

Unique citing works32
Citations per year2,67
Citation span2014 - 2024 (11)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 32
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae