Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Hard won lessons learned in the evaluation field

Implications for behavioural insights practice

Bibliographic Data

ID9783302
AuthorsJim McDavid, J Bradley McDavid (corresponding author), Kathryn Henderson (0000-0001-8857-9317)
Year2021
Volume64
Issue1
Pages7-25
Publication date2021-03-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueCanadian Public Administration (JOURNAL)
Journal identifiersISSN: 0008-4840 • E-ISSN: 1754-7121
PublisherWiley (PUBLISHER • GB)
DOI10.1111/capa.12401
OpenAlexW3128396000
LanguageEN
Citations received2
References cited78

This article explores parallels between the recent emergence of Behavioural Insights (BI) as an applied public policy‐related field and the first years of the evaluation field (dating back to the 1960s). We identify four developments in the evaluation field and implications relevant for BI. We then identify three challenges that lie ahead for BI, with the most significant involving professionalizing BI practice. We identify several advantages to professionalization, one being an improved capacity to speak truth to power. The evaluation field, globally, is exploring steps to professionalize practice, but given the continued emergence of competing approaches, in theory and practice, it is an open question whether professionalization can be successful. Understanding challenges in the evaluation field can inform BI efforts to professionalize as a regular contributor to government assessment and improvement of policies and programs

Engineering ethics · Field (mathematics · Government (linguistics · Parallels · Political science · Power (physics · Professionalization · Public relations · Social science · Sociology · Engineering · Evaluation and Performance Assessment · Health Policy Implementation Science · Psychology · Public Policy and Administration Research

  • Enduring Themes in John Mayne’s Work

    Jim McDavid, J Bradley McDavid•Canadian Journal of Program…•2023

  • Behavioural Insights and Public Policy in Canada

    Open Access•Vincent Hopkins, Andrea Lawlor•Canadian Journal of Political…•2023

  • The Art and Craft of Policy Analysis

    Open Access•Aaron Wildavsky•Art and Craft of Policy Analysis•1979

  • The System of Professions

    Andrew Abbott•System of Professions•1988

  • Nudge and the Manipulation of Choice

    Open Access•Pelle Guldborg Hansen, Andreas Maaløe Jespersen•European Journal of Risk Regulation•2013

  • Theory‐based evaluation

    Open Access•CAROL H WEISS•New Directions for Evaluation•1997

  • Defining and describing the paradigm issue in mixed‐method evaluation

    Open Access•Jennifer C Greene, Valerie J Caracelli•New Directions for Evaluation•1997

  • Evaluation practices and effects of indicator use—a literature review

    Sarah De Rijcke, Paul Wouters et al.•Research Evaluation•2016

  • The Economist as Plumber

    Esther Duflo•American Economic Review•2017

  • Reinventing Government

    David Osborne•Public Productivity & Management…•1993

  • Risk, Ambiguity, and the Savage Axioms

    Daniel Ellsberg•The Quarterly Journal of Economics•1961

  • Prospect Theory

    Daniel Kahneman, Amos Tversky•Econometrica•1979

  • Evaluator Competencies and Professionalizing the Field

    Donna Podems•Canadian Journal of Program…•2014

  • Will Evaluation Prosper in the Future

    James C Mcdavid, Irene Huse•Canadian Journal of Program…•2007

  • Using Actor-Based Theories of Change to Conduct Robust Evaluation in Complex Settings

    Andrew Koleros, John Mayne•Canadian Journal of Program…•2019

  • Theory of Change Analysis

    John Mayne•Canadian Journal of Program…•2017

  • Fourth-Generation Evaluation

    Anne Neufeld, Alan Ryan et al.•Canadian Journal of Program…•1988

  • Linking Evaluation and Spending Reviews

    Jim McDavid, J Bradley McDavid et al.•Canadian Journal of Program…•2018

  • What happened to patrol operations in Kansas city? A review of the Kansas city preventive patrol experiment

    Open Access•Richard C Larson•Journal of Criminal Justice•1975

  • Behavioural science and policy

    Open Access•Michael Sanders, Veerle Snijders et al.•Behavioural Public Policy•2018

  • Transformative Paradigm

    Open Access•Donna M Mertens•Journal of Mixed Methods Research•2007

  • The logic of evaluation professionalism

    Open Access•Robert Picciotto•Evaluation•2011

  • Democratic evaluation for the 21st century

    Open Access•Robert Picciotto•Evaluation•2015

  • Some reflections on Pawson’s Science of Evaluation

    Open Access•Brad Astbury•Evaluation•2013

  • A Contribution to Current Debates in Impact Evaluation

    Open Access•Howard White•Evaluation•2010

  • Contribution analysis

    Open Access•John Mayne•Evaluation•2012

  • The institutionalization of evaluation matters

    Open Access•Steve Jacob, Sandra Speer et al.•Evaluation•2015

  • Experimentalism and development evaluation

    Open Access•Robert Picciotto•Evaluation•2012

  • Does evaluation contribute to the public good

    Open Access•Sandra Mathison•Evaluation•2018

  • From mechanism to virtue

    Open Access•Mark Kosters, Jeroen Van Der Heijden•Evaluation•2015

  • Reported Influence of Evaluation Data on Decision Makers’ Actions

    Open Access•Christina A Christie•American Journal of Evaluation•2007

  • Advancing Evaluation Practice With Serious Games

    Open Access•Karol Olejniczak, Kathryn E Newcomer et al.•American Journal of Evaluation•2020

  • Evaluation Use Theory, Practice, and Future Research

    Open Access•Michael Quinn Patton•American Journal of Evaluation•2020

  • Balancing Evaluation Theory and Practice in the Real World

    Open Access•Eleanor Chelimsky•American Journal of Evaluation•2013

  • Research on Evaluation Use

    Open Access•Kelli Johnson, Lija O Greenseid et al.•American Journal of Evaluation•2009

  • AEA Members’ Opinions Concerning Evaluator Certification

    Open Access•S Christopher Jones, Blaine R Worthen•American Journal of Evaluation•1999

  • The Centrality of Use

    Open Access•Jean A King, Marvin C Alkin•American Journal of Evaluation•2018

  • Transformative Considerations

    Open Access•Donna M Mertens•American Journal of Evaluation•2007

  • The Manitoba Basic Annual Income Experiment

    Wayne Simpson, Greg Mason et al.•Canadian Public Policy•2017

  • Behavioural insight and the labour market

    Open Access•Michael Sanders, Guglielmo Briscese et al.•Journal of Public Policy•2021

  • Determining What We Stand for Will Guide What We Do

    Leda M Pérez, Henrie M Treadwell•American Journal of Public Health•2009

  • Four Pragmatists

    James Gouinlock, Israel Scheffler•Philosophy and Phenomenological…•1976

  • Closing Down the Conversation

    John K Smith, Lous Heshusius•Educational Researcher•1986

  • Against the Quantitative-Qualitative Incompatibility Thesis or Dogmas Die Hard

    Kenneth R Howe•Educational Researcher•1988

  • A Clash of Cultures

    Open Access•Eleanor Chelimsky•American Journal of Evaluation•2008

  • Naturalistic inquiry

    Open Access•Yvonna S Lincoln, Egon G Guba et al.•International Journal of…•1985

  • Behavioural insights teams in practice

    Open Access•Sarah Ball, Bessie Head et al.•Policy & Politics•2021

  • From evaluation to auditing and from programs to institutions

    Open Access•B Guy Peters, J Pierre•Governance•2020

  • Anomalies

    Open Access•G Loewenstein, Richard H Thaler•The Journal of Economic…•1989

  • Scientific-Based Research and Randomized Controlled Trials, the "Gold" Standard? Alternative Paradigms and Mixed Methodologies

    Open Access•Thomas W Christ, Thomas Christ•Qualitative Inquiry•2014

  • Moments, Mixed Methods, and Paradigm Dialogs

    Open Access•Norman K Denzin•Qualitative Inquiry•2010

Unique citing works2
Citations per year0,67
Citation span2023 - 2023 (1)
Citation velocityhistorical
Highly citedNo
Citation typesNeutral: 2

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae