Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Evaluating social policies

Do methodological approaches determine the policy impact

Bibliographic Data

ID11197833
AuthorsØyunn Syrstad Høydal (0000-0002-0406-3645, Oslo Business School, Faculty of Social Sciences OsloMet – Oslo Metropolitan University Oslo Norway, corresponding author), Anne Grete Tøge (0000-0001-9905-951X, Oslo Business School, Faculty of Social Sciences OsloMet – Oslo Metropolitan University Oslo Norway)
Year2021
Volume55
Issue5
Pages954-967
Publication date2021-09-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSocial Policy and Administration (JOURNAL)
Journal identifiersISSN: 0144-5596 • E-ISSN: 1467-9515
PublisherWiley (PUBLISHER • GB)
DOI10.1111/spol.12682
OpenAlexW3119362233
LanguageEN
Citations received5
References cited45

Over the last decades, evidence‐based public policy has emerged as a concept and field of research, presenting methodological approaches from the natural sciences as the ideal. However, empirical and interdisciplinary research on the relationship between methodological approaches and policy impact remains scarce. The aim is to investigate whether the impact of evaluations on development of new ideas and policies depends on methodological approaches. Data are drawn from a survey among policy‐makers ( n = 222) in six Norwegian agencies. Applying linear regression models, we analyse whether ‘evaluations provide new ideas and perspectives’ and if ‘evaluations play a major role as a foundation for policy‐making’, and if these aspects depend on the reason for conducting the evaluation and the type of data collection. The civil servants report strong belief in evaluations' impact on policy and development of new ideas; however, this is more or less independent of type of methodological approaches. Exceptions are evaluation using observational data, interviews, or case studies and evaluations conducted with the intention of obtaining new knowledge. The article brings new empirical knowledge regarding the way different methodological approaches contribute to the usefulness of evaluations. Supporting the criticism of a rigid understanding of the meaning of evidence

Criticism · Economics · Empirical research · Epistemology · Field (mathematics · Foundation (evidence · Management science · Meaning (existential · Norwegian · Political science · Positive economics · Public policy · Sociology · Evaluation and Performance Assessment · Health Policy Implementation Science · Law · Psychology · Public Policy and Administration Research

  • Evaluation of Social Interventions with People with Disabilities

    Open Access•Marta Mira-Aladrén, Javier Martín-Peña et al.•Social Work Research•2024

  • Implementing individual placement and support in Norway. From vocational rehabilitation to an employment scheme

    Open Access•Cathrine Moe, Beate Brinchmann et al.•Social Policy and Administration•2023

  • The differential impact of evidence types in policy decisions

    Open Access•Jonas Videbæk Jørgensen•Policy Studies•2025

  • Policy capacity

    Open Access•Scott Brenton, Erik Baekkeskov et al.•Policy Studies•2023

  • Why do some academic articles receive more citations from policy communities

    Open Access•Ji Ma, Yuan Cheng•Public Administration Review•2024

  • Evaluation

    Howard E Freeman, Mark W Lipsey et al.•Evaluation•1993

  • Policy Evaluation in Europe

    Open Access•Valérie Pattyn, Stijn Van Voorst et al.•The Palgrave Handbook of Public…•2018

  • Using evidence

    Sandra Nutley, Sandra M Nutley et al.•Using Evidence•2007

  • What works?Evidence-based policy and practice in public services

    Huw T O Davies, Huw Davies et al.•What works?Evidence-based policy…•2000

  • Regression with Dummy Variables

    Melissa Hardy, Melissa A Hardy•Regression with Dummy Variables•1993

  • The Myth of Research-Based Policy & Practice

    M Hammersley•The Myth of Research-Based Policy…•2013

  • What Works?

    Open Access•Ron Amann, Peter Smith et al.•What Works?•2000

  • Fixed Effects Regression Models

    P D Allison, Paul Allison•Fixed Effects Regression Models•2009

  • Beyond Evidence-Based Policy in Public Health

    Open Access•Katherine E Smith, Katherine Smith•Beyond Evidence Based Policy in…•2013

  • Health policy-makers' perceptions of their use of evidence

    Open Access•Simon Innvær, Gunn Elisabeth Vist et al.•Journal of Health Services…•2002

  • A systematic review of barriers to and facilitators of the use of evidence by policymakers

    Open Access•Kathryn Oliver, Simon Innvar et al.•BMC Health Services Research•2014

  • Current Empirical Research on Evaluation Utilization

    Open Access•J Bradley Cousins, Kenneth A Leithwood et al.•Review of Educational Research•1986

  • Reconceptualizing evaluation use

    Open Access•Karen E Kirkhart•New Directions for Evaluation•2000

  • What Constitutes “Good” Evidence for Public Health and Social Policy-making? From Hierarchies to Appropriateness

    Open Access•Justin O Parkhurst, Justin Parkhurst et al.•Social Epistemology•2016

  • The Political Uses of Expert Knowledge

    Open Access•Christina Boswell•Political Uses of Expert Knowledge•2009

  • A Very Short, Fairly Interesting and Reasonably Cheap Book aboutQualitative Research

    David J Silverman, David Silverman•Very Short, Fairly Interesting…•2013

  • Social Science and the Evidence-based Policy Movement

    Open Access•Ken Young, Deborah Ashby et al.•Social Policy and Society•2002

  • An evaluation paradox in social work? An empirical study of evaluation use in connection with temporary programmes in Swedish social work

    Anna Petersén, Jan Olsson et al.•European Journal of Social Work•2013

  • Evaluation use in evaluation systems – the case of the European Commission

    Open Access•Steven Højlund•Evaluation•2014

  • Four Waves of Evaluation Diffusion

    Open Access•EVERT VEDUNG•Evaluation•2010

  • Evidence producing organizations

    Open Access•Kari‐tove Elvbakken, Kari Tove Elvbakken et al.•Evaluation•2018

  • Discovering Process Use

    Open Access•Michael Quinn Patton•Evaluation•1998

  • Evaluation models and evaluation use

    Open Access•Damien Contandriopoulos, Astrid Brousselle•Evaluation•2012

  • Building Evidence in Challenging Contexts

    Open Access•Nicole M Deterding, Anna R Solmeyer•American Journal of Evaluation•2017

  • Have We Learned Anything New About the Use of Evaluation

    Open Access•CAROL H WEISS•American Journal of Evaluation•1998

  • Beyond Use

    Open Access•Gary T Henry, Melvin M Mark•American Journal of Evaluation•2003

  • Research on Evaluation Use

    Open Access•Kelli Johnson, Lija O Greenseid et al.•American Journal of Evaluation•2009

  • The Threshold and Inclusive Approaches to Determining “Best Available Evidence”

    Open Access•J Stockard, Timothy W Wood•American Journal of Evaluation•2016

  • The Troubled Families Programme

    Open Access•Sadie Parr, Harriet Churchill•Social Policy and Administration•2020

  • Evidence for public health policy on inequalities

    Mark Petticrew, Margaret Whitehead et al.•Journal of Epidemiology and…•2004

  • The political use of knowledge in the policy process

    Open Access•Falk Daviter•Policy Sciences•2015

  • Technocracy Reinvented

    Open Access•Emma Clarence•Public Policy and Administration•2002

  • Policy Practitioners' Accounts of Evidence-Based Policy Making

    Open Access•Mark Monaghan, Jo Ingold•Journal of Social Policy•2019

  • Social Insurance as Fiscal Policy and State-Building Tool

    Open Access•Daniel Béland, Michal Koreh•Journal of Social Policy•2019

Unique citing works5
Citations per year1,67
Citation span2023 - 2025 (3)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 5

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae