Evaluating the evidence – a move to more Realistic Evaluation
A case study of Regional Selective Assistance in Scotland
Bibliographic Data
| ID | 12567804 |
|---|---|
| Authors | Keith Hayton (0000-0003-3051-1242, Directorate of Strategy and Economics, Scottish Enterprise, UK, corresponding author) |
| Year | 2015 |
| Volume | 21 |
| Issue | 2 |
| Pages | 248-262 |
| Publication date | 2015-04-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1356-3890 • E-ISSN: 1461-7153 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1356389015577466 |
| OpenAlex | W2324630986 |
| Language | EN |
| Citations received | 1 |
| References cited | 4 |
This article considers how evaluation practice can improve so that the support offered to decision makers is a better reflection of the reality being evaluated. The article examines a number of evaluations of the same intervention, Regional Selective Assistance administered by Scottish Enterprise, one of Scotland’s two public sector economic development agencies. The assumptions underpinning the evaluations have changed over time. The earlier ones assumed that it was possible to evaluate the intervention in isolation: ignoring the factors that Realistic Evaluation highlights as affecting impacts: Context, Mechanisms and the Outcome Configuration. Later evaluations implicitly acknowledged these factors. However, the evaluations produced different results so that, rather than triangulation resulting in a degree of consensus, policy makers were presented with different views as to the effectiveness of the same intervention. The conclusion is that both evaluators and policy makers need to explicitly accept the Realistic Evaluation agenda and realize that causality is far more complicated than is often assumed. This would be aided if there was more transparency in evaluation methodologies and the use of different approaches to evaluate the same intervention so that any findings were triangulated
Causality (physics · Context (archaeology · Economic evaluation · Economics · Impact evaluation · Intervention (counseling · Isolation (microbiology · Management science · Microeconomics · Outcome (game theory · Political science · Public economics · Public relations · Transparency (behavior · Triangulation · Underpinning · Engineering · Evaluation and Performance Assessment · Law · Medicine · Psychology · Regional Development and Policy · Social Policy and Reform Studies
| Citations per year | 0.2 |
|---|---|
| Citation span | 2021 - 2021 (1) |
| Highly cited | No |