Anticipatory evaluation. How to incorporate an anticipatory technique into a theory-driven evaluation process. Results of application in a case study
Bibliographic Data
| ID | 21457033 |
|---|---|
| Authors | Mariangel Pacheco – Troisi, Mariangel Pacheco-Troisi (National Administration of Power Plants and Electrical Transmissions (Uruguay), corresponding author), Mónica García-Melón, Mónica García‐Melón (0000-0001-8101-4049, Universitat Politècnica de València), Fernando Jiménez‐Sáez (0000-0001-5685-3959, Universitat Politècnica de València), Fernando Jiménez-Sáez |
| Year | 2025 |
| Volume | 108 |
| Pages | 102509 |
| Publication date | 2025-02-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Evaluation and Program Planning (JOURNAL) |
| Journal identifiers | ISSN: 0149-7189 • E-ISSN: 1873-7870 |
| Publisher | Elsevier BV (PUBLISHER) |
| DOI | 10.1016/j.evalprogplan.2024.102509 |
| PMID | 39427607 |
| OpenAlex | W4403468882 |
| Language | EN |
| References cited | 27 |
In recent years, there has been increased focus on strategic learning from impact analysis, including in the field of science, technology, and innovation. In this paper, we propose combining techniques from two fields of study. Firstly, we adopt the approach of addressing impact through productive interactions between science and society, and secondly, we incorporate an anticipatory dimension by integrating game analysis involving key actors. Through a theory-driven evaluation design, we consider expected impacts as promises of the future. Within an anticipatory perspective, the future can be shaped by the interactions among different actors in the present. In this article, we apply this approach step-by-step to a research institute program in Uruguay. We demonstrate how the achieved results offer strategic insights to the program manager for anticipating and attaining the desired impacts. Additionally, we provide summative inputs for accountability using a flexible technique applicable at any stage of the program life cycle. The article concludes with a discussion of the advantages and disadvantages compared to other techniques, along with lessons learned that may benefit other evaluators seeking to replicate this approach. Furthermore, we explore potential extensions and opportunities for further improvement in this research. • This is a contribution to evaluation practice , resulting from the practice and combination of techniques and research findings from two different fields of study . • A novel approach to apply the concept of productive interactions (PI) in combination with an anticipatory technique implemented in the context of a formative evaluation. • PIs between science and society are a central approach to identify future societal impacts. In this paper we show in detail the individual steps of the application of two concepts: PI and the actor’s game. • An approach that facilitates enables strategic learning through impact analysis, focusing on the connection of the programme with the environment. • Anticipatory evaluation is applicable in a theory-driven evaluation design and offers strategic perspective to project managers and planners
Business · Management science · Process (computing) · Process management · Risk analysis (engineering) · Complex Systems and Decision Making · Computer Science · Engineering · Evaluation and Performance Assessment · Innovative Education and Learning Practices · Psychology
Progressing research impact assessment
Evaluation practices and effects of indicator use—a literature review
Introducing 'productive interactions' in social impact assessment
The connection between personnel evaluation and school evaluation
Evaluating Research beyond Scientific ImpactHow to Include Criteria for Productive Interactions and Impact on Practice and Society
Fourth-Generation Evaluation
Are social mechanisms usable and useful in evaluation research
What is Essential in Developmental Evaluation? On Integrity, Fidelity, Adultery, Abstinence, Impotence, Long-Term Commitment, Integrity, and Sensitivity in Implementing Evaluation Models
Real-time technology assessment
Actors' moves and strategies
| Highly cited | No |
|---|