Research on Evaluation Use
A Review of the Empirical Literature From 1986 to 2005
Bibliographic Data
| ID | 12470935 |
|---|---|
| Authors | Kelli Johnson (0000-0002-9128-4672, University of Minnesota, corresponding author), Lija O Greenseid (University of Minnesota), Stacie A Toal (University of Minnesota), Jean A King (0000-0003-0061-0872, University of Minnesota), Frances Lawrenz (0000-0002-6317-7992, University of Minnesota), Boris B Volkov (0000-0002-5412-3028, University of North Dakota), Boris Volkov (University of North Dakota) |
| Year | 2009 |
| Volume | 30 |
| Issue | 3 |
| Pages | 377-410 |
| Publication date | 2009-08-05 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | American Journal of Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1098-2140 • E-ISSN: 1557-0878 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1098214009341660 |
| OpenAlex | W2097751135 |
| Language | EN |
| Citations received | 95 |
| References cited | 34 |
This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood’s 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The Cousins and Leithwood framework allowed a comparison over time. After initially grouping these studies according to Cousins and Leithwood’s two categories and twelve characteristics, one additional category and one new characteristic were added to their framework. The new category is stakeholder involvement, and the new characteristic is evaluator competence (under the category of evaluation implementation). Findings point to the importance of stakeholder involvement in facilitating evaluation use and suggest that engagement, interaction, and communication between evaluation clients and evaluators is critical to the meaningful use of evaluations
Competence (human resources · Empirical research · Evaluation methods · Management science · Political science · Program evaluation · Public relations · Quality (philosophy · Stakeholder · Statistics · Computer Science · Educational Assessment and Improvement · Evaluation and Performance Assessment · Mathematics · Psychology · Public Policy and Administration Research · Social Psychology
Controlling or blaming? How members of parliament use performance audit reports
Policy Evaluation in Europe
Os muitos usos da avaliação do Sinaes
Explaining use and non-use of policy evaluations in a mature evaluation setting
Assessing the impact of evaluations of crisis management efforts
Educational evaluation research in Asia
Supporting Use of Data and Evidence from Early Warning Indicator Systems in Research–Practice Partnerships
Terms of whose reference? Commissioning, power, and the distribution of evaluative learning in development
Does evaluation quality matter? Quantitative analysis of the use of evaluation findings in the field of cohesion policy in Poland
Evaluating school inspection effectiveness
“Your career will be over”—Power and contradictions in the work of educational evaluators
Using data on school strengths and weaknesses for school improvement
Time to participate
Use and impact of external evaluation feedback in schools
Using knowledge translation to support the use of evaluation findings
Student course evaluation documents
Reflections on the Intersections Between Collaboration and Use in Evaluation Practice
The Centrality of Use
Heterogeneous Roles and Heterogeneous Practices
Toward the Development of Reporting Standards for Evaluations
Evaluation Use and Factors Affecting Evaluation Use in the Context of the Brazilian Graduate Evaluation System
Including Diverse Stakeholder Voices in Youth Character Program Evaluation
The Politics and Consequences of Including Stakeholders in International Development Evaluation
A Protocol for Participatory Data Use
Definitions of Evaluation Use and Misuse, Evaluation Influence, and Factors Affecting Use
Motivation to Adopt Evaluation Practice as a Determinant of Evaluation Use
Introducing Evidence-Based Principles to Guide Collaborative Approaches to Evaluation
The “Process” of Process Use
Evaluation
Cohesion through co-optation
Towards Program Evaluation for Practitioner Learning
Toward More “Evidence‐Informed” Policy Making
Evaluation use and learning in public policy
Evidence for policy-makers
A New Framework for Monitoring and Evaluating Health Impact Assessment
Taking What Action for Change? Dare Evaluation Build a New Social Order
A Professional Grounding and History of the Development and Formal Use of Evaluator Competencies
Factors influencing the impact of ex-post legislative evaluations
Understanding evaluation use from an organisational perspective
Evaluability Assessments
Exploring Use and Influence in Culturally Responsive Approaches to Evaluation
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Citizens and Evaluation
Mapping Evaluation Use
Developing and testing a theory of change for Boy Scouts of America
A Case Study on the Utility of Sustained Evaluation Practice in Public Health Partnership
Benefit-Cost Analysis in the States
Personality and knowledge mobilisation
Does evaluation quality enhance evaluation use
A framework for Made in Africa Evaluation and influence of the African Peer Review Mechanism on policy outcomes
Using systematic review methods within a Ph.D. dissertation in political science
The real functions of evaluation and response systems
The constitutive effects of evaluation systems
Worlds apart or coproduction? Investigating the relationship between knowledge users and producers
Evaluation units as knowledge brokers
Organisational factors in evaluation use
The power and dysfunctions of evaluation systems in international organizations
An examination of evaluation users’ preferences for program- and actor-oriented theories of change
Evaluation use in evaluation systems – the case of the European Commission
The use and usability of evaluation outputs
Evaluation use in the organizational context – changing focus to improve theory
Using environmental evaluation systems and their contribution to sustainable development
Rethinking rigour to embrace complexity in peacebuilding evaluation
Choosing a qualitative comparative analysis solution in multi-method impact evaluation
Evaluación de Programas Públicos de Gobernanza Colaborativa
Using Large-Scale Databases in Evaluation
The State of the Empirical Research Literature on Stakeholder Involvement in Program Evaluation
You Get the Great Feeling That You’re Being Heard But in the End You Realize That Things Will Be Done Differently and in Others’ Favor”
Expectations to Change” (E2C)
A Decade of Research on Evaluation
The Game of Knowledge Brokering
Understanding Evaluation Influence Within Public Sector Partnerships
Evaluation of Natural Resource Interventions
What Do We Know About the Demand for Evaluation? Insights From the Parliamentary Arena
Capturing the Added Value of Participatory Evaluation
In Need of an Attitude Adjustment? The Role of Data Visualization in Attitude Change and Evaluation Influence
Does Research on Evaluation Matter? Findings From a Survey of American Evaluation Association Members and Prominent Evaluation Theorists and Scholars
Exploring the Necessary Conditions for Evaluation Use in Program Change
Good Evaluation Measures
L’utilisation paradoxale des rapports d’évaluation de politiques publiques
Evaluating social policies
Ex post legislative evaluation in the European Union
A developing context
Hard won lessons learned in the evaluation field
L'élaboration et la mise en œuvre des recommandations issues d'évaluations de programmes au gouvernement du Canada
Evaluating the evaluators
Learning at the Boundaries of Research and Practice
The (non-)use of ex post legislative evaluations by the European Commission
How Do Municipal Policy- and Decision-Makers Evaluate the Impact of Their Policies? Insights from the City of Regina in Saskatchewan, Canada
Self-Selection and Misreporting in Legislative Surveys
Evidenz und Expertise im vorparlamentarischen Gesetzgebungsprozess
The Multiple Purposes of Policy Piloting and Their Consequences
A clash of values
Usos e influência da avaliação em saúde em dois estudos sobre o Programa Nacional de Controle da Dengue
O uso de uma avaliação por gestores da atenção primária em saúde
Research On the Utilization of Evaluations
Current Empirical Research on Evaluation Utilization
Reconceptualizing evaluation use
Utilization-focused evaluation
Factors influencing the decision-making process
Unbundling evaluation use
Consequences of researcher involvement in participatory evaluation
Fourth-Generation Evaluation
The Mechanisms and Outcomes of Evaluation Influence
Reported Influence of Evaluation Data on Decision Makers’ Actions
Beyond Use
An Alternate Route to Policy Influence
Knowledge Utilization in Evaluation Efforts
The role of evaluation information in legislative decision making
| Unique citing works | 95 |
|---|---|
| Citations per year | 5,94 |
| Citation span | 2010 - 2026 (17) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 95 |