Ralph Renger
Biographic Data
| ID | 4411578 |
|---|---|
| NAME | Ralph Renger |
| GIVEN NAMES | Ralph |
| FAMILY NAME | Renger |
| SIGNATURE | RENGER R |
| AFFILIATIONS | University of Arizona |
| ORCID | 0000-0002-0224-1444 |
| VERIFIED | Yes |
| TOTAL WORKS | 40 |
| TOTAL CITATIONS | 68 |
| AUTHOR COUNT | 40 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 1998 |
| LATEST PUBLICATION YEAR | 2025 |
| H-INDEX | 5 |
Applying the Renger System Test to Determine Whether a System Evaluation Is Fit for Evaluating a Complex Intervention
This article presents the Renger System Test (RST) as a method for assessing whether a system evaluation approach is suitable for evaluating complex interventions. The RST has three criteria: (1) the intervention includes multiple components, (2) these components operate interdependently, and (3) their interdependence produces an outcome that no single component can achieve alone. An NIH-funded case illustrates how to apply the RST to program sou…
From the Section Editors
Four suppositions about emergent properties of complex interventions that operate and function as systems
This article focuses on evaluating the emergent properties of complex interventions that operate and function as systems. After defining key terms, four suppositions of emergence are presented. The suppositions are based on the authors’ reflections on evaluating several complex interventions using a systems approach. Supposition 1 posits that there is an operational emergent property, paralleling the theory-driven evaluation concept of implementa…
A comparative case study illustrating the influence of a system perspective on the outcome evaluation of simple versus complex interventions
When evaluating the effectiveness of an intervention, the evaluation approach must match the intervention complexity, ensuring that the chosen evaluation is “fit for purpose.” For simple interventions, evaluating short-, mid-, and long-term outcomes is appropriate. However, for complex interventions, an additional outcome that must be considered is the essential system property that emerges as a result of the interaction of interdependent interve…
Evaluation Utility Metrics (EUMs) in Reflective Practice
The article proposes three evaluation utility metrics to assist evaluators in evaluating the quality of their evaluation. After an overview of reflective practice in evaluation, the different ways in which evaluators can hold themselves accountable are discussed. It is argued that reflective practice requires evaluators to go beyond evaluation quality (i.e., technical quality and methodological rigor) when assessing evaluation practice to include…
New Insights for Tracking and Reporting Milestones
Despite being a common evaluation metric, milestones are poorly defined, and guidance for their use is underdeveloped in the evaluation literature. This practice note attempts to address this oversight by providing evaluation-specific guidance for tracking and reporting milestones. Using a case study, we share our initial approach to tracking and reporting milestones, as well as how critical reflection guided by the evaluation standards provided …
Lessons learned in evaluating system interdependencies using qualitative methods
This article shares lessons learned while evaluating the system interdependencies for a clinical and translational research centre (CTR). It explores the methodological challenge of discussing system concepts (e.g., cascading failures, feedback loops, and reflex arcs) with layperson participants during evaluation interviews. The article discusses the iterative process of moving from structured interview approaches in favor of an open narrative ap…
Using the Homeland Security Exercise and Evaluation Program (HSEEP) Building Block Approach to Implement System Evaluation Theory (SET)
This article shares lessons learned in applying system evaluation theory (SET) to evaluate a Clinical and Translational Research Center (CTR) funded by the National Institutes of Health. After describing how CTR support cores are intended to work interdependently as a system, the case is made for SET as the best fit for evaluating this evaluand. The article then details how the evaluation was also challenged to facilitate a CTR culture shift, hel…
Comparing and Contrasting a Program versus System Approach to Evaluation
This article examines the differences between approaching an evaluation problem from a program perspective and doing so from a systems perspective. The terms program, systems, systems thinking, and systems concepts are first defined. Then, using an actual evaluation of a cardiac care system, it is shown how initial investments in a program theory approach were deemed inadequate to account for the influence of external factors on patient outcomes.…
Lessons learned in evaluating the infrastructure of a Centre for Translational Research
This paper shares lessons learned while evaluating the implementation of a Clinical and Translational Research Center (CTR). To meet its overarching goals the CTR consists of numerous research support units (e.g., biostats, community engagement, professional development, etc.) that are intended to work together collaboratively. It is then argued that an evaluation approach grounded in system thinking was the best fit to evaluate this key CTR desi…
The connection between logic models and systems thinking concepts
This article examines the relationship between systems thinking concepts and the logic model. Two notable shortcomings of the logic model are illustrated: depicting the program theory linearly and failing to place the program in context. Both issues lead to an artificial depiction of reality making evaluation findings difficult to interpret. Systems thinking concepts are defined and how they address these shortcomings is discussed. This article t…
Reworks
The article reports on the inaugural Australian-American system evaluation summit convened in Wyoming, USA, focusing on the application of system evaluation theory (SET). The think tank noted SET’s efficiency principles and published illustrations are emergency response sector specific and pondered whether efficiency measures could be identified for systems targeting complex social problems. The article describes how the think tank used the conce…
Defining Systems to Evaluate System Efficiency and Effectiveness
This paper focuses on the application of systems thinking, systems theory, and systems evaluation theory (SET) in evaluating modern day systems. SET consists of three steps purposively sequenced with each being a prerequisite for the success of the next step. The first foundational step is to define the system. Systems thinking provides theoretical rationale for defining the system boundaries, components, and relationships. However, there is no l…
Evaluating System Cascading Failures
This article shares methods used to evaluate system cascading failures. A cascading failure occurs when a problem is passed from one subsystem to a downstream subsystem creating a domino effect that undermines system efficiency and effectiveness. First, the basics of system evaluation theory (SET) are reviewed. Then drawing on different examples from the evaluation of emergency response systems the article describes how a) standard operating proc…
Process Flow Mapping for Systems Improvement
This article fills a gap in the evaluation literature by detailing how to conduct process flow mapping: a continuous quality improvement (CQI) method. The importance of process flow mapping and the steps required to complete the method are illustrated in the context of evaluating a cardiac care system. The article discusses several challenges and solutions in conducting process flow mapping, including (a) selecting appropriate subject matter expe…
Suggested Guidelines for Writing Reflective Case Narratives
Reflective case narratives are a practical mechanism for conveying lessons learned for practice improvement. Their ability to transform experience into knowledge in a colloquial, narrative style positions reflective case narratives as a powerful learning tool with pedagogical benefits for the evaluation community. However, one criticism of reflective case narratives is they suffer from loose guidelines and lengthy discussions that obscure lessons…
Illustrating the Evaluation of System Feedback Mechanisms Using System Evaluation Theory (SET)
This article describes how system evaluation theory (SET) guided the evaluation of cardiac care response systems efficiency in seven rural United States. Specifically, the article focuses on the approach and methods used to evaluate system feedback mechanisms; one key factor affecting system efficiency. Mixed methods were applied to evaluate five criteria of system feedback efficiency: frequency, timeliness, credibility, specificity, and relevanc…
System evaluation theory (SET)
This article presents a guiding framework for evaluators to conduct systems evaluation: system evaluation theory (SET). The article firstly defines ‘systems’, ‘system theory’, and ‘system thinking’; it then discusses the confusion in the evaluation literature surrounding the use of these terms (noting their application is primarily in evaluating programs, not evaluating modern day systems). Three guiding principles for evaluating modern day syste…
Indicators of buy-in to gauge evaluation success
In order for novice evaluators to gauge the success of their evaluations, the ability to identify and recognize indicators of buy-in is an essential skill. While much is written in the evaluation literature about strategies to build buy-in, the indicators of buy-in are largely overlooked. This article shares strategies used for building buy-in from a multi-state evaluation of cardiac care. Indicators of the success of these strategies are then sh…
Contributing Factors to the Continued Blurring of Evaluation and Research
Despite many studies devoted to the different purposes of evaluation and research, purpose-method incongruence persists. Experimental research designs continue to be inappropriately used to evaluate programs for which sufficient research evidence has accumulated. By using a case example the article highlights several contributing factors to purpose-method incongruence, including the control of the federal level evaluation agenda by researchers, c…
The Reciprocal Relationship between Implementation Theory and Program Theory in Assisting Program Design and Decision-Making
The focus of this article is how Theory Driven Evaluation (TDE) and two of its central tenets—program theory and implementation theory—can be simultaneously used to inform and assist programmatic decision-making. The article argues there is a paucity of evaluation literature demonstrating how program theory can be beneficial to the design and interpretation of implementation theory. A case example is used to illustrate the importance of program t…
Deliberation-Derived Process (DDP) evaluation
This article describes a methodology for conducting process evaluations. The Deliberation-Derived Process (DDP) evaluation develops questions based on deliberations occurring during the planning, design and early implementation phases of a program. The steps involved in completing a DDP evaluation are described and illustrated using a few case examples. It is argued DDP evaluation is especially useful in providing targeted and timely information …
Using Root Cause Analysis for Evaluating Program Improvement
A common evaluation purpose is to determine whether a policy or program was implemented as intended: referred to as formative evaluation, process evaluation, or evaluating program improvement. A well-designed formative evaluation is important in: detecting program drift; providing timely feedback to program staff to make cost-saving mid-course corrections; reassuring the sponsor that quality assurance measures are implemented to protect investmen…
Emergency Preparedness Training of Tribal Community Health Representatives
Systemic Evaluation, Impact Evaluation and Logic Models
Evaluators are yet to define systemic evaluation adequately. With respect to impact evaluation, systemic evaluators are critical of current methods such as simple logic models, or logframes, for capturing the contextual complexity in which programs operate. Despite a lack of clarity about what constitutes a systemic evaluation, many evaluators are suggesting it is a better alternative for capturing the true complexity of the context in which a pr…
A Three-Step Approach to Teaching Logic Models
Developing a logic model is an essential first step in program evaluation. Our experience has been that there is little guidance to teach students how to develop a logic model that is true to its intended purpose of providing a clear visual representation of the underlying rationale that is not shrouded by including the elements of evaluation. We have developed a three-step approach that begins with developing the visual representation of the und…
Illustrating the Evaluation of System Feedback Mechanisms Using System Evaluation Theory (SET)
This article describes how system evaluation theory (SET) guided the evaluation of cardiac care response systems efficiency in seven rural United States. Specifically, the article focuses on the approach and methods used to evaluate system feedback mechanisms; one key factor affecting system efficiency. Mixed methods were applied to evaluate five criteria of system feedback efficiency: frequency, timeliness, credibility, specificity, and relevanc…
Systemic Evaluation, Impact Evaluation and Logic Models
Evaluators are yet to define systemic evaluation adequately. With respect to impact evaluation, systemic evaluators are critical of current methods such as simple logic models, or logframes, for capturing the contextual complexity in which programs operate. Despite a lack of clarity about what constitutes a systemic evaluation, many evaluators are suggesting it is a better alternative for capturing the true complexity of the context in which a pr…
A Three-Step Approach to Teaching Logic Models
Indicators of buy-in to gauge evaluation success
In order for novice evaluators to gauge the success of their evaluations, the ability to identify and recognize indicators of buy-in is an essential skill. While much is written in the evaluation literature about strategies to build buy-in, the indicators of buy-in are largely overlooked. This article shares strategies used for building buy-in from a multi-state evaluation of cardiac care. Indicators of the success of these strategies are then sh…
Defining Systems to Evaluate System Efficiency and Effectiveness
This paper focuses on the application of systems thinking, systems theory, and systems evaluation theory (SET) in evaluating modern day systems. SET consists of three steps purposively sequenced with each being a prerequisite for the success of the next step. The first foundational step is to define the system. Systems thinking provides theoretical rationale for defining the system boundaries, components, and relationships. However, there is no l…
Evaluating System Cascading Failures
This article shares methods used to evaluate system cascading failures. A cascading failure occurs when a problem is passed from one subsystem to a downstream subsystem creating a domino effect that undermines system efficiency and effectiveness. First, the basics of system evaluation theory (SET) are reviewed. Then drawing on different examples from the evaluation of emergency response systems the article describes how a) standard operating proc…
Suggested Guidelines for Writing Reflective Case Narratives
Reflective case narratives are a practical mechanism for conveying lessons learned for practice improvement. Their ability to transform experience into knowledge in a colloquial, narrative style positions reflective case narratives as a powerful learning tool with pedagogical benefits for the evaluation community. However, one criticism of reflective case narratives is they suffer from loose guidelines and lengthy discussions that obscure lessons…
System evaluation theory (SET)
This article presents a guiding framework for evaluators to conduct systems evaluation: system evaluation theory (SET). The article firstly defines ‘systems’, ‘system theory’, and ‘system thinking’; it then discusses the confusion in the evaluation literature surrounding the use of these terms (noting their application is primarily in evaluating programs, not evaluating modern day systems). Three guiding principles for evaluating modern day syste…
Learning From a Challenging Fieldwork Evaluation Experience
The use of fieldwork experiences has been widely accepted by teachers of evaluation as a method of preparing future practitioners for challenges encountered in the field. However, several challenges must be addressed to make fieldwork experiences a useful tool in preparing students for their professional careers. The authors present a case study in which a graduate student in an evaluation class approached an agency seeking a fieldwork project. T…
Geographic Information Systems (GIS) as an Evaluation Tool
A comparative case study illustrating the influence of a system perspective on the outcome evaluation of simple versus complex interventions
When evaluating the effectiveness of an intervention, the evaluation approach must match the intervention complexity, ensuring that the chosen evaluation is “fit for purpose.” For simple interventions, evaluating short-, mid-, and long-term outcomes is appropriate. However, for complex interventions, an additional outcome that must be considered is the essential system property that emerges as a result of the interaction of interdependent interve…
Lessons learned in evaluating system interdependencies using qualitative methods
This article shares lessons learned while evaluating the system interdependencies for a clinical and translational research centre (CTR). It explores the methodological challenge of discussing system concepts (e.g., cascading failures, feedback loops, and reflex arcs) with layperson participants during evaluation interviews. The article discusses the iterative process of moving from structured interview approaches in favor of an open narrative ap…
Lessons learned in evaluating the infrastructure of a Centre for Translational Research
This paper shares lessons learned while evaluating the implementation of a Clinical and Translational Research Center (CTR). To meet its overarching goals the CTR consists of numerous research support units (e.g., biostats, community engagement, professional development, etc.) that are intended to work together collaboratively. It is then argued that an evaluation approach grounded in system thinking was the best fit to evaluate this key CTR desi…
Reworks
The article reports on the inaugural Australian-American system evaluation summit convened in Wyoming, USA, focusing on the application of system evaluation theory (SET). The think tank noted SET’s efficiency principles and published illustrations are emergency response sector specific and pondered whether efficiency measures could be identified for systems targeting complex social problems. The article describes how the think tank used the conce…
Consequences to Federal Programs When the Logic-Modeling Process Is Not Followed With Fidelity
The Office of Management and Budget has recommended the termination of numerous federal programs, citing a lack of program results as the primary reason for this decision. In response to this recommendation, several federal agencies have turned to logic modeling to demonstrate that programs are on the path to results accountability. However, approaches to logic modeling in some agencies have not followed the strategies that evaluators recommend a…
The connection between logic models and systems thinking concepts
This article examines the relationship between systems thinking concepts and the logic model. Two notable shortcomings of the logic model are illustrated: depicting the program theory linearly and failing to place the program in context. Both issues lead to an artificial depiction of reality making evaluation findings difficult to interpret. Systems thinking concepts are defined and how they address these shortcomings is discussed. This article t…
A Practical Framework for Evaluating a Culturally Tailored Adolescent Substance Abuse Treatment Programme in Molokai, Hawaii
While programme evaluation data is still being collected, the authors have demonstrated a sound foundation for programme activities, and designed methodology for collecting meaningful data to measure programme effectiveness at changing important root causes of substance abuse in a rural Native Hawaiian community
Strategies for Values Inquiry
Values inquiry refers to systematic investigation of the values relevant to a program, including understanding those outcomes most prized by stakeholders. Although much attention has been given to stakeholder involvement, the literature on value inquiries per se as an approach is limited. This paper demonstrates how several of the steps used in the ATM approach to developing logic models [Am. J. Eval. 23 (2002) 493] are congruent with the tenets …
Evaluating Housing Revitalization Projects
The article describes the challenges faced by the authors in evaluating a neighborhood revitalization project. The challenges are placed in the context of three of the Program Evaluation Standards published by the Joint Committee on Standards for Educational Evaluation: Values Identification, Fiscal Responsibility, and Analysis of Quantitative Information. For each problem presented, the authors provide solutions that should assist all evaluators…
Geographic Information Systems (GIS) as an Evaluation Tool
Evaluators must seek methods that convey the results of an evaluation so that those who intend on using the information easily understand them. The purpose of this article is to describe how Geographic Information Systems (GIS) can be used to assist evaluators to convey complex information simply, via a spatial representation. Although the utility of GIS in such disciplines as geography, planning, epidemiology and public health is well documented…
Research and legal perspectives on the implications of the Family Privacy Protection Act for research and evaluation involving minors
Research and Legal Perspectives on the Implications of the Family Privacy Protection Act for Research and Evaluation Involving Minors
This paper reviews the Family Privacy Protection Act of 1995 (FPPA) and its potential impact on research and evaluation involving minors. First it discusses the issues surrounding the FPPA as debated in the United States House of Representatives. The FPPA requires written, or “active,” consent from the parent/guardian for survey research involving minors, rather than “passive” consent, which researchers have presumed when parents fail to return f…
Optimal Living Profile
Objective: To develop an instrument to assess environmental, emotional, spiritual, physical, social, and intellectual health and wellness. Methods: Reliability was assessed using 102 respondents who completed the OLP on 2 occasions. Concurrent validity was assessed using a second sample of 34 respondents and a panel of 6 experts. Results: Most items had high test-retest correlation coefficients. Each dimension had high internal consistency (ie, h…
Assessing the Effectiveness of a Community-Based Media Campaign Targeting Physical Inactivity
The goal of this study was to develop, implement, and evaluate a community-based effort addressing the problem of physical inactivity. Using Prochaska's Transtheoretical Model as a guide, community members developed television and worksite media messages focusing on the benefits and barriers of physical activity and on increasing self-efficacy. The media campaign was effective in changing perceived barriers, perceived benefits, and self-efficacy …
Geographic Information Systems (GIS) as an Evaluation Tool
Evaluators must seek methods that convey the results of an evaluation so that those who intend on using the information easily understand them. The purpose of this article is to describe how Geographic Information Systems (GIS) can be used to assist evaluators to convey complex information simply, via a spatial representation. Although the utility of GIS in such disciplines as geography, planning, epidemiology and public health is well documented…
A Three-Step Approach to Teaching Logic Models
A Three-Step Approach to Teaching Logic Models
Developing a logic model is an essential first step in program evaluation. Our experience has been that there is little guidance to teach students how to develop a logic model that is true to its intended purpose of providing a clear visual representation of the underlying rationale that is not shrouded by including the elements of evaluation. We have developed a three-step approach that begins with developing the visual representation of the und…
Geographic Information Systems (GIS) as an Evaluation Tool
Evaluating Housing Revitalization Projects
The article describes the challenges faced by the authors in evaluating a neighborhood revitalization project. The challenges are placed in the context of three of the Program Evaluation Standards published by the Joint Committee on Standards for Educational Evaluation: Values Identification, Fiscal Responsibility, and Analysis of Quantitative Information. For each problem presented, the authors provide solutions that should assist all evaluators…
Strategies for Values Inquiry
Values inquiry refers to systematic investigation of the values relevant to a program, including understanding those outcomes most prized by stakeholders. Although much attention has been given to stakeholder involvement, the literature on value inquiries per se as an approach is limited. This paper demonstrates how several of the steps used in the ATM approach to developing logic models [Am. J. Eval. 23 (2002) 493] are congruent with the tenets …
Learning From a Challenging Fieldwork Evaluation Experience
The use of fieldwork experiences has been widely accepted by teachers of evaluation as a method of preparing future practitioners for challenges encountered in the field. However, several challenges must be addressed to make fieldwork experiences a useful tool in preparing students for their professional careers. The authors present a case study in which a graduate student in an evaluation class approached an agency seeking a fieldwork project. T…
Consequences to Federal Programs When the Logic-Modeling Process Is Not Followed With Fidelity
The Office of Management and Budget has recommended the termination of numerous federal programs, citing a lack of program results as the primary reason for this decision. In response to this recommendation, several federal agencies have turned to logic modeling to demonstrate that programs are on the path to results accountability. However, approaches to logic modeling in some agencies have not followed the strategies that evaluators recommend a…
What an Eight-Year-Old Can Teach Us About Logic Modelling and Mainstreaming
This article presents a short case narrative, the purpose of which is to illustrate that complex evaluation methodologies such as logic modelling can be simplified to the point where a child can be guided through the process quickly. However, the case narrative also serves to highlight the potential consequences to program development and evaluation activities when the process is oversimplified. Like a double-edged sword, simplifying the process …
A Practical Framework for Evaluating a Culturally Tailored Adolescent Substance Abuse Treatment Programme in Molokai, Hawaii
While programme evaluation data is still being collected, the authors have demonstrated a sound foundation for programme activities, and designed methodology for collecting meaningful data to measure programme effectiveness at changing important root causes of substance abuse in a rural Native Hawaiian community
Constructing and Verifying Program Theory Using Source Documentation
Making the program theory explicit is an essential first step in Theory Driven Evaluation (TDE). Once explicit, the program logic can be established making necessary links between the program theory, activities, and outcomes. Despite its importance evaluators often encounter situations where the program theory is not explicitly stated. Under such circumstances evaluators require alternatives to generate a program theory with limited time and reso…
Emergency Preparedness Training of Tribal Community Health Representatives
Systemic Evaluation, Impact Evaluation and Logic Models
Evaluators are yet to define systemic evaluation adequately. With respect to impact evaluation, systemic evaluators are critical of current methods such as simple logic models, or logframes, for capturing the contextual complexity in which programs operate. Despite a lack of clarity about what constitutes a systemic evaluation, many evaluators are suggesting it is a better alternative for capturing the true complexity of the context in which a pr…
Using Root Cause Analysis for Evaluating Program Improvement
A common evaluation purpose is to determine whether a policy or program was implemented as intended: referred to as formative evaluation, process evaluation, or evaluating program improvement. A well-designed formative evaluation is important in: detecting program drift; providing timely feedback to program staff to make cost-saving mid-course corrections; reassuring the sponsor that quality assurance measures are implemented to protect investmen…
The Reciprocal Relationship between Implementation Theory and Program Theory in Assisting Program Design and Decision-Making
The focus of this article is how Theory Driven Evaluation (TDE) and two of its central tenets—program theory and implementation theory—can be simultaneously used to inform and assist programmatic decision-making. The article argues there is a paucity of evaluation literature demonstrating how program theory can be beneficial to the design and interpretation of implementation theory. A case example is used to illustrate the importance of program t…
Deliberation-Derived Process (DDP) evaluation
This article describes a methodology for conducting process evaluations. The Deliberation-Derived Process (DDP) evaluation develops questions based on deliberations occurring during the planning, design and early implementation phases of a program. The steps involved in completing a DDP evaluation are described and illustrated using a few case examples. It is argued DDP evaluation is especially useful in providing targeted and timely information …
Contributing Factors to the Continued Blurring of Evaluation and Research
Despite many studies devoted to the different purposes of evaluation and research, purpose-method incongruence persists. Experimental research designs continue to be inappropriately used to evaluate programs for which sufficient research evidence has accumulated. By using a case example the article highlights several contributing factors to purpose-method incongruence, including the control of the federal level evaluation agenda by researchers, c…
System evaluation theory (SET)
This article presents a guiding framework for evaluators to conduct systems evaluation: system evaluation theory (SET). The article firstly defines ‘systems’, ‘system theory’, and ‘system thinking’; it then discusses the confusion in the evaluation literature surrounding the use of these terms (noting their application is primarily in evaluating programs, not evaluating modern day systems). Three guiding principles for evaluating modern day syste…
Indicators of buy-in to gauge evaluation success
In order for novice evaluators to gauge the success of their evaluations, the ability to identify and recognize indicators of buy-in is an essential skill. While much is written in the evaluation literature about strategies to build buy-in, the indicators of buy-in are largely overlooked. This article shares strategies used for building buy-in from a multi-state evaluation of cardiac care. Indicators of the success of these strategies are then sh…
Process Flow Mapping for Systems Improvement
This article fills a gap in the evaluation literature by detailing how to conduct process flow mapping: a continuous quality improvement (CQI) method. The importance of process flow mapping and the steps required to complete the method are illustrated in the context of evaluating a cardiac care system. The article discusses several challenges and solutions in conducting process flow mapping, including (a) selecting appropriate subject matter expe…
Suggested Guidelines for Writing Reflective Case Narratives
Reflective case narratives are a practical mechanism for conveying lessons learned for practice improvement. Their ability to transform experience into knowledge in a colloquial, narrative style positions reflective case narratives as a powerful learning tool with pedagogical benefits for the evaluation community. However, one criticism of reflective case narratives is they suffer from loose guidelines and lengthy discussions that obscure lessons…
Computer Science (35 works) · Evaluation and Performance Assessment (31 works) · Engineering (28 works) · Psychology (23 works) · Management science (22 works) · Health Policy Implementation Science (15 works) · Political science (15 works) · Sociology (14 works) · Medicine (13 works) · Process management (12 works)