Sebastian Lemire
Biographic Data
| ID | 4392918 |
|---|---|
| NAME | Sebastian Lemire |
| GIVEN NAMES | Sebastian |
| FAMILY NAME | Lemire |
| SIGNATURE | LEMIRE S |
| AFFILIATIONS | University of California, Los Angeles |
| ORCID | 0000-0003-4079-3247 |
| VERIFIED | Yes |
| TOTAL WORKS | 26 |
| TOTAL CITATIONS | 46 |
| WORKS AS AUTHOR | 26 |
| WORKS AS EDITOR | 0 |
| FIRST PUBLICATION YEAR | 2010 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 4 |
What can we learn from reviews of realist evaluation studies? Principles for rigorous realist evaluation
The realist evaluation approach has become firmly established within the field of evaluation. Reflecting its sustained and increasing uptake across diverse fields, a growing number of reviews have, over the years, examined practical applications of realist evaluations. Drawing on an umbrella review of 23 published reviews of realist evaluations, this article takes stock of key challenges in realist evaluation and proposes practical principles for…
Co-developing practice guides
Taking Stock of Contribution Analysis
Over the past two decades, contribution analysis (CA) has attracted considerable attention as a theory-based evaluation approach. Over the years, CA has been applied across a broad and still broadening range of settings and contexts. Informed by a comprehensive review of published articles on CA, this article examines the main methodological and theoretical developments of CA. The findings suggest that developments over the past 10 years have foc…
Unpacking core components for policy design
Under the banner of evidence‐based policy, evidence reviews—summaries of existing studies on an intervention—have become an established form of policy analysis. Whereas evidence reviews have typically focused on studies of an intervention as delivered, interest is growing in examining the specific elements that comprise the intervention and that contribute to its success—broadly referred to as its core components. Understanding the core component…
Capturing Evaluation Capacity
This article surveys the literature on organizational evaluation capacity (EC) instruments. Over the past 25 years, articles have been published in four waves covering the development of organizational evaluation capacity models, surveys of the evaluation capacity and practice landscape, the development of EC instruments, and their replication and adaptation. Altogether, the authors identified 20 studies applying 16 EC instruments. Several studie…
The Science and Practice of Evaluation Capacity Building
Evaluation capacity building (ECB) has become an integral part of the practice and profession of evaluation. Over 20 years, much has been learned about ECB, yet substantial room exists for continuing to expand our ECB scholarship and practice. In this special issue, the authors share insights from recent scholarship and training efforts that can serve as a launching point for the next generation of ECB
Concluding Remarks
Evaluation capacity building (ECB) seeks to provide individuals and organizations with the knowledge, skills, and systems that they need to make evaluation an ongoing part of their everyday activities. This special issue sought to advance ECB by bringing to light original empirical research as well as practical applications of various ECB approaches. This concluding article provides an overview of the eight contributions comprising the special is…
Mapping the evaluation capacity building landscape
Mapping the Contributions of John Mayne
The late John Mayne’s contribution to evaluation was significant. This article maps his written contributions to evaluation. The authors analyze the number and types of publications produced by John Mayne from 1981 to 2020. They also identify the main themes in his authorship, and how they evolved over time. They further identify his most notable publications and use standard citation metrics to assess his academic impact. Finally, they take stoc…
Using Evaluative Information Sensibly
In this concluding article, we take stock of the diverse and stimulating contributions comprising this special issue. Using concept mapping, we identify eight evaluation themes and concepts central to John Mayne’s collective work: evaluation utilization, results-based management, organizational learning, accountability, evaluation culture, contribution analysis, theory-based evaluation, and causation. The overarching contribution story is that Jo…
Remembering John Mayne—A Practical Thinker and a Thinking Practitioner
The evolution of systematic evidence reviews
Evidence reviews are widely used to summarize findings from existing studies and, as such, are an important base for policy analysis. Over the past 50 years, three waves of evidence reviews have emerged: (1) the meta‐analysis wave, (2) the mixed‐methods synthesis wave, and (3) the core components wave. The present article first describes these waves and reflects on the benefits and limitations of each wave in the context of policy analysis. Infor…
The curious case of the realist trial
Realist evaluation and experimental designs are both well-established approaches to evaluation. Over the past 10 years, realist trials—evaluations purposefully combining realist evaluation and experimental designs—have emerged. Informed by a comprehensive review of published realist trials, this article examines to what extent and how realist trials align with quality standards for realist evaluations and randomized controlled trials and to what …
Unpacking context in realist evaluations
Realist evaluation is an established approach in evaluation. The main question driving realist evaluation is to uncover how, for whom, and under what conditions an intervention works. This is accomplished by empirically examining the inner mechanisms by which an intervention generates outcomes within a particular context—explicating the underlying context–mechanism–outcome configurations. Despite the central role of context in realist evaluation,…
Laying a Solid Foundation for the Next Generation of Evaluation Capacity Building
Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a structured approach. The purpose of the present article is to integrate the ECB literature in evaluation…
Peer Reviewers for Volume 34 / Examinateurs des manuscrits du volume 34
Peer Reviewers for Volume 34 / Examinateurs des manuscrits du volume 34." Canadian Journal of Program Evaluation, 34(3), pp. 521–522
The Growth of the Evaluation Tree in the Policy Analysis Forest
The practice and profession of evaluation is continually evolving. From its early origin in the Great Society years of the 1960s, through its golden years of the 1970s, its transformation under the fiscal conservatism of the Reagan era in the 1980s, and in its maturation during the performance and results era of the 1990s, the field of evaluation continues to evolve in response to broader trends in society. This article examines recent developmen…
Can’t See the Wood for the Logframe
There are numerous ways in which to model the underlying theory of programs. In the context of international development evaluation, the most ubiquitous are likely “logframes” and to some extent “theories of change,” both of which may serve to guide program development and management, monitoring, and evaluation. While logframes and theories of change are often developed in parallel, they are rarely fully integrated in their practical application.…
The Current Landscape of Program Theorizing
Guest Editors Introduction
How We Model Matters
In this concluding article, grounded on the exemplary contributions contained in the preceding pages, the guest editors scale the proverbial soapbox and present a manifesto to guide the pursuit and advancement of the next generation of program theorizing. Formulating ten declarations for program theory development and examination, the modest hope of the authors is to motivate and inspire refl ective evaluation practitioners to broaden their views…
Meta-Modeling Housing First
Research synthesis has become an increasingly popular approach for summarizing primary research. In the past two decades, interest in mixed methods reviews has steadily grown, followed, more recently, by an increased attention to theory-based syntheses. This article advances and illustrates a practical application of meta-modeling—a mixed methods, theory-based synthesis approach. The proposed methodology combines meta-analytic and qualitative com…
Why Evaluation Theory Should Be Used to Inform Evaluation Policy
Many organizations now have evaluation policies. Because formal evaluation policies intend to frame evaluation practice, it is important to understand the aims of policies and their influence on practice. Evaluation theory is also intended to guide practice; therefore, the extent to which policies are informed by theory is also important to consider, given the related purposes of evaluation theories and policies. Because evaluation policies have …
Building the house of evaluation
The push for evidence-based practice is persistent in the public sector—what counts is what works. One central premise for evidence-based practice is the existence of an evidence base; that is, an accumulated and generalizable body of knowledge. Informed by a recent systematic review, we examine the promises and pitfalls of meta-analysis (the statistical workhorse of systematic reviews) as the primary blueprint for cumulative knowledge building i…
Making contribution analysis work
This article examines the methodological strengths and weaknesses of contribution analysis. The authors contend that a salient characteristic of contribution analysis is its accounting for influencing factors and alternative explanations. We argue that contribution analysis in its current form needs further methodological and practical elaboration in this respect. Therefore, this article pays particular attention to how the methodology can identi…
Measuring Evaluation Capacity—Results and Implications of a Danish Study
Evaluation capacity building (ECB) has become an area in the evaluation field that is attracting both scholarly attention and the practical work of evaluators. Despite some recent contributions, differing conceptions still exist concerning what constitutes ECB, let alone the nature of the capacity being built. Responding to an earlier call on the need for conceptual clarity regarding evaluation capacity (EC), this article discusses a model and a …
Making contribution analysis work
This article examines the methodological strengths and weaknesses of contribution analysis. The authors contend that a salient characteristic of contribution analysis is its accounting for influencing factors and alternative explanations. We argue that contribution analysis in its current form needs further methodological and practical elaboration in this respect. Therefore, this article pays particular attention to how the methodology can identi…
Measuring Evaluation Capacity—Results and Implications of a Danish Study
Evaluation capacity building (ECB) has become an area in the evaluation field that is attracting both scholarly attention and the practical work of evaluators. Despite some recent contributions, differing conceptions still exist concerning what constitutes ECB, let alone the nature of the capacity being built. Responding to an earlier call on the need for conceptual clarity regarding evaluation capacity (EC), this article discusses a model and a …
The Growth of the Evaluation Tree in the Policy Analysis Forest
The practice and profession of evaluation is continually evolving. From its early origin in the Great Society years of the 1960s, through its golden years of the 1970s, its transformation under the fiscal conservatism of the Reagan era in the 1980s, and in its maturation during the performance and results era of the 1990s, the field of evaluation continues to evolve in response to broader trends in society. This article examines recent developmen…
Why Evaluation Theory Should Be Used to Inform Evaluation Policy
Many organizations now have evaluation policies. Because formal evaluation policies intend to frame evaluation practice, it is important to understand the aims of policies and their influence on practice. Evaluation theory is also intended to guide practice; therefore, the extent to which policies are informed by theory is also important to consider, given the related purposes of evaluation theories and policies. Because evaluation policies have …
Laying a Solid Foundation for the Next Generation of Evaluation Capacity Building
Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a structured approach. The purpose of the present article is to integrate the ECB literature in evaluation…
Unpacking core components for policy design
Under the banner of evidence‐based policy, evidence reviews—summaries of existing studies on an intervention—have become an established form of policy analysis. Whereas evidence reviews have typically focused on studies of an intervention as delivered, interest is growing in examining the specific elements that comprise the intervention and that contribute to its success—broadly referred to as its core components. Understanding the core component…
The evolution of systematic evidence reviews
Evidence reviews are widely used to summarize findings from existing studies and, as such, are an important base for policy analysis. Over the past 50 years, three waves of evidence reviews have emerged: (1) the meta‐analysis wave, (2) the mixed‐methods synthesis wave, and (3) the core components wave. The present article first describes these waves and reflects on the benefits and limitations of each wave in the context of policy analysis. Infor…
The curious case of the realist trial
Realist evaluation and experimental designs are both well-established approaches to evaluation. Over the past 10 years, realist trials—evaluations purposefully combining realist evaluation and experimental designs—have emerged. Informed by a comprehensive review of published realist trials, this article examines to what extent and how realist trials align with quality standards for realist evaluations and randomized controlled trials and to what …
Contribution Analysis Applied
This article investigates contribution analysis, an analytical tool invented by John Mayne, from both a theoretical and an operational perspective. Despite the substantial attention that contribution analysis has received, few studies appear to have applied it in practice. The article discusses the broadened scope of contribution analysis by analyzing its theoretical and methodological tenets, and examines its practical applicability in relation …
Measuring Evaluation Capacity—Results and Implications of a Danish Study
Evaluation capacity building (ECB) has become an area in the evaluation field that is attracting both scholarly attention and the practical work of evaluators. Despite some recent contributions, differing conceptions still exist concerning what constitutes ECB, let alone the nature of the capacity being built. Responding to an earlier call on the need for conceptual clarity regarding evaluation capacity (EC), this article discusses a model and a …
Making contribution analysis work
This article examines the methodological strengths and weaknesses of contribution analysis. The authors contend that a salient characteristic of contribution analysis is its accounting for influencing factors and alternative explanations. We argue that contribution analysis in its current form needs further methodological and practical elaboration in this respect. Therefore, this article pays particular attention to how the methodology can identi…
Building the house of evaluation
The push for evidence-based practice is persistent in the public sector—what counts is what works. One central premise for evidence-based practice is the existence of an evidence base; that is, an accumulated and generalizable body of knowledge. Informed by a recent systematic review, we examine the promises and pitfalls of meta-analysis (the statistical workhorse of systematic reviews) as the primary blueprint for cumulative knowledge building i…
Can’t See the Wood for the Logframe
There are numerous ways in which to model the underlying theory of programs. In the context of international development evaluation, the most ubiquitous are likely “logframes” and to some extent “theories of change,” both of which may serve to guide program development and management, monitoring, and evaluation. While logframes and theories of change are often developed in parallel, they are rarely fully integrated in their practical application.…
The Current Landscape of Program Theorizing
Guest Editors Introduction
How We Model Matters
In this concluding article, grounded on the exemplary contributions contained in the preceding pages, the guest editors scale the proverbial soapbox and present a manifesto to guide the pursuit and advancement of the next generation of program theorizing. Formulating ten declarations for program theory development and examination, the modest hope of the authors is to motivate and inspire refl ective evaluation practitioners to broaden their views…
Meta-Modeling Housing First
Research synthesis has become an increasingly popular approach for summarizing primary research. In the past two decades, interest in mixed methods reviews has steadily grown, followed, more recently, by an increased attention to theory-based syntheses. This article advances and illustrates a practical application of meta-modeling—a mixed methods, theory-based synthesis approach. The proposed methodology combines meta-analytic and qualitative com…
Why Evaluation Theory Should Be Used to Inform Evaluation Policy
Many organizations now have evaluation policies. Because formal evaluation policies intend to frame evaluation practice, it is important to understand the aims of policies and their influence on practice. Evaluation theory is also intended to guide practice; therefore, the extent to which policies are informed by theory is also important to consider, given the related purposes of evaluation theories and policies. Because evaluation policies have …
Peer Reviewers for Volume 34 / Examinateurs des manuscrits du volume 34
Peer Reviewers for Volume 34 / Examinateurs des manuscrits du volume 34." Canadian Journal of Program Evaluation, 34(3), pp. 521–522
The Growth of the Evaluation Tree in the Policy Analysis Forest
The practice and profession of evaluation is continually evolving. From its early origin in the Great Society years of the 1960s, through its golden years of the 1970s, its transformation under the fiscal conservatism of the Reagan era in the 1980s, and in its maturation during the performance and results era of the 1990s, the field of evaluation continues to evolve in response to broader trends in society. This article examines recent developmen…
Unpacking context in realist evaluations
Realist evaluation is an established approach in evaluation. The main question driving realist evaluation is to uncover how, for whom, and under what conditions an intervention works. This is accomplished by empirically examining the inner mechanisms by which an intervention generates outcomes within a particular context—explicating the underlying context–mechanism–outcome configurations. Despite the central role of context in realist evaluation,…
Laying a Solid Foundation for the Next Generation of Evaluation Capacity Building
Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a structured approach. The purpose of the present article is to integrate the ECB literature in evaluation…
Mapping the evaluation capacity building landscape
Mapping the Contributions of John Mayne
The late John Mayne’s contribution to evaluation was significant. This article maps his written contributions to evaluation. The authors analyze the number and types of publications produced by John Mayne from 1981 to 2020. They also identify the main themes in his authorship, and how they evolved over time. They further identify his most notable publications and use standard citation metrics to assess his academic impact. Finally, they take stoc…
Using Evaluative Information Sensibly
In this concluding article, we take stock of the diverse and stimulating contributions comprising this special issue. Using concept mapping, we identify eight evaluation themes and concepts central to John Mayne’s collective work: evaluation utilization, results-based management, organizational learning, accountability, evaluation culture, contribution analysis, theory-based evaluation, and causation. The overarching contribution story is that Jo…
Remembering John Mayne—A Practical Thinker and a Thinking Practitioner
The evolution of systematic evidence reviews
Evidence reviews are widely used to summarize findings from existing studies and, as such, are an important base for policy analysis. Over the past 50 years, three waves of evidence reviews have emerged: (1) the meta‐analysis wave, (2) the mixed‐methods synthesis wave, and (3) the core components wave. The present article first describes these waves and reflects on the benefits and limitations of each wave in the context of policy analysis. Infor…
The curious case of the realist trial
Realist evaluation and experimental designs are both well-established approaches to evaluation. Over the past 10 years, realist trials—evaluations purposefully combining realist evaluation and experimental designs—have emerged. Informed by a comprehensive review of published realist trials, this article examines to what extent and how realist trials align with quality standards for realist evaluations and randomized controlled trials and to what …
Capturing Evaluation Capacity
This article surveys the literature on organizational evaluation capacity (EC) instruments. Over the past 25 years, articles have been published in four waves covering the development of organizational evaluation capacity models, surveys of the evaluation capacity and practice landscape, the development of EC instruments, and their replication and adaptation. Altogether, the authors identified 20 studies applying 16 EC instruments. Several studie…
The Science and Practice of Evaluation Capacity Building
Evaluation capacity building (ECB) has become an integral part of the practice and profession of evaluation. Over 20 years, much has been learned about ECB, yet substantial room exists for continuing to expand our ECB scholarship and practice. In this special issue, the authors share insights from recent scholarship and training efforts that can serve as a launching point for the next generation of ECB
Concluding Remarks
Evaluation capacity building (ECB) seeks to provide individuals and organizations with the knowledge, skills, and systems that they need to make evaluation an ongoing part of their everyday activities. This special issue sought to advance ECB by bringing to light original empirical research as well as practical applications of various ECB approaches. This concluding article provides an overview of the eight contributions comprising the special is…
Co-developing practice guides
Taking Stock of Contribution Analysis
Over the past two decades, contribution analysis (CA) has attracted considerable attention as a theory-based evaluation approach. Over the years, CA has been applied across a broad and still broadening range of settings and contexts. Informed by a comprehensive review of published articles on CA, this article examines the main methodological and theoretical developments of CA. The findings suggest that developments over the past 10 years have foc…
Unpacking core components for policy design
Under the banner of evidence‐based policy, evidence reviews—summaries of existing studies on an intervention—have become an established form of policy analysis. Whereas evidence reviews have typically focused on studies of an intervention as delivered, interest is growing in examining the specific elements that comprise the intervention and that contribute to its success—broadly referred to as its core components. Understanding the core component…
Evaluation and Performance Assessment (23 works) · Computer Science (15 works) · Engineering (15 works) · Political science (11 works) · Sociology (11 works) · Epistemology (10 works) · Public Policy and Administration Research (10 works) · Engineering ethics (9 works) · Management science (9 works) · Law (7 works)