Paul R Brandon
Biographic Data
| ID | 234030 |
|---|---|
| NAME | Paul R Brandon |
| GIVEN NAMES | Paul R |
| FAMILY NAME | Brandon |
| SIGNATURE | BRANDON P R |
| AFFILIATIONS | University of Hawaiʻi at Mānoa |
| VERIFIED | No |
| TOTAL WORKS | 22 |
| TOTAL CITATIONS | 41 |
| AUTHOR COUNT | 22 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 1987 |
| LATEST PUBLICATION YEAR | 2020 |
| H-INDEX | 4 |
Program Evaluation
The profession of educational and social program evaluation has expanded exponentially around the globe since the mid-1960s and continues to receive the considerable attention of theorists, methodologists, and practitioners. The literature on it is wide and deep, reflecting an array of definitions and conceptions of purpose and social role. This chapter discusses these topics and several others, including opinions about the choice of methods, som…
The development, validation, and potential uses of the Student Interest-in-the-Arts Questionnaire
The State of the Empirical Research Literature on Stakeholder Involvement in Program Evaluation
Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical studies as the first step in establishing a firm foundation for a discussion of stakeholder involvem…
Monitoring and Evaluation of African Women in Agricultural Research and Development (Award): An Exemplar of Managing for Impact in Development Evaluation
SAS Code for Calculating Intraclass Correlation Coefficients and Effect Size Benchmarks for Site-Randomized Education Experiments
When evaluators plan site-randomized experiments, they must conduct the appropriate statistical power analyses. These analyses are most likely to be valid when they are based on data from the jurisdictions in which the studies are to be conducted. In this method note, we provide software code, in the form of a SAS macro, for producing statistical power analyses using such data. The macro is designed to estimate statistical parameters for multiple…
Five Years of HHS Home Health Care Evaluations: Using Evaluation to Change National Policy
Looking Ahead: The Future of Evaluation
Aspects of Successful Evaluation Practice at an Established Private Evaluation Firm
Evaluation Exemplar: Exemplary Aspects of a Small Group-Randomized Local Educational Program Evaluation
Evaluation Exemplar: The Critical Importance of Stakeholder Relations in a National, Experimental Abstinence Education Evaluation
This piece describes Mathematicaâ€TMs abstinence education evaluation, provides interviews with the evaluationâ€TMs two lead authors (Trenholm and Devaney), and offers reflections on the study
Participatory Evaluation as Seen in a Vygotskian Framework
In participatory evaluations of K–12 programs, evaluators develop school faculty’s and administrators’ evaluation capacity by training them to conduct evaluation tasks and providing consultation while the tasks are conducted. A strong case can be made that the capacity building in these evaluations can be examined using a Vygotskian approach. We conducted participatory evaluations at 9 Hawaii public schools and collected data on the extent to whi…
The Strength of the Methodological Warrants for the Findings of Research on Program Evaluation Use
Considerable research has been conducted on the use of the findings of program evaluation, but little, if any, attention has been paid to the soundness of the methods of this research. If the methods are not sound or not well described in the research, the strength of the conclusions of the research is unknown. The authors examine the empirical studies reported in five widely cited reviews of the literature on program evaluation use and summarize…
The Complexity of Measuring the Quality of Program Implementation With Observations: The Case of Middle School Inquiry-Based Science
In the growing literature on the evaluation of program implementation, less has been said about evaluating program quality than about evaluating other aspects of program implementation. Furthermore, most articles and reports in the program-implementation evaluation literature have presented only brief descriptions of how implementation instruments have been developed. In this article, the authors describe a method for evaluating the quality of im…
An Empirical Study of Building the Evaluation Capacity of K–12 Site-Managed Project Personnel
This article examines the effects of professional development, including formal workshops and ongoing consultation, on the evaluation capacity of K–12 school faculty and administrators who were conducting evaluations of 17 site-managed projects. Changes in the faculty’s and administrators’ (a) attitudes toward evaluation, (b) self-confidence as evaluators, and (c) assessments of their capabilities as evaluators were examined. School personnel’s a…
Two Versions of the Contrasting-Groups Standard-Setting Method: A Review
This article reviews the literature on the contrasting-groups standard-setting method and describes 2 versions of the method—the person-focused version and the response-focused version. Of the 2, the response-focused version is preferable. It can be enhanced by adopting some practices of the modified Angoff method
A meta-evaluation of schools' methods for selecting site-managed projects
Stakeholder Participation for the Purpose of Helping Ensure Evaluation Validity: Bridging the Gap Between Collaborative and Non-collaborative Evaluations
Collaborative evaluations, in which program stakeholders participate extensively, typically are conducted for the primary purpose of enhancing the use of evaluation findings, and non-collaborative evaluations, in which stakeholders do not participate extensively, typically are conducted for the primary purpose of generating valid findings. This article shows how the gap can be bridged between these two types of evaluations. The article synthesize…
Stakeholder participation for the purpose of helping ensure evaluation validity: Bridging the gap between collaborative and non-collaborative evaluations
Evaluators' Use of Peer Debriefing: Three Impressionist Tales
Program evaluators are sometimes requested to help their clients identify ways to use evaluation findings, but little guidance for this task has been provided in the literature. How might evaluators grapple with this dilemma? This article discusses the use of peer debriefing as a method for helping evaluators during the final stage of the evaluation of a curriculum in a school of a large state university and presents the implications of these fin…
Gender differences in young Asian Americans' educational attainments
Children’s Mathematics Achievement in Hawaii: Sex Differences Favoring Girls
Most reviews of the literature have concluded that boys have surpassed girls in mathematics achievement at some point in their schooling. In Hawaii, however, some studies have suggested that sex differences in mathematics achievement have favored girls. In this paper, norm-referenced mathematics achievement test results for Hawaii public school students in four ethnic groups and four grades are examined for sex differences. Results are examined f…
Children's Mathematics Achievement in Hawaii: Sex Differences Favoring Girls
Most reviews of the literature have concluded that boys have surpassed girls in mathematics achievement at some point in their schooling. In Hawaii, however, some studies have suggested that sex differences in mathematics achievement have favored girls. In this paper, norm-referenced mathematics achievement test results for Hawaii public school students in four ethnic groups and four grades are examined for sex differences. Results are examined f…
Gender differences in young Asian Americans' educational attainments
Stakeholder Participation for the Purpose of Helping Ensure Evaluation Validity: Bridging the Gap Between Collaborative and Non-collaborative Evaluations
Collaborative evaluations, in which program stakeholders participate extensively, typically are conducted for the primary purpose of enhancing the use of evaluation findings, and non-collaborative evaluations, in which stakeholders do not participate extensively, typically are conducted for the primary purpose of generating valid findings. This article shows how the gap can be bridged between these two types of evaluations. The article synthesize…
The State of the Empirical Research Literature on Stakeholder Involvement in Program Evaluation
Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical studies as the first step in establishing a firm foundation for a discussion of stakeholder involvem…
Evaluation Exemplar: The Critical Importance of Stakeholder Relations in a National, Experimental Abstinence Education Evaluation
This piece describes Mathematicaâ€TMs abstinence education evaluation, provides interviews with the evaluationâ€TMs two lead authors (Trenholm and Devaney), and offers reflections on the study
Stakeholder participation for the purpose of helping ensure evaluation validity: Bridging the gap between collaborative and non-collaborative evaluations
The Strength of the Methodological Warrants for the Findings of Research on Program Evaluation Use
Considerable research has been conducted on the use of the findings of program evaluation, but little, if any, attention has been paid to the soundness of the methods of this research. If the methods are not sound or not well described in the research, the strength of the conclusions of the research is unknown. The authors examine the empirical studies reported in five widely cited reviews of the literature on program evaluation use and summarize…
Evaluators' Use of Peer Debriefing: Three Impressionist Tales
Program evaluators are sometimes requested to help their clients identify ways to use evaluation findings, but little guidance for this task has been provided in the literature. How might evaluators grapple with this dilemma? This article discusses the use of peer debriefing as a method for helping evaluators during the final stage of the evaluation of a curriculum in a school of a large state university and presents the implications of these fin…
Children’s Mathematics Achievement in Hawaii: Sex Differences Favoring Girls
Most reviews of the literature have concluded that boys have surpassed girls in mathematics achievement at some point in their schooling. In Hawaii, however, some studies have suggested that sex differences in mathematics achievement have favored girls. In this paper, norm-referenced mathematics achievement test results for Hawaii public school students in four ethnic groups and four grades are examined for sex differences. Results are examined f…
Looking Ahead: The Future of Evaluation
SAS Code for Calculating Intraclass Correlation Coefficients and Effect Size Benchmarks for Site-Randomized Education Experiments
When evaluators plan site-randomized experiments, they must conduct the appropriate statistical power analyses. These analyses are most likely to be valid when they are based on data from the jurisdictions in which the studies are to be conducted. In this method note, we provide software code, in the form of a SAS macro, for producing statistical power analyses using such data. The macro is designed to estimate statistical parameters for multiple…
Aspects of Successful Evaluation Practice at an Established Private Evaluation Firm
The Complexity of Measuring the Quality of Program Implementation With Observations: The Case of Middle School Inquiry-Based Science
In the growing literature on the evaluation of program implementation, less has been said about evaluating program quality than about evaluating other aspects of program implementation. Furthermore, most articles and reports in the program-implementation evaluation literature have presented only brief descriptions of how implementation instruments have been developed. In this article, the authors describe a method for evaluating the quality of im…
Children’s Mathematics Achievement in Hawaii: Sex Differences Favoring Girls
Most reviews of the literature have concluded that boys have surpassed girls in mathematics achievement at some point in their schooling. In Hawaii, however, some studies have suggested that sex differences in mathematics achievement have favored girls. In this paper, norm-referenced mathematics achievement test results for Hawaii public school students in four ethnic groups and four grades are examined for sex differences. Results are examined f…
Children's Mathematics Achievement in Hawaii: Sex Differences Favoring Girls
Most reviews of the literature have concluded that boys have surpassed girls in mathematics achievement at some point in their schooling. In Hawaii, however, some studies have suggested that sex differences in mathematics achievement have favored girls. In this paper, norm-referenced mathematics achievement test results for Hawaii public school students in four ethnic groups and four grades are examined for sex differences. Results are examined f…
Gender differences in young Asian Americans' educational attainments
A meta-evaluation of schools' methods for selecting site-managed projects
Stakeholder Participation for the Purpose of Helping Ensure Evaluation Validity: Bridging the Gap Between Collaborative and Non-collaborative Evaluations
Collaborative evaluations, in which program stakeholders participate extensively, typically are conducted for the primary purpose of enhancing the use of evaluation findings, and non-collaborative evaluations, in which stakeholders do not participate extensively, typically are conducted for the primary purpose of generating valid findings. This article shows how the gap can be bridged between these two types of evaluations. The article synthesize…
Stakeholder participation for the purpose of helping ensure evaluation validity: Bridging the gap between collaborative and non-collaborative evaluations
Evaluators' Use of Peer Debriefing: Three Impressionist Tales
Program evaluators are sometimes requested to help their clients identify ways to use evaluation findings, but little guidance for this task has been provided in the literature. How might evaluators grapple with this dilemma? This article discusses the use of peer debriefing as a method for helping evaluators during the final stage of the evaluation of a curriculum in a school of a large state university and presents the implications of these fin…
Two Versions of the Contrasting-Groups Standard-Setting Method: A Review
This article reviews the literature on the contrasting-groups standard-setting method and describes 2 versions of the method—the person-focused version and the response-focused version. Of the 2, the response-focused version is preferable. It can be enhanced by adopting some practices of the modified Angoff method
An Empirical Study of Building the Evaluation Capacity of K–12 Site-Managed Project Personnel
This article examines the effects of professional development, including formal workshops and ongoing consultation, on the evaluation capacity of K–12 school faculty and administrators who were conducting evaluations of 17 site-managed projects. Changes in the faculty’s and administrators’ (a) attitudes toward evaluation, (b) self-confidence as evaluators, and (c) assessments of their capabilities as evaluators were examined. School personnel’s a…
The Complexity of Measuring the Quality of Program Implementation With Observations: The Case of Middle School Inquiry-Based Science
In the growing literature on the evaluation of program implementation, less has been said about evaluating program quality than about evaluating other aspects of program implementation. Furthermore, most articles and reports in the program-implementation evaluation literature have presented only brief descriptions of how implementation instruments have been developed. In this article, the authors describe a method for evaluating the quality of im…
Participatory Evaluation as Seen in a Vygotskian Framework
In participatory evaluations of K–12 programs, evaluators develop school faculty’s and administrators’ evaluation capacity by training them to conduct evaluation tasks and providing consultation while the tasks are conducted. A strong case can be made that the capacity building in these evaluations can be examined using a Vygotskian approach. We conducted participatory evaluations at 9 Hawaii public schools and collected data on the extent to whi…
The Strength of the Methodological Warrants for the Findings of Research on Program Evaluation Use
Considerable research has been conducted on the use of the findings of program evaluation, but little, if any, attention has been paid to the soundness of the methods of this research. If the methods are not sound or not well described in the research, the strength of the conclusions of the research is unknown. The authors examine the empirical studies reported in five widely cited reviews of the literature on program evaluation use and summarize…
Evaluation Exemplar: Exemplary Aspects of a Small Group-Randomized Local Educational Program Evaluation
Evaluation Exemplar: The Critical Importance of Stakeholder Relations in a National, Experimental Abstinence Education Evaluation
This piece describes Mathematicaâ€TMs abstinence education evaluation, provides interviews with the evaluationâ€TMs two lead authors (Trenholm and Devaney), and offers reflections on the study
Looking Ahead: The Future of Evaluation
Aspects of Successful Evaluation Practice at an Established Private Evaluation Firm
Five Years of HHS Home Health Care Evaluations: Using Evaluation to Change National Policy
The development, validation, and potential uses of the Student Interest-in-the-Arts Questionnaire
The State of the Empirical Research Literature on Stakeholder Involvement in Program Evaluation
Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical studies as the first step in establishing a firm foundation for a discussion of stakeholder involvem…
Monitoring and Evaluation of African Women in Agricultural Research and Development (Award): An Exemplar of Managing for Impact in Development Evaluation
SAS Code for Calculating Intraclass Correlation Coefficients and Effect Size Benchmarks for Site-Randomized Education Experiments
When evaluators plan site-randomized experiments, they must conduct the appropriate statistical power analyses. These analyses are most likely to be valid when they are based on data from the jurisdictions in which the studies are to be conducted. In this method note, we provide software code, in the form of a SAS macro, for producing statistical power analyses using such data. The macro is designed to estimate statistical parameters for multiple…
Program Evaluation
The profession of educational and social program evaluation has expanded exponentially around the globe since the mid-1960s and continues to receive the considerable attention of theorists, methodologists, and practitioners. The literature on it is wide and deep, reflecting an array of definitions and conceptions of purpose and social role. This chapter discusses these topics and several others, including opinions about the choice of methods, som…
Psychology (21 works) · Evaluation and Performance Assessment (14 works) · Computer Science (12 works) · Engineering (11 works) · Evaluation methods (11 works) · Political science (11 works) · Program evaluation (9 works) · Medicine (7 works) · Sociology (7 works) · Applied Psychology (6 works)