Toward understanding and quantifying halo in students’ evaluation of teaching
Bibliographic Data
| ID | 19378904 |
|---|---|
| Authors | John L Michela (0000-0002-2991-7264, University of Waterloo, corresponding author) |
| Year | 2023 |
| Volume | 48 |
| Issue | 4 |
| Pages | 438-450 |
| Publication date | 2023-05-19 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Assessment & Evaluation in Higher Education (JOURNAL) |
| Journal identifiers | ISSN: 0260-2938 • E-ISSN: 1469-297X |
| Publisher | Informa UK Limited (PUBLISHER • GB) |
| DOI | 10.1080/02602938.2022.2086965 |
| OpenAlex | W4283172079 |
| Language | EN |
| Citations received | 1 |
| References cited | 26 |
Despite its name, the halo effect in student evaluation of teaching (SET) response is not mystical. Halo in SET results from psychological processes that undermine SET validity, particularly for summative evaluation (pay decisions, etc.). These processes span psychological concepts of cognition, motivation and affect. This paper demonstrates that halo signals serious trouble for SET data, contrary to the conclusion in Cannon and Cipriani (2022 Cannon, E., and G. P. Cipriani. 2022. “Quantifying Halo Effects in Students’ Evaluation of Teaching.” Assessment & Evaluation in Higher Education 47 (1): 1–14. doi:https://doi.org/10.1080/02602938.2021.1888868.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), to which this article replies. Re-analysis of those authors’ findings, conducted for the present paper, reveals both more halo and less validity than Cannon and Cipriani reported. For re-analysis of their factor analysis, a practical, generalizable approach to gauging halo in various settings is proposed. This approach revealed consistently high apparent SET halo across various decades and geographical locations of SET use. For re-analysis of their multiple regression, an approach to deciphering individual variables’ effect sizes is provided for designs like Cannon and Cipriani’s. Implications discussed for summative use of SETs include issues of veracity of SET confidence intervals. In contrast to summative use, formative use (toward performance improvement) suffers less from halo because non-instructional factor influences are somewhat constant for individuals
Course evaluation · Evaluation methods · Halo · Higher education · Mathematics education · Pedagogy · Political science · Teaching method · Educational Environments and Student Outcomes · Online and Blended Learning · Psychology · Visual and Cognitive Learning Processes
Methods of Meta-Analysis
A First Course in Factor Analysis
Motivated Stereotyping of Women
Performance appraisal and performance management
Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom
Student evaluations of teaching (mostly) do not measure teaching effectiveness
Comment on Halo Effects in Rating and Evaluation Research
Student Evaluations of Teaching Encourages Poor Teaching and Contributes to Grade Inflation
Meta-analysis of faculty's teaching effectiveness
Quantifying halo effects in students’ evaluation of teaching
Gender Patterns in College Students' Choices of Their Best and Worst Professors
Women Are Teachers, Men Are Professors
Ubiquitous halo
| Unique citing works | 1 |
|---|---|
| Citations per year | 0.5 |
| Citation span | 2024 - 2024 (1) |
| Citation velocity | recent |
| Highly cited | No |
| Citation types | Neutral: 1 |