Bias hypotheses under scrutiny

To advance the discussion on the validity of student evaluations of university teaching, student ratings of two teaching dimensions – student involvement and rapport – were compared with corresponding observer ratings. Seven potential bias variables were tested with regard to their impact on the students’ teaching assessment: three teacher characteristics (first impression, enthusiasm, humour) and four student characteristics (prior interest, expected grades, study experience, class attendance). Bias was defined as an impediment of the students’ assessment of teaching on course level. By means of bivariate correlations with course averages and two-level latent moderated structural equations, data of 1,716 students in 80 courses were analysed. Results showed that all three teacher characteristics were genuinely connected to rapport, and even explained variance of the student-rated variable when controlling for observer-rated rapport. The assessment of student involvement was not modified by the teacher characteristics except for teacher enthusiasm, which affected the student evaluation when controlling for observed involvement and, moreover, moderated the relation between the observed and the student-rated variable. For the examined student characteristics, no biasing effects were found – neither on rapport nor on student involvement

Developmental psychology · Higher education · Mathematics education · Pedagogy · Political science · Psychometrics · Scrutiny · Test validity · Evaluation of Teaching Practices · Psychology · Reflective Practices in Education · Social Psychology · Student Assessment and Feedback

• Evaluating Student Evaluations of Teaching

  Open Access•Rebecca J Kreitzer, Jennie Sweet-Cushman•Journal of Academic Ethics•2022

  Incluir item

• On the Validity of Student Evaluation of Teaching

  Open Access•Pieter Spooren, Bert Brockx et al.•Review of Educational Research•2013

  Incluir item

• Students’ Evaluations of University Teaching

  Herbert W Marsh•The Scholarship of Teaching and…•2007

  Incluir item

• Student Evaluations of Teaching: Are They Related to What Students Learn?

  Open Access•Dennis E Clayson•Journal of Marketing Education•2009

  Incluir item

• Multilevel structural equation models for assessing moderation within and across levels of analysis.

  Kristopher J Preacher, Zhen Zhang et al.•Psychological Methods•2016

  Incluir item

• Students' evaluations of University teaching

  Open Access•Herbert W Marsh•International Journal of…•1987

  Incluir item

• An Explanation of the Relationship between Instructor Humor and Student Learning

  Melissa Bekelja Wanzer, Ann Bainbridge Frymier et al.•Communication Education•2010

  Incluir item

• Student Ratings of Instruction and Student Achievement

  Open Access•Peter A Cohen•Review of Educational Research•1981

  Incluir item

• Statistical power analyses using G*Power 3.1

  Open Access•Franz Faul, Edgar Erdfelder et al.•Behavior Research Methods•2009

  Incluir item

• Meta-analysis of faculty's teaching effectiveness

  Open Access•Bob Uttl, Carmela A White et al.•Studies In Educational Evaluation•2017

  Incluir item

• The Validity of Student Evaluation of Teaching in Higher Education

  Mark Shevlin, Philip Banyard et al.•Assessment & Evaluation in Higher…•2000

  Incluir item

• Ratings of university teacher instruction

  Tanya Beran, Claudio Violato•Assessment & Evaluation in Higher…•2005

  Incluir item

• Navigating student ratings of instruction

  Sylvia d’Apollonia, Sylvia d'Apollonia et al.•American Psychologist•1997

  Incluir item

• Variables associated with achievement in higher education

  Michael Schneider, Franzis Preckel•Psychological Bulletin•2017

  Incluir item

• Making students' evaluations of teaching effectiveness effective

  Herbert W Marsh, Lawrence A Roche•American Psychologist•1997

  Incluir item

• Thick slice and thin slice teaching evaluations

  Open Access•Gail Tom, Stephanie Tom Tong et al.•Social Psychology of Education•2009

  Incluir item

• Don't Worry, Be Happy

  Michael Delucchi•Teaching Sociology•2000

  Incluir item

• Half a minute

  Nalini Ambady, Robert Rosenthal•Journal of Personality and Social…•1993

  Incluir item