The dimensionality of student ratings of teaching

The debate on the unidimensionality versus multidimensionality of students' ratings of teaching performance, and the relationship of this dilemma to summative and formative uses of these instruments is reviewed, with special attention to the implications of their development and application in the Spanish university system. A comprehensive theoretical framework, stressing the relation between effective teaching theory and the expected construct of teaching performance in students' view, is advanced. The structure of teaching competencies is analysed by means of confirmatory factor analysis (CFA) and similarity structure analysis (SSA) in two ratings forms, of 13 and 34 items. The forms were applied to large student samples from two Spanish universities, rating the performance of individual teachers. CFA and SSA show a common latent structure in the two samples, and support the conceptual distinction between aspects of teaching competence. The results suggest that the structure of the students' ratings can be interpreted as multidimensional as much as unidimensional. The reason for this apparent paradox is that some specific dimensions are more central (versus peripheral) in the construct of teaching skills. This structure is consistent with the conceptual framework, and would explain the ambiguity between unidimensional and multidimensional solutions of CFA outcomes. The implications of these results for the orientation of future research on the dimensionality of students' ratings and for their application in formative and summative evaluation of teaching are discussed. Acknowledgement This research was supported by project grant BSO2000‐1407 of the National Plan of R&D (2000–2003) of the Spanish Ministry of Education and Science

Confirmatory factor analysis · Construct validity · Developmental psychology · Formative assessment · Mathematics education · Multidimensional scaling · Psychometrics · Structural equation modeling · Summative assessment · Computer Science · Evaluation of Teaching Practices · Psychology · Social Psychology

• La calidad de la docencia percibida por el alumnado y el profesorado universitarios

  Open Access•María Castro-Morera, Enrique Navarro Asencio et al.•Educación XX1•2020

  Incluir item

• On the Validity of Student Evaluation of Teaching

  Open Access•Pieter Spooren, Bert Brockx et al.•Review of Educational Research•2013

  Incluir item

• Students’ Evaluations of University Teaching

  Herbert W Marsh•The Scholarship of Teaching and…•2007

  Incluir item

• Investigating Course Level Effects on Student Evaluations of Teaching in Higher Education

  Open Access•William M Bart, Mohammed A A Abulela et al.•Education Sciences•2026

  Incluir item

• Linking learner factors, teaching context, and engagement patterns with Mooc learning outcomes

  Open Access•Ruiqi Deng, Pierre Benckendorff et al.•Journal of Computer Assisted…•2020

  Incluir item

• Assessing the validity and reliability of a quick scan for student's evaluation of teaching. Results from confirmatory factor analysis and G Theory

  Open Access•Pieter Spooren, Dimitri Mortelmans et al.•Studies In Educational Evaluation•2014

  Incluir item

• Perceived autonomy support, intrinsic motivation, and student ratings of instruction

  Open Access•Bryan W Griffin•Studies In Educational Evaluation•2016

  Incluir item

• On the credibility of the judge

  Open Access•Pieter Spooren•Studies In Educational Evaluation•2010

  Incluir item

• An investigation of the factor structure of student ratings of teaching at a Midwestern public university in the USA

  William M Bart, Iclal Can•Assessment & Evaluation in Higher…•2022

  Incluir item

• University performance evaluations

  Rowan E Bedggood, Rowan Bedggood et al.•Studies in Higher Education•2012

  Incluir item

• Modern Multidimensional Scaling

  Open Access•Ingwer Borg, Patrick J F Groenen et al.•Modern Multidimensional Scaling•1997

  Incluir item

• Learning to Teach in Higher Education

  Paul Ramsden•Learning to Teach in Higher…•2002

  Incluir item

• Facet Theory

  Open Access•David Canter•Facet Theory•1985

  Incluir item

• A General Nonmetric Technique for Finding the Smallest Coordinate Space for a Configuration of Points

  Open Access•Louis Guttman•Psychometrika•1968

  Incluir item

• Students' evaluations of University teaching

  Open Access•Herbert W Marsh•International Journal of…•1987

  Incluir item

• Student Ratings of Instruction and Student Achievement

  Open Access•Peter A Cohen•Review of Educational Research•1981

  Incluir item

• Basics of Structural Equation Modeling

  Geoffrey Maruyama•Basics of structural equation…•1998

  Incluir item

• Does the Use of Student Feedback Questionnaires Improve the Overall Quality of Teaching

  David Kember, Doris Y P Leung et al.•Assessment & Evaluation in Higher…•2002

  Incluir item

• Nonmetric Factor Analysis

  JAMES C LINGOES, Louis Guttman•Multivariate Behavioral Research•1967

  Incluir item

• Current concerns are past concerns

  Philip C Abrami, Sylvia d’Apollonia et al.•American Psychologist•1999

  Incluir item

• Navigating student ratings of instruction

  Sylvia d’Apollonia, Sylvia d'Apollonia et al.•American Psychologist•1997

  Incluir item

• Making students' evaluations of teaching effectiveness effective

  Herbert W Marsh, Lawrence A Roche•American Psychologist•1997

  Incluir item

• The multidimensionality of students' evaluations of teaching effectiveness

  Open Access•Herbert W Marsh, Dennis Hocevar•Teaching and Teacher Education•1991

  Incluir item

• Mastering the Techniques of Teaching

  William J McCaslin, Joseph Lowman•Teaching Sociology•1985

  Incluir item

• Orientations to Teaching and Their Effect on the Quality of Student Learning

  David Kember, Lyn Gow•The Journal of Higher Education•1994

  Incluir item

• Student ratings

  Wilbert J Mckeachie•American Psychologist•1997

  Incluir item

• Learning to Teach in Higher Education

  Peter Lucas, Paul Ramsden•British Journal of Educational…•1992

  Incluir item

• Understanding Student Learning

  N C Graham, Nina Graham et al.•British Journal of Educational…•1984

  Incluir item

• Effective Teaching in Higher Education

  Alan Betjemann, A G Betjemann et al.•British Journal of Educational…•1989

  Incluir item

• The Use of Students’ Evaluations and an Individually Structured Intervention to Enhance University Teaching Effectiveness

  Open Access•Herbert W Marsh, Lawrence A Roche et al.•American Educational Research…•1993

  Incluir item

• The Factorial Invariance of Student Evaluations of College Teaching

  Open Access•Herbert W Marsh, Dennis Hocevar•American Educational Research…•1984

  Incluir item

• Goodness-of-fit indexes in confirmatory factor analysis

  Herbert W Marsh, John R Balla et al.•Psychological Bulletin•1988

  Incluir item

• On Qualitative Differences in Learning

  Open Access•Ference Marton, Roger Säljö•British Journal of Educational…•1976

  Incluir item

• Multidimensional scaling versus components analysis of test intercorrelations

  Mark L Davison•Psychological Bulletin•1985

  Incluir item

• Student ratings of instruction in the USA

  Elaine Kolitch, Elaine R Kolitch et al.•Studies in Higher Education•1999

  Incluir item