Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

The reliability and construct validity of student perceptions of teaching quality

Bibliographic Data

ID22419359
AuthorsHannah J E Bijlsma (0000-0001-8825-0167, Radboud University Nijmegen, corresponding author), Cees A W Glas (0000-0001-6531-5503, University of Twente; Faculty of Behavioural), Adrie J Visscher (0000-0001-8443-9878, University of Twente; Faculty of Behavioural)
Year2026
Volume33
Issue3
Pages306-328
Publication date2026-05-04
Open AccessYes
TypeARTICLE
VenueAssessment in Education: Principles, Policy & Practice (JOURNAL)
Journal identifiersISSN: 0969-594X • E-ISSN: 1465-329X
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/0969594x.2026.2677005
OpenAlexW7163219640
LanguageEN
Citations received1
References cited67

Student perceptions of teaching quality allow teachers to obtain feedback on their lessons. However, the reliability and validity of student perceptions of teaching quality are subject of scientific debate. In this study, data of 717 students, all aged 14 or 15 years, taught by 26 different mathematic teachers in The Netherlands were analysed to assess the construct validity of student perceptions, using a combined Item Response Theory and Generalizability Theory model. Moreover, the global and local reliability of the scores were investigated. Results support the construct validity of the data. It was also found that the student scores are reliable measures of teaching quality. Reliability is achieved, using a D-study, with a minimum of 5 students conducting 3 separate lesson ratings at different time points. The findings support the use of these perceptions for the rating and teacher development. Limitations of the study and suggestions for future research are presented.

Construct validity · Perception · Validity · Educational Environments and Student Outcomes · Evaluation of Teaching Practices · Teacher Education and Leadership Studies

  • Report cards and student learning

    Open Access•Christopher Deluca•Assessment in Education:…•2026

  • Visible Learning

    John Hattie•Visible Learning•2008

  • Generalizability Theory

    Open Access•Robert L Brennan•Generalizability Theory•2001

  • One lesson is all you need? Stability of instructional quality across lessons

    Open Access•Anna‐Katharina Praetorius, Christine Pauli et al.•Learning and Instruction•2014

  • Toward a Knowledge Base for School Learning

    Open Access•Margaret C Wang, Geneva D Haertel et al.•Review of Educational Research•1993

  • Full-Information Item Factor Analysis

    Open Access•R Darrell Bock, Robert D Gibbons et al.•Applied Psychological Measurement•1988

  • Generic dimensions of teaching quality

    Open Access•Anna‐Katharina Praetorius, Eckhard Klieme et al.•ZDM•2018

  • A Rasch Model for Partial Credit Scoring

    Open Access•Geoff N Masters•Psychometrika•1982

  • State of the art – teacher effectiveness and professional learning

    Daniel Muijs, Leonidas Kyriakides et al.•School Effectiveness and School…•2014

  • Educational effectiveness research (EER)

    David Reynolds, David O Reynolds et al.•School Effectiveness and School…•2014

  • Teaching Effectiveness Research in the Past Decade

    Open Access•Tina Seidel, Richard J Shavelson•Review of Educational Research•2007

  • Quality of teaching in four European countries

    Wim van De Grift•Educational Research•2007

  • Teacher Quality and Student Achievement

    Open Access•Linda Darling-Hammond•Education Policy Analysis Archives•2000

  • Measurement reliability and agreement in psychiatry

    Open Access•Patrick E Shrout•Statistical Methods in Medical…•1998

  • A Generalized Partial Credit Model

    Open Access•Eiji Muraki•Applied Psychological Measurement•1992

  • Who is the expert? Construct and criteria validity of student and teacher ratings of instruction

    Open Access•M Kunter, Jürgen Baumert•Learning Environments Research•2007

  • Student ratings of teaching quality in primary school

    Open Access•Benjamin Fauth, Jasmin Decristan et al.•Learning and Instruction•2014

  • Assessment and Classroom Learning

    Paul Black, Dylan Wiliam•Assessment in Education:…•1998

  • A Time-Varying Dynamic Partial Credit Model to Analyze Polytomous and Multivariate Time Series Data

    Open Access•Sebastian Castro-Alvarez, Laura F Bringmann et al.•Multivariate Behavioral Research•2024

  • The use of secondary school student ratings of their teacher’s skillfulness for low-stake assessment and high-stake evaluation

    Open Access•Rikkert M van der Lans, Ridwan Maulana•Studies In Educational Evaluation•2018

  • A Coefficient of Agreement for Nominal Scales

    Open Access•Jacob Cohen•Educational and Psychological…•1960

  • Making students' evaluations of teaching effectiveness effective

    Herbert W Marsh, Lawrence A Roche•American Psychologist•1997

  • The effect of changes in published secondary school admissions on pupil composition

    Rebecca Allen, John Coldron et al.•Journal of Education Policy•2012

  • Language and cultural factors in students' perceptions of teacher communication style

    Open Access•Jack Levy, Theo Wubbels et al.•International Journal of…•1997

  • Coefficient alpha and the internal structure of tests

    Open Access•Lee J Cronbach•Psychometrika•1951

  • Unskilled and unaware of it

    Justin Kruger, David Dunning•Journal of Personality and Social…•1999

  • Conceptualization, Measurement, and Improvement of Classroom Processes

    Open Access•Robert C Pianta, Bridget K Hamre•Educational Researcher•2009

  • When Rater Reliability Is Not Enough

    Open Access•Heather Hill, Charalambos Y Charalambous et al.•Educational Researcher•2012

  • Validity of psychological assessment

    Samuel Messick•American Psychologist•1995

  • The Power of Feedback

    Open Access•John Hattie, Helen Timperley•Review of Educational Research•2007

  • Construct validity in psychological tests

    Lee J Cronbach, Paul E Meehl•Psychological Bulletin•1955

  • Consensus in interpersonal perception

    D A Kenny, Linda Albright et al.•Psychological Bulletin•1994

Citations per year1
Citation span2026 - 2026 (1)
Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae