Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

The Test Matters

The Relationship Between Classroom Observation Scores and Teacher Value Added on Multiple Types of Assessment

Bibliographic Data

ID9734405
AuthorsPam Grossman (Stanford University, Stanford, CA, corresponding author), Julie Cohen (0000-0001-6794-7993, University of Virginia, Charlottesville, Va), Matthew Ronfeldt (0000-0003-1702-1812, University of Michigan, Ann Arbor, MI), Lindsay Brown (0000-0002-2790-5112, Stanford University, Stanford, CA)
Year2014
Volume43
Issue6
Pages293-303
Publication date2014-08-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational Researcher (JOURNAL)
Journal identifiersISSN: 0013-189X • E-ISSN: 1935-102X
PublisherAmerican Educational Research Association (AERA) (PUBLISHER)
DOI10.3102/0013189x14544542
OpenAlexW2133352432
LanguageEN
Citations received45
References cited28

In this study, we examined how the relationships between one observation protocol, the Protocol for Language Arts Teaching Observation (PLATO), and value-added measures shift when different tests are used to assess student achievement. Using data from the Measures of Effective Teaching Project, we found that PLATO was more strongly related to the Stanford Achievement Test (SAT-9), the alternative assessment used by MET to assess more ambitious outcomes. We also found that the SAT-9 is more instructionally sensitive to the PLATO factor of Cognitive and Disciplinary Demand than the state tests used in MET study. This difference suggests that PLATO factors designed specifically to identify ambitious instructional practices are especially sensitive to which test is used to construct value-added scores

Academic achievement · Achievement test · Cognition · Construct (python library · Discipline · Language arts · Mathematics education · Protocol (science · Social science · Sociology · Standardized test · Statistics · Test (biology · Value (mathematics · Computer Science · Evaluation of Teaching Practices · Mathematics · Psychology · School Choice and Performance · Student Assessment and Feedback

  • Evaluating the validity evidence surrounding use of value-added models to evaluate teachers

    Open Access•Audrey Amrein-Beardsley, Matthew Ryan Lavery et al.•Education Policy Analysis Archives•2023

  • Principal evaluation in the United States

    Open Access•Sarah R Nielsen, Alyson L Lavigne•Education Policy Analysis Archives•2020

  • A Vicious Cycle

    Open Access•Jason A Okonofua, Gary M Walton et al.•Perspectives on Psychological…•2016

  • Qualities of classroom observation systems

    Courtney Bell, Marjoleine J Dobbelaer et al.•School Effectiveness and School…•2019

  • Validating automated assessments of teaching effectiveness using multimodal data

    Open Access•Tim Fütterer, Ruikun Hou et al.•Learning and Instruction•2026

  • Using global observation protocols to inform research on teaching effectiveness and school improvement

    Open Access•Sean Kelly, Robert Bringe et al.•Education Policy Analysis Archives•2020

  • How has teaching effectiveness been conceptualized? Questioning the consistency between definition and measure

    Open Access•Samantha Taylor, Stéphane Thion•Frontiers in Education•2023

  • The sizzle and fizzle of teacher evaluation in the United States and the selective use of research evidence

    Open Access•Drew H Gitomer, Brittany L Marshall•Frontiers in Education•2023

  • Observing Instructional Practice

    Open Access•Mark White, Armin Jentsch et al.•Education Sciences•2026

  • Quality of teaching and learning

    Open Access•J Dejaeghere, Bich-Hang Duong et al.•Educational Research for Policy…•2023

  • The Challenge of Measuring Instructional Coach Effectiveness

    Open Access•Michelle Doughty, Mimi Engel et al.•Educational Policy•2025

  • The Change We Cannot See

    Open Access•Julie Cohen, Ethan Hutt et al.•Educational Policy•2022

  • Do all students benefit equally from the supply and use of cognitively activating teaching? Introducing students’ cognitive processing skills into the equation

    Open Access•Charalambos Y Charalambous, Sergios Sergiou et al.•International Journal of…•2025

  • Value-Added Model (VAM) Scholars on Using VAMs for Teacher Evaluation After the Passage of the Every Student Succeeds Act

    Open Access•Matthew Ryan Lavery, Audrey Amrein-Beardsley et al.•Teachers College Record The Voice…•2020

  • School-to-School Differences in Instructional Practice

    Open Access•Sean Kelly, Sean G Kelly et al.•Teachers College Record The Voice…•2020

  • The Cares classroom observation tool

    Open Access•Meredith P Franco, Jessika H Bottiani et al.•Journal of School Psychology•2024

  • Accounting for learning environments in academic screening

    Open Access•Adam Lekwa, Adam J Lekwa et al.•Journal of School Psychology•2025

  • Development and validation of an observation protocol for measuring science teachers' modeling‐based teaching performance

    Open Access•Fan Shi, Lei Wang et al.•Journal of Research in Science…•2021

  • Measuring Text-Focused Reading Instruction

    Open Access•Julie Cohen, Luke C Miller et al.•Journal of Education•2024

  • Shifting Teacher Evaluation Systems to Community Answerability Systems

    Shanyce L Campbell•The Educational Forum•2022

  • Engagement, achievement, and teacher classroom practices in mathematics

    Open Access•Yuan Zhang, Shannon Russell et al.•Studies In Educational Evaluation•2022

  • Working more collaboratively to better understand teaching and its quality

    Open Access•Charalambos Y Charalambous, Anna‐Katharina Praetorius et al.•Studies In Educational Evaluation•2021

  • What About the “Instruction” in Instructional Sensitivity? Raising a Validity Issue in Research on Instructional Sensitivity

    Open Access•Marsha Ing•Educational and Psychological…•2018

  • Methodological Concerns About the Education Value-Added Assessment System (Evaas)

    Open Access•Audrey Amrein-Beardsley, Tray Geiger•SAGE Open•2020

  • The impact of specialised content courses on student teaching in a Norwegian teacher education programme

    Open Access•Magne Olufsen, Solveig Karlsen et al.•Education Inquiry•2021

  • Quality of the stated purpose and the use of feedback in Icelandic lower-secondary classrooms results from a video study

    Open Access•Birna María Svanbjörnsdóttir, B Svanbjörnsdóttir et al.•Teaching and Teacher Education•2022

  • Practices that cross disciplines

    Open Access•Julie Cohen•Teaching and Teacher Education•2017

  • Teacher feedback on procedural skills, conceptual understanding, and mathematical practices

    Open Access•Roar Bakken Stovner, Kirsti Klette•Teaching and Teacher Education•2021

  • The development of ambitious instruction

    Open Access•Peter Youngs, Lauren Molloy Elreda et al.•Teaching and Teacher Education•2021

  • Three types of subject-specificity. Exploring differences in the measurement of teaching quality across Norwegian mathematics and language arts classrooms

    Open Access•Armin Jentsch, Mark White et al.•Teaching and Teacher Education•2025

  • The impact of observable and perceived features of instruction on student achievement

    Open Access•Michael Tengberg, Gustaf B Skar et al.•Teaching and Teacher Education•2024

  • An investigation of supporting teacher learning in the context of a common decomposition for leading mathematics discussions

    Open Access•Meghan Shaughnessy, Hala Ghousseini et al.•Teaching and Teacher Education•2019

  • Missed opportunities of text-based instruction

    Open Access•Michael Tengberg, Marte Blikstad‐bala et al.•Teaching and Teacher Education•2022

  • How beginning elementary teachers’ mathematics instructional quality is associated with similarities between student teaching and first-year teaching assignments

    Open Access•Peter Youngs, Jason M Miller et al.•Teaching and Teacher Education•2025

  • Respecting complexity in measures of teaching

    Open Access•Julie Cohen, Pam Grossman•Teaching and Teacher Education•2016

  • Relationships between Observations of Elementary Mathematics Instruction and Student Achievement

    Kathleen Lynch, Kathleen S Lynch et al.•American Journal of Education•2017

  • First-Year Teacher Needs in the Urban Classroom

    Open Access•Megan Svajda-Hardy, Andrew Kwok•The Urban Review•2024

  • First‐Year Teachers’ Informational Reading Instruction

    Open Access•Alexa M Quinn, Judy Paulick et al.•Reading Research Quarterly•2022

  • Describing Profiles of Instructional Practice

    Open Access•Peter F Halpin, Michael J Kieffer•Educational Researcher•2015

  • Houston, We Have a Lawsuit”

    Open Access•Mark A Paige, Audrey Amrein-Beardsley•Educational Researcher•2020

  • Observational Evaluation of Teachers

    Open Access•Shanyce L Campbell, Matthew Ronfeldt•American Educational Research…•2018

  • Examining Clinical Teaching Observation Scores as a Measure of Preservice Teacher Quality

    Open Access•Brendan Bartanen, Andrew Kwok•American Educational Research…•2021

  • Teacher Collaboration in Instructional Teams and Student Achievement

    Open Access•Matthew Ronfeldt, Susanna Owens Farmer et al.•American Educational Research…•2015

  • Rating Teachers Cheaper, Faster, and Better

    Open Access•Thomas L Good, Alyson L Lavigne•Journal of Teacher Education•2015

  • Capturing the Complex, Situated, and Active Nature of Teaching Through Inquiry-Oriented Standards for Teaching

    Open Access•Claire Sinnema, Frauke Meyer et al.•Journal of Teacher Education•2017

  • The Long-Term Impacts of Teachers

    Raj Chetty, John Friedman et al.•National Bureau of Economic…•2011

  • Teaching Effectiveness Research in the Past Decade

    Open Access•Tina Seidel, Richard J Shavelson•Review of Educational Research•2007

  • An Argument Approach to Observation Protocol Validity

    Courtney A Bell, Courtney Bell et al.•Educational Assessment•2012

  • The Impact of Individual Teachers on Student Achievement

    Jonah E Rockoff, Jonah Rockoff•American Economic Review•2004

  • Mathematical Knowledge for Teaching and the Mathematical Quality of Instruction

    Heather C Hill, Heather Hill et al.•Cognition and Instruction•2008

  • Instructional Discourse, Student Engagement, and Literature Achievement

    Martin Nystrand, Adam Gamoran•Research in the Teaching of English•1991

  • Teacher value‐added

    Open Access•Douglas N Harris•Journal of Policy Analysis and…•2009

  • The effects of NBPTS‐certified teachers on student achievement

    Open Access•Douglas N Harris, Tim R Sass•Journal of Policy Analysis and…•2008

  • Evaluating value‐added models

    Open Access•Heather Hill•Journal of Policy Analysis and…•2009

  • Measure for Measure

    Pam Grossman, Susanna Loeb et al.•American Journal of Education•2013

  • Opening Dialogue

    Lisa H MacNeilley, Martin Nystrand et al.•Language•1998

  • Assessments and Accountability

    Open Access•Robert L Linn•Educational Researcher•2000

  • Different Tests, Different Answers

    Open Access•John P Papay•American Educational Research…•2011

  • A Validity Argument Approach to Evaluating Teacher Value-Added Scores

    Open Access•Heather C Hill, Heather Hill et al.•American Educational Research…•2011

  • A Course on Effective Teacher-Child Interactions

    Open Access•Bridget K Hamre, Robert C Pianta et al.•American Educational Research…•2012

  • Classroom Effects on Children’s Achievement Trajectories in Elementary School

    Open Access•Robert C Pianta, J Belsky et al.•American Educational Research…•2008

  • Comparing correlated correlation coefficients

    Xiao-Li Meng, Robert Rosenthal et al.•Psychological Bulletin•1992

  • Do We Know a Successful Teacher When We See One? Experiments in the Identification of Effective Teachers

    Open Access•Michael Strong, John Gargani et al.•Journal of Teacher Education•2011

Unique citing works45
Citations per year4,09
Citation span2015 - 2026 (12)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 43

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae