Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Strengthening the Research Base That Informs STEM Instructional Improvement Efforts

A Meta-Analysis

Bibliographic Data

ID23354579
AuthorsKathleen Lynch (0000-0001-8413-0969, Annenberg Institute at Brown University), Kathleen S Lynch (0000-0001-6344-7430, Annenberg Institute at Brown University), Heather Hill (0000-0001-5181-1573), Kathryn E Gonzalez, Cynthia Pollard (Harvard Graduate School of Education)
Year2019
Volume41
Issue3
Pages260-293
Publication date2019-09-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational Evaluation and Policy Analysis (JOURNAL)
Journal identifiersISSN: 0162-3737 • E-ISSN: 1935-1062
PublisherAmerican Educational Research Association (AERA) (PUBLISHER)
DOI10.3102/0162373719849044
LanguageEN
Citations received56
References cited58

We present results from a meta-analysis of 95 experimental and quasi-experimental pre-K–12 science, technology, engineering, and mathematics (STEM) professional development and curriculum programs, seeking to understand what content, activities, and formats relate to stronger student outcomes. Across rigorously conducted studies, we found an average weighted impact estimate of +0.21 standard deviations. Programs saw stronger outcomes when they helped teachers learn to use curriculum materials; focused on improving teachers’ content knowledge, pedagogical content knowledge, and/or understanding of how students learn; incorporated summer workshops; and included teacher meetings to troubleshoot and discuss classroom implementation. We discuss implications for policy and practice.

  • Identifying the characteristics of effective teacher professional development

    Sam Sims, Harry Fletcher-Wood•School Effectiveness and School…•2021

  • When Effective teacher training falls short in the classroom

    Open Access•Suzanne Bellue, Adrien Bouguen et al.•Economics of Education Review•2024

  • Out-of-field teaching and professional learning opportunities

    Julie A Luft, Paulo A C Loureiro et al.•Professional Development in…•2026

  • Teacher Professional Development and Student Reasoning

    Open Access•Risa Haridza, Lin Ding•Journal of Science Teacher…•2026

  • Learn-Modify-Implement-Reflect

    Martha Inouye, R Summers et al.•Journal of Science Teacher…•2026

  • Tasks as mediators for advancing strategy flexibility in equation solving

    Open Access•Christian Rüede, Maurus Küttel et al.•Mathematics Education Research…•2026

  • Design and effectiveness of professional development programmes to support teachers in promoting students’ scientific inquiry competencies

    Open Access•Richard Sannert, Armin Baur et al.•Studies in Science Education•2026

  • The Effects of Early Childhood Science Educational Interventions on Children’s Science Achievement

    Kathleen A Lynch, Kathleen Lynch et al.•The Elementary School Journal•2026

  • Invalid estimates and biased means. A replication of a recent meta-analysis investigating the effect of teacher professional development on pupil outcomes

    Open Access•Joshua Fullard•Social Sciences & Humanities Open•2023

  • Supporting a state in developing a working theory of improvement for promoting equity in science education

    Open Access•W R Penuel, Tiffany Neill et al.•Frontiers in Education•2025

  • Does Increased Choice over Learning Topic Improve the Effectiveness of Automated Feedback for Educators

    Open Access•Dorottya Demszky, Heather Hill et al.•Education Sciences•2025

  • Supporting Multilingual Students’ Mathematical Discourse Through Teacher Professional Development Grounded in Design-Based Research

    Open Access•Margarita Jimenez‐Silva, Robin Martin et al.•Education Sciences•2025

  • The Impact of Online Video-Based Teacher Professional Development on Instructional Practices and Student Achievement in Biology

    Open Access•Irena Labak, Branko Bognar et al.•Education Sciences•2025

  • Teacher Professional Development and Student Mathematics Achievement

    Open Access•Soyoung Park, Young Ri Lee et al.•Education Sciences•2025

  • Designing Resilient STEM Trajectories

    Open Access•Albert Ziegler, Heidrun Stoeger•Education Sciences•2026

  • Does professional development for online instruction improve student course outcomes

    Open Access•Xuehan Zhou, Qiujie Li et al.•The Internet and Higher Education•2025

  • Supporting teachers through curriculum-based professional learning

    Katherine L Mcneill, Renee Affolter et al.•Journal of the Learning Sciences•2025

  • The impact of AI-enhanced interactive learning environments on EFL teachers’ computational thinking pedagogical knowledge

    Xiang Xu, Akbar Bahari•Interactive Learning Environments•2026

  • STEM education in academic achievement

    Shu-Hsuan Chang, Lee-Jen Yang et al.•Interactive Learning Environments•2022

  • Professional development of science teachers in Latin America

    Tatiana Iveth Salazar-López, Gonzalo Peñaloza•International Journal of Science…•2024

  • Professional Learning Partnerships as a Policy Mechanism for School Improvement

    Open Access•Kirsten Lee Hill, Laura M Desimone et al.•Educational Policy•2026

  • Effects of online teacher professional development on teacher-, classroom-, and student-level outcomes

    Open Access•Fitore Morina, Tim Fütterer et al.•Computers & Education•2025

  • Trends and exemplary practices of STEM teacher professional development programs in K-12 contexts

    Open Access•Biyun Huang, Morris Siu‐Yung Jong et al.•Computers & Education•2022

  • Australian teachers’ views on how primary science education can be improved

    Open Access•James Deehan, Amy MacDonald•The Australian Educational…•2024

  • Primary school mathematics leaders as brokers of professional learning

    Catherine Gripton, Andrew Noyes et al.•Cambridge Journal of Education•2026

  • Effects of digital games on student motivation in mathematics

    Open Access•Daniela Fadda, Marta Pellegrini et al.•Journal of Computer Assisted…•2022

  • Supporting Professional Learning at Scale

    Open Access•Julie Cohen, Emily Wiseman•Teachers College Record The Voice…•2022

  • Changing the “Micros” of Teaching through Collaborative Inquiry

    Open Access•Ariel Tichnor-Wagner, Ada Okun et al.•Teachers College Record The Voice…•2025

  • A multimethod examination of hope and adolescent STEM career expectancies

    Open Access•Brittany L Alexander, Jayley Janssen et al.•Journal of Adolescence•2022

  • Leveraging curricular and students' resources to instigate and sustain problematizing

    Open Access•Mon‐Lin Monica Ko•Science Education•2021

  • Redesign or relabel? How a commercial curriculum and its implementation oversimplify key features of the NGSS

    Open Access•Benjamin R Lowell, Kevin Cherbow et al.•Science Education•2021

  • The student hat in professional development

    Open Access•Benjamin R Lowell•Science Education•2024

  • The Impact of Summer Programs on Student Mathematics Achievement

    Open Access•Kathleen Lynch, Kathleen S Lynch et al.•Review of Educational Research•2023

  • Effective Teacher Professional Development

    Open Access•Sam Sims, Harry Fletcher-Wood et al.•Review of Educational Research•2025

  • Professional development that improves STEM outcomes

    Open Access•Heather C Hill, Heather Hill et al.•Phi Delta Kappan•2020

  • Changes in teachers' beliefs

    Open Access•Benjamin R Lowell, Katherine L Mcneill•Journal of Research in Science…•2023

  • Early Impact of Teacher Leaders in a Networked Improvement Community on Middle School Mathematics Performance

    Rachel M Ruggirello, Rachel Ruggirello et al.•The Educational Forum•2026

  • Effectiveness of personnel and material implementation strategies

    Open Access•Jennifer Dröse, Rebekka Stahnke et al.•Studies In Educational Evaluation•2026

  • Science teachers’ implementation of science and engineering practices in different instructional settings

    Cheng-Wen He, Hong Tran et al.•International Journal of Science…•2024

  • Evidence bases to inform school improvement plans

    Carly Molloy, Ruth Beatson et al.•Research Papers in Education•2024

  • How and why do teachers’ participation in professional development and collaboration with colleagues differ across countries

    Open Access•Nils Kirsten•Studies In Educational Evaluation•2025

  • Broadening the Pool of Precollege Engineering Teachers

    Open Access•Medha Dalal, Adam R Carberry et al.•IEEE Transactions on Education•2022

  • Teachers’ Perceptions and Beliefs About STEAM Education

    Open Access•Laura Frentescu Tordai, Carmen Creţu et al.•Canadian Journal of Science…•2026

  • Supporting teachers to enact science talk in early elementary classrooms

    Open Access•Tanya S Wright, Amelia Wenk Gotwals et al.•Early Childhood Research Quarterly•2025

  • Effects of multicultural professional development and English learner percentage on STEM teachers’ instructional quality

    Open Access•Qiang Cheng, Xuan Zhou et al.•Teaching and Teacher Education•2026

  • How effective is the professional development in which teachers typically participate? Quasi-experimental analyses of effects on student achievement based on TIMSS 2003–2019

    Open Access•Nils Kirsten, Jannika Lindvall et al.•Teaching and Teacher Education•2023

  • Exploring effective teacher certificate requirements to benefit student achievement

    Open Access•Xin Xie, Xie Xin et al.•International Journal of…•2025

  • Feasibility and Acceptability of an Active Playful Learning Intervention for Kindergarten Teachers Using Instructional Coaching

    Open Access•Kimberly T Nesbitt, Elias Blinkoff et al.•Early Education and Development•2025

  • Using Implementation Fidelity to Aid in Interpreting Program Impacts

    Open Access•Heather Hill, Anna Erickson•Educational Researcher•2019

  • Navigating a Fractured Landscape

    Susan Patrick, Susan K Patrick et al.•American Journal of Education•2025

  • Unveiling effectiveness

    Open Access•Hyesun You, Sunyoung Park et al.•Journal of Research in Science…•2025

  • STEM Faculty Professional Development

    Open Access•Mary F McCarthy Hintz, Lynn M Tashiro et al.•Journal of Research in Science…•2025

  • The Application of Behavioral Economics to Teacher Professional Development

    Open Access•Kathleen Lynch, Kathleen S Lynch•Educational Researcher•2024

  • Interpreting Effect Sizes of Education Interventions

    Open Access•Matthew A Kraft•Educational Researcher•2020

  • Assessing Professional Development on Experimentation as a Method of Inquiry‐Based Science Teaching Framework and Principal Results

    Open Access•Markus Emden, Arne Bewersdorff et al.•Science Education•2025

  • Equipping Educators for Equity Through Ethnic‐Racial Identity Curriculum

    Open Access•Adriana J Umaña‐taylor, Stefanie Martinez‐fuente et al.•Journal of Community Psychology•2025

  • Systematic Reviews and Meta-Analysis

    Julia H Littell, Jacqueline Corcoran et al.•Systematic Reviews and…•2008

  • Learning Policy

    David K Cohen, Heather C Hill et al.•Learning Policy•2001

  • Next Generation Science Standards

    National Research Council, NGSS Lead States Staff•Next Generation Science Standards•2013

  • Estimating the Difference Between Published and Unpublished Effect Sizes

    Open Access•Joshua R Polanin, Emily E Tanner-Smith et al.•Review of Educational Research•2016

  • Academic Interventions for Elementary and Middle School Students With Low Socioeconomic Status

    Open Access•Jens Dietrichson, Martin Bøg et al.•Review of Educational Research•2017

  • Professional Development for Science Teachers

    Open Access•Suzanne M Wilson•Science•2013

  • Empirical Benchmarks for Interpreting Effect Sizes in Research

    Open Access•Carolyn J Hill, Howard S Bloom et al.•Child Development Perspectives•2008

  • Teacher Preparation and Student Achievement

    Open Access•Donald J Boyd, Donald Boyd et al.•Educational Evaluation and Policy…•2009

  • How Does Professional Development Improve Teaching?

    Open Access•Mary M Kennedy•Review of Educational Research•2016

  • Robust variance estimation with dependent effect sizes: practical considerations including a software tutorial in Stata and spss

    Open Access•Emily E Tanner-Smith, Elise Tipton et al.•Research Synthesis Methods•2014

  • Digital Games, Design, and Learning

    Open Access•Douglas B Clark, Emily E Tanner-Smith et al.•Review of Educational Research•2016

  • Experimental and Quasi-Experimental Studies of Inquiry-Based Science Teaching

    Open Access•Erin M Furtak, Tina Seidel et al.•Review of Educational Research•2012

  • Small-Sample Adjustments for Tests of Moderators and Model Fit Using Robust Variance Estimation in Meta-Regression

    Open Access•Elise Tipton, Elizabeth Tipton et al.•Journal of Educational and…•2015

  • A Primer on Effective Professional Development

    Open Access•Laura M Desimone•Phi Delta Kappan•2011

  • Trim and Fill

    Open Access•Sue Duval, Richard Tweedie et al.•Biometrics•2000

  • Bias in meta-analysis detected by a simple, graphical test

    Open Access•Matthias Egger, Gregory D Smith et al.•BMJ•1997

  • Preferred Reporting Items for Systematic Reviews and Meta-Analyses

    Open Access•David Moher, Alessandro Liberati et al.•PLoS Medicine•2009

  • Handling Complex Meta-analytic Data Structures Using Robust Variance Estimates

    Open Access•Emily E Tanner-Smith, Elise Tipton et al.•Journal of Developmental and…•2016

  • Those Who Understand

    Open Access•Lee S Shulman•Educational Researcher•1986

  • The Use and Validity of Standardized Achievement Tests for Evaluating New Curricular Interventions in Mathematics and Science

    Open Access•Joshua Sussman, Mark Wilson et al.•American Journal of Evaluation•2018

  • Systemic school reform

    Marshall S Smith, Jennifer O'Day et al.•Journal of Education Policy•1990

  • Using Social Network Analysis to Study How Collegial Interactions Can Augment Teacher Learning from External Professional Development

    W R Penuel, Min Sun et al.•American Journal of Education•2012

  • Reform by the Book

    Open Access•Deborah Loewenberg Ball, David K Cohen•Educational Researcher•1996

  • Anatomy of an Evidence Base

    Open Access•David Malouf, David B Malouf et al.•Educational Researcher•2016

  • Perspectives on Evidence-Based Research in Education—What Works? Issues in Synthesizing Educational Program Evaluations

    Open Access•Robert E Slavin•Educational Researcher•2008

  • Integration of Technology, Curriculum, and Professional Development for Advancing Middle School Mathematics

    Open Access•Jeremy Roschelle, Nicole Shechtman et al.•American Educational Research…•2010

  • Advancing Educational Policy by Advancing Research on Instruction

    Open Access•Stephen W Raudenbush•American Educational Research…•2008

  • An Efficacy Trial of Research-Based Curriculum Materials With Curriculum-Based Professional Development

    Open Access•Joseph A Taylor, Stephen R Getty et al.•American Educational Research…•2015

  • Impact of a Large-Scale Science Intervention Focused on English Language Learners

    Open Access•Lorena Llosa, Okhwa Lee et al.•American Educational Research…•2016

  • Improving Impact Studies of Teachers' Professional Development

    Open Access•Laura M Desimone•Educational Researcher•2009

  • Vote-counting methods in research synthesis

    Larry V Hedges, Ingram Olkin•Psychological Bulletin•1980

  • A Research Agenda for Online Teacher Professional Development

    Open Access•Christopher Dede, Chris Dede et al.•Journal of Teacher Education•2009

Unique citing works56
Citations per year8
Citation span2019 - 2026 (8)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 56

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae