Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Evidence-Based Use of Cognitive Testing for Academic Interventions

A Critical Appraisal of Meta-Analytic Methodologies

Bibliographic Data

ID22166178
AuthorsScott L Decker (0000-0002-8085-7965, University of South Carolina, corresponding author), Jessica C Luedke (0000-0003-2671-0185, University of South Carolina)
Year2021
Volume6
Publication date2021-03-25
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueFrontiers in Education (JOURNAL)
Journal identifiersISSN: 2504-284X • E-ISSN: 2504-284X
PublisherFrontiers Media SA (PUBLISHER • CH)
DOI10.3389/feduc.2021.637676
OpenAlexW3141824392
LanguageEN
Citations received1
References cited226

Research suggests Specific Learning Disabilities (SLD) are directly linked to specific neurocognitive deficits that result in unexpected learning delays in academic domains for children in schools. However, meta-analytic studies have failed to find supporting evidence for using neurocognitive tests and, consequently, have discouraged their inclusion in SLD identification policies. The current study critically reviews meta-analytic findings and the methodological validity of over 200 research studies used in previous meta-analytic studies to estimate the causal effect of neurocognitive tests on intervention outcomes. Results suggest that only a very small percentage (6–12%) of studies used in previous meta-analytic studies were methodologically valid to estimate a direct effect of cognitive tests on academic intervention outcomes, with the majority of studies having no causal link between neurocognitive tests and intervention outcomes. Additionally, significant reporting discrepancies and inaccurate effect size estimates were found that warranted legitimate concerns for conclusions and policy recommendations provided in several meta-analytic studies. Given the lack of methodological rigor linking cognitive testing to academic interventions in current research, removing neurocognitive testing from learning disability evaluations may be premature. Suggestions for future studies evaluating the impact of neurocognitive tests on intervention outcomes as well as guidelines for synthesizing meta-analytic findings are discussed

Alternative medicine · Cognition · Cognitive Intervention · Cognitive psychology · Critical appraisal · Developmental psychology · Learning disability · Meta-analysis · Neurocognitive · Psychiatry · Psychological intervention · Attention Deficit Hyperactivity Disorder · Clinical Psychology · Cognitive and developmental aspects of mathematical skills · Medicine · Psychology · Reading and Literacy Development · Social Psychology

  • Supporting Children’s Working Memory Through Instructional Support in Primary School

    Open Access•Simona Sankalaite, Sophie Pollé et al.•Education Sciences•2025

  • The Handbook of Research Synthesis and Meta-Analysis

    Harris M Cooper, Jeff C Valentine et al.•Handbook of Research Synthesis…•2019

  • Are interventions theory-based? Development of a theory coding scheme.

    Susan Michie, Andrew Prestwich•Health Psychology•2010

  • Understanding, educating, and supporting children with specific learning disabilities

    Elena L Grigorenko, Donald L Compton et al.•American Psychologist•2020

  • Computerized Training of Working Memory in Children With ADHD-A Randomized, Controlled Trial

    Open Access•Travis Klingberg, Torkel Klingberg et al.•Journal of the American Academy…•2005

  • Preventing reading failure in young children with phonological processing disabilities

    Joseph K Torgesen, Richard K Wagner et al.•Journal of Educational Psychology•1999

  • Averaging correlation coefficients

    N Clayton Silver, William P Dunlap•Journal of Applied Psychology•1987

  • Intensive Remedial Instruction for Children with Severe Reading Disabilities

    Open Access•Joseph K Torgesen, Ann W Alexander et al.•Journal of Learning Disabilities•2001

  • Cognitive profiles of difficult-to-remediate and readily remediated poor readers

    Frank R Vellutino, Donna M Scanlon et al.•Journal of Educational Psychology•1996

  • Meta-Analysis

    Robert Rosenthal, M Robin Dimatteo•Annual Review of Psychology•2001

  • Adaptive training leads to sustained enhancement of poor working memory in children

    Open Access•Joni Holmes, Susan E Gathercole et al.•Developmental Science•2009

  • Publication bias in psychological science

    Christopher J Ferguson, Chris Ferguson et al.•Psychological Methods•2012

  • The role of instruction in learning to read

    Barbara R Foorman, David J Francis et al.•Journal of Educational Psychology•1998

  • Training and transfer effects of executive functions in preschool children

    Open Access•Lisa B Thorell, 直明 石渡 et al.•Developmental Science•2009

  • Specifying and reporting complex behaviour change interventions

    Open Access•Susan Michie, Dean L Fixsen et al.•Implementation Science•2009

  • Improving fluid intelligence with training on working memory

    Open Access•Susanne M Jaeggi, Martin Buschkuehl et al.•Proceedings of the National…•2008

  • False-Positive Psychology

    Open Access•Joseph P Simmons, L D Nelson et al.•Psychological Science•2011

  • Evaluating the impact of dyslexia laws on the identification of specific learning disability and dyslexia

    Open Access•B A Phillips, B Anne Barber Phillips et al.•Annals of Dyslexia•2017

  • It’s never too late to remediate

    Open Access•Sylvia P Abbott, Virginia W Berninger•Annals of Dyslexia•1999

  • Reorganizing the instructional reading components

    Open Access•Mary Beth Calhoon, Alexia Sandow et al.•Annals of Dyslexia•2010

  • Computer-assisted instruction to prevent early reading difficulties in students at risk for dyslexia

    Open Access•Joseph K Torgesen, Richard K Wagner et al.•Annals of Dyslexia•2010

  • Neuropsychological intervention in kindergarten children with subtyped risks of reading retardation

    Open Access•Sietsia W D Smit-Glaudé, Jan W Van Strien et al.•Annals of Dyslexia•2005

  • A Survey of State Laws

    Open Access•Perry A Zirkel, Nico Krohn•TEACHING Exceptional Children•2008

  • Is working memory training effective? A meta-analytic review

    Monica Melby-Lervåg, Charles Hulme et al.•Developmental Psychology•2013

  • Identification and Remediation of Reading Difficulties Based on Successive Processing Deficits and Delay in General Reading

    Open Access•Melinda Churches, Mervyn Skuy et al.•Psychological Reports•2002

  • Is meta-analysis the platinum standard of evidence

    Open Access•Jacob Stegenga•Studies in History and Philosophy…•2011

  • Constructing the local and deconstructing the global in education

    Michele Schweisfurth•Comparative Education•2010

  • Poor Readers' Decoding Skills

    Karel Van Den Bosch, Wim H J van Bon et al.•Reading Research Quarterly•1995

  • Can Minimally Trained College Student Volunteers Help Young At‐Risk Children to Read Better

    Open Access•Jill Fitzgerald•Reading Research Quarterly•2001

  • The effects of theoretically different instruction and student characteristics on the skills of struggling readers

    Open Access•Patricia G Mathes, Carolyn A Denton et al.•Reading Research Quarterly•2005

  • The Cognitive Element Model of Reading Instruction

    Open Access•Peng Peng, J Marc Goodrich•Reading Research Quarterly•2020

  • The malleability of working memory and visuospatial skills

    Hana Stepankova, Jiří Lukavský et al.•Developmental Psychology•2014

  • Perspectives on Evidence-Based Research in Education—What Works? Issues in Synthesizing Educational Program Evaluations

    Open Access•Robert E Slavin•Educational Researcher•2008

  • The Politics of Literacy Teaching

    Open Access•Richard L Allington, Haley Woodside-Jiron et al.•Educational Researcher•1999

  • Reading Rescue

    Open Access•Linnea C Ehri, Lois G Dreyer et al.•American Educational Research…•2007

  • Three requirements for justifying an educational neuroscience

    Open Access•George Hruby, George G Hruby•British Journal of Educational…•2012

  • Evidence for the effectiveness of the Early Literacy Support programme

    Open Access•Peter J Hatcher, Kristina Goetz et al.•British Journal of Educational…•2006

  • Is working memory training effective

    Zach Shipstead, Thomas S Redick et al.•Psychological Bulletin•2012

Unique citing works1
Citations per year1
Citation span2025 - 2025 (1)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 1

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae