Triangulating on developmental models with a combination of experimental and nonexperimental estimates

Bibliographic Data

ID9785885
AuthorsSirui Wan (0000-0002-8750-0977, University of Wisconsin–Madison, corresponding author), Timothy R Brick (0000-0002-3339-9279, Pennsylvania State University), Daniela Alvarez-Vargas (0000-0002-4075-1154, University of California, Irvine), Drew H Bailey (0000-0002-7812-1107, University of California, Irvine)
Year2023
Volume59
Issue2
Pages216-228
Publication date2023-02-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueDevelopmental Psychology (JOURNAL)
Journal identifiersISSN: 0012-1649 • E-ISSN: 1939-0599
PublisherAmerican Psychological Association (APA) (PUBLISHER)
DOI10.1037/dev0001490
PMID36395046
OpenAlexW4309360354
LanguageEN
Citations received1
References cited7

Plausible competing developmental models show similar or identical structural equation modeling model fit indices, despite making very different causal predictions. One way to help address this problem is incorporating outside information into selecting among models. This study attempted to select among developmental models of children's early mathematical skills by incorporating information about the extent to which models forecast the longitudinal pattern of causal impacts of early math interventions. We tested for the usefulness and validity of the approach by applying it to data from three randomized controlled trials of early math interventions with longitudinal follow-up assessments in the United States ( N s = 1,375, 591, 744; baseline age 4.3, 6.5, 4.4; 17%-69% Black). We found that, across data sets, (a) some models consistently outperformed other models at forecasting later experimental impacts, (b) traditional statistical fit indices were not strongly related to causal fit as indexed by models' accuracy at forecasting later experimental impacts, and (c) models showed consistent patterns of similarity and discrepancy between statistical fit and models' effectiveness at forecasting experimental impacts. We highlight the importance of triangulation and call for more comparisons of experimental and nonexperimental estimates for choosing among developmental models. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

Causal model · Developmental psychology · Econometrics · MEDLINE · Psychological intervention · PsycINFO · Similarity (geometry · Statistics · Structural equation modeling · Artificial Intelligence · Cognitive Abilities and Testing · Cognitive and developmental aspects of mathematical skills · Computer Science · Early Childhood Education and Development · Mathematics · Psychology

Tools

Open DOIOpen Access