Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Test–retest reliability and predictive validity of the Implicit Association Test in children

Bibliographic Data

ID9787719
AuthorsJames R Rae (University of Washington, corresponding author), Kristina R Olson (0000-0002-1111-544X, University of Washington)
Year2018
Volume54
Issue2
Pages308-330
Publication date2018-02-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueDevelopmental Psychology (JOURNAL)
Journal identifiersISSN: 0012-1649 • E-ISSN: 1939-0599
PublisherAmerican Psychological Association (APA) (PUBLISHER)
DOI10.1037/dev0000437
PMID29251966
OpenAlexW2777939718
LanguageEN
Citations received18
References cited35

The Implicit Association Test (IAT) is increasingly used in developmental research despite minimal evidence of whether children's IAT scores are reliable across time or predictive of behavior. When test-retest reliability and predictive validity have been assessed, the results have been mixed, and because these studies have differed on many factors simultaneously (lag-time between testing administrations, domain, etc.), it is difficult to discern what factors may explain variability in existing test-retest reliability and predictive validity estimates. Across five studies (total N = 519; ages 6- to 11-years-old), we manipulated two factors that have varied in previous developmental research-lag-time and domain. An internal meta-analysis of these studies revealed that, across three different methods of analyzing the data, mean test-retest (rs of .48, .38, and .34) and predictive validity (rs of .46, .20, and .10) effect sizes were significantly greater than zero. While lag-time did not moderate the magnitude of test-retest coefficients, whether we observed domain differences in test-retest reliability and predictive validity estimates was contingent on other factors, such as how we scored the IAT or whether we included estimates from a unique sample (i.e., a sample containing gender typical and gender diverse children). Recommendations are made for developmental researchers that utilize the IAT in their research. (PsycINFO Database Record

Association (psychology · Concurrent validity · Developmental psychology · Incremental validity · Internal consistency · MEDLINE · Predictive validity · Psychometrics · PsycINFO · Reliability (semiconductor · Test (biology · Test validity · Child and Adolescent Psychosocial and Emotional Development · Clinical Psychology · Early Childhood Education and Development · Psychology · Social and Intergroup Psychology

  • Implicit measures of teachers' attitudes and stereotypes, and their effects on teacher practice and student outcomes

    Open Access•Eddie Denessen, Lisette Hornstra et al.•Learning and Instruction•2022

  • Six Lessons for a Cogent Science of Implicit Bias and Its Criticism

    Open Access•Bertram Gawronski•Perspectives on Psychological…•2019

  • Racial Attitudes, Accumulation Mechanisms, and Disparities

    Open Access•Ron Mallon•Review of Philosophy and Psychology•2021

  • Testimonial Injustice

    Open Access•Migdalia Arcila-Valenzuela, Andrés Páez•Review of Philosophy and Psychology•2024

  • Uncovering the complexities of cultural identity

    Open Access•Usama El‐awad, Atefeh Fathi et al.•Current Psychology•2025

  • Engaging White parents to address their White children's racial biases in the Black-White context

    Open Access•Katharine E Scott, Tory L Ash et al.•Child Development•2023

  • Indian = Hindu? The Development of Nationalist Attitudes Among Hindu and Muslim Children in India

    Open Access•Monica E Ellwood-Lowe, Catherine Berner et al.•Child Development•2020

  • A systematic review of modern measures for capturing children’s ethnic and racial attitudes, stereotypes, and discrimination

    Open Access•Eren Fukuda, Katharine E Scott et al.•Developmental Review•2025

  • Children’s evaluations of and reactions to racial discrimination

    Open Access•Katharine E Scott, Madeline Henkel et al.•Developmental Psychology•2023

  • Evaluating Implicit Emotions of Chinese University Students With Different Levels of Social Adjustment

    Open Access•Ying Ge, Jun-Yu Huo et al.•Psychological Reports•2018

  • Measuring Gender Status Beliefs

    Open Access•Bradley Montgomery, Hyomin Park et al.•Socius Sociological Research for…•2024

  • Development of an Implicit Well-Being Measure for Youths Using the Implicit Association Test

    Open Access•Ricardo Márquez, Maria Stavraki et al.•Child Indicators Research•2024

  • Changing students’ explicit and implicit attitudes toward peers with disabilities

    Open Access•Sergej Wüthrich, Caroline Sahli Lozano et al.•Social Psychology of Education•2023

  • Between a boy and a girl

    Open Access•Selin Gülgöz, Deja Edwards et al.•Social Development•2022

  • The visual analogue scale as a child-friendly measure of the unhealthy = tasty intuition

    Open Access•Jonathan D'hondt, Barbara Briers•Appetite•2024

  • Developmental differences in the malleability of implicit racial bias following exposure to counterstereotypical exemplars

    Open Access•Antonya Marie Gonzalez, Jennifer R Steele et al.•Developmental Psychology•2021

  • Consistency of gender identity and preferences across time

    Open Access•Tabea Hässler, Jessica J Glazier et al.•Developmental Psychology•2022

  • The developmental origins and behavioral consequences of attributions for inequality

    Open Access•Antonya Marie Gonzalez, Lucía Macchia et al.•Journal of Experimental Social…•2022

  • Introduction to Meta‐Analysis

    Open Access•Michael Borenstein, Larry V Hedges et al.•Introduction to Meta-Analysis•2021

  • Patterns of Continuity

    R Chris Fraley, Brent W Roberts•Psychological Review•2005

  • Math–Gender Stereotypes in Elementary School Children

    Open Access•Dario Cvencek, Andrew N Meltzoff et al.•Child Development•2011

  • Validity and reliability of measurement instruments used in research

    Carole L Kimberlin, Almut G Winterstein•American Journal of Health-System…•2008

  • Health of the Implicit Association Test at Age 3

    Anthony G Greenwald, Brian A Nosek•Experimental Psychology•2001

  • A basic introduction to fixed-effect and random-effects models for meta-analysis

    Open Access•Michael Borenstein, Larry V Hedges et al.•Research Synthesis Methods•2010

  • Mini Meta‐Analysis of Your Own Studies

    Open Access•Jin X Goh, Judith A Hall et al.•Social and Personality Psychology…•2016

  • Calculating and reporting effect sizes to facilitate cumulative science

    Open Access•Daniël Lakens•Frontiers in Psychology•2013

  • Exposure to Racial Out-Groups and Implicit Race Bias in the United States

    Open Access•James R Rae, Anna-Kaisa Newheiser et al.•Social Psychological and…•2015

  • The Development of Implicit Attitudes

    Open Access•Andrew Scott Baron, Mahzarin R Banaji•Psychological Science•2005

  • Social Norms and Self-Presentation

    Open Access•Adam Rutland, Lindsey Cameron et al.•Child Development•2005

  • Implicit Attitude Measures

    Open Access•William A Cunningham, Kristopher J Preacher et al.•Psychological Science•2001

  • A comparative investigation of seven indirect attitude measures

    Open Access•Yoav Bar-Anan, Brian A Nosek•Behavior Research Methods•2013

  • Children and social groups

    Yarrow Dunham, Andrew Scott Baron et al.•Self and Identity•2007

  • Understanding Anti-Fat Bias in Children

    Kim Bissell, H R Hays•Mass Communication & Society•2010

  • The Development of Math–Race Stereotypes

    Open Access•Dario Cvencek, Na’ilah Suad Nasir et al.•Journal of Research on Adolescence•2014

  • A Comparative Study of the Implicit and Explicit Gender Attitudes of Children and College Students

    Open Access•John J Skowronski, Melissa A Lawrence•Psychology of Women Quarterly•2001

  • Gender Essentialism in Children and Parents

    Open Access•Meredith Meyer, A Gelman•Sex Roles•2016

  • Fundamental Statistics for Psychology

    Richard A Zeller, Robert B McCall•Contemporary Sociology A Journal…•1973

  • Of Affect and Ambiguity

    Open Access•Yarrow Dunham, Jason Emory•Journal of Social Issues•2014

  • Preference for high status predicts implicit outgroup bias among children from low-status groups

    Anna‐kaisa Newheiser, Anna‐kaisa Reiman et al.•Developmental Psychology•2014

  • White and Black American children's implicit intergroup bias

    Open Access•Anna-Kaisa Newheiser, Anna‐kaisa Newheiser et al.•Journal of Experimental Social…•2011

  • The relationship between parental racial attitudes and children’s implicit prejudice

    Open Access•Stacey Sinclair, Elizabeth W Dunn et al.•Journal of Experimental Social…•2004

  • Implicit measures for preschool children confirm self-esteem's role in maintaining a balanced identity

    Open Access•Dario Cvencek, Anthony G Greenwald et al.•Journal of Experimental Social…•2015

  • Racial-ethnic identity development in children in a racial-ethnic minority group

    B Corenblum, Helen D Armstrong•Canadian Journal of Behavioural…•2012

  • Understanding and using the Implicit Association Test

    Anthony G Greenwald, Brian A Nosek et al.•Journal of Personality and Social…•2003

  • Implicit self-esteem

    Michael D Buhrmester, Hart Blanton et al.•Journal of Personality and Social…•2011

  • Automatic prejudice in childhood and early adolescence

    Juliane Degner, Dirk Wentura•Journal of Personality and Social…•2010

  • Stalking the perfect measure of implicit self-esteem

    Jennifer K Bosson, William B Swann et al.•Journal of Personality and Social…•2000

  • Reducing explicit and implicit outgroup prejudice via direct and extended contact

    Richard N Turner, Miles Hewstone et al.•Journal of Personality and Social…•2007

  • Intergenerational Intervention to Mitigate Children’s Bias Against the Elderly

    Renée L Babcock, Eileen E Malonebeach et al.•Journal of Intergenerational…•2016

  • Development of a Children’s IAT to Measure Bias Against the Elderly

    Renée L Babcock, Eileen E Malonebeach et al.•Journal of Intergenerational…•2016

  • Relations among the Implicit Association Test, Discriminatory Behavior, and Explicit Measures of Racial Attitudes

    Open Access•Allen R Mcconnell, Jill M Leibold•Journal of Experimental Social…•2001

  • A power primer

    Jacob Cohen•Psychological Bulletin•1992

Unique citing works18
Citations per year2,25
Citation span2018 - 2025 (8)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 18

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae