Seeing a talking face matters

Visual speech cues from a speaker's talking face aid speech segmentation in adults, but despite the importance of speech segmentation in language acquisition, little is known about the possible influence of visual speech on infants' speech segmentation. Here, to investigate whether there is facilitation of speech segmentation by visual information, two groups of English‐learning 7‐month‐old infants were presented with continuous speech passages, one group with auditory‐only (AO) speech and the other with auditory‐visual (AV) speech. Additionally, the possible relation between infants' relative attention to the speaker's mouth versus eye regions and their segmentation performance was examined. Both the AO and the AV groups of infants successfully segmented words from the continuous speech stream, but segmentation performance persisted for longer for infants in the AV group. Interestingly, while AV group infants showed no significant relation between the relative amount of time spent fixating the speaker's mouth versus eyes and word segmentation, their attention to the mouth was greater than that of AO group infants, especially early in test trials. The results are discussed in relation to the possible pathways through which visual speech cues aid speech perception

Audiology · Perception · Segmentation · Speech perception · Speech processing · Speech recognition · Speech segmentation · Communication · Computer Science · Hearing Impairment and Communication · Medicine · Multisensory perception and integration · Psychology · Speech and Audio Processing · Artificial Intelligence

• The role of visual cues on word recognition in noise in monolingual and bilingual toddlers

  Open Access•Meli René Ayala, Mackensie Blair et al.•International Journal of…•2026

  Incluir item

• Infants′ Sensitivity to the Sound Patterns of Native Language Words

  Open Access•P W Jusczyk, Angela D Friederici et al.•Journal of Memory and Language•1993

  Incluir item

• Visual Experience in Infants

  Open Access•Rifat Akhter, Robert L Fantz et al.•Science•1964

  Incluir item

• Dual coding theory

  Allan Paivio•Canadian Journal of Psychology/Revu…•1991

  Incluir item

• Phonotactic and Prosodic Effects on Word Segmentation in Infants

  Open Access•Sven L Mattys, Peter W Jusczyk et al.•Cognitive Psychology•1999

  Incluir item

• Word Segmentation by 8-Month-Olds

  Open Access•Elizabeth K Johnson, Peter W Jusczyk•Journal of Memory and Language•2001

  Incluir item

• Infants′ Detection of the Sound Patterns of Words in Fluent Speech

  Open Access•P W Jusczyk, Richard Ν Aslin et al.•Cognitive Psychology•1995

  Incluir item

• Social Feedback to Infants' Babbling Facilitates Rapid Phonological Learning

  Open Access•Michael Goldstein, Michael H Goldstein et al.•Psychological Science•2008

  Incluir item

• Infants deploy selective attention to the mouth of a talking face when learning speech

  Open Access•David J Lewkowicz, Amy M Hansen-Tift•Proceedings of the National…•2012

  Incluir item

• The control of the false discovery rate in multiple testing under dependency

  Yoav Benjamini, Daniel Yekutieli•The Annals of Statistics•2001

  Incluir item

• At 6–9 months, human infants know the meanings of many common nouns

  Open Access•Elika Bergelson, Daniel Swingley•Proceedings of the National…•2012

  Incluir item

• Mommy and Me

  Open Access•Heather Bortfeld, James L Morgan et al.•Psychological Science•2005

  Incluir item

• The Beginnings of Word Segmentation in English-Learning Infants

  Open Access•Peter W Jusczyk, Derek M Houston et al.•Cognitive Psychology•1999

  Incluir item

• Statistical Learning by 8-Month-Old Infants

  Open Access•Jenny Saffran, Jenny R Saffran et al.•Science•1996

  Incluir item

• Emerging word segmentation abilities in European Portuguese-learning infants

  Open Access•Joseph Butler, Sónia Frota•Journal of Child Language•2018

  Incluir item

• Attention to the mouth and gaze following in infancy predict language development

  Open Access•Elena J Tenenbaum, David M Sobel et al.•Journal of Child Language•2015

  Incluir item

• Reduplication facilitates early word segmentation

  Open Access•Mitsuhiko Ota, Barbora Skarabela•Journal of Child Language•2018

  Incluir item

• Input and uptake at 7 months predicts toddler vocabulary

  Open Access•Robert S Newman, Rochelle S Newman et al.•Journal of Child Language•2016

  Incluir item

• Attention to Maternal Multimodal Naming by 6‐ to 8‐Month‐Old Infants and Learning of Word–Object Relations

  Open Access•Lakshmi J Gogate, Lakshmi Gogate et al.•Infancy•2006

  Incluir item

• Infant‐Directed Prosody Helps Infants Map Sounds to Meanings

  Open Access•Katharine Graf Estes, Karinna Hurley et al.•Infancy•2013

  Incluir item

• Violation of non‐adjacent rule dependencies elicits greater attention to a talker's mouth in 15‐month‐old infants

  Open Access•Joan Birulés, Anna Martinez‐Alvarez et al.•Infancy•2022

  Incluir item

• Increased F ocus on the M outh A mong I nfants in the F irst Y ear of L ife

  Open Access•Elena J Tenenbaum, Rajesh J Shah et al.•Infancy•2013

  Incluir item

• Learning While Babbling

  Open Access•Michael Goldstein, Michael H Goldstein et al.•Infancy•2010

  Incluir item

• Prosodic Structure in Early Word Segmentation

  Open Access•Valesca Kooijman, Peter Hagoort et al.•Infancy•2009

  Incluir item

• Infants' Preferences for Familiarity and Novelty During the Course of Visual Processing

  Open Access•Beverly J Roder, Emily W Bushneil et al.•Infancy•2000

  Incluir item

• Individual Differences in Infant Speech Segmentation

  Open Access•Evan Kidd, Caroline Junge et al.•Infancy•2018

  Incluir item

• Developmental Changes in Infants’ Ability to Cope with Dialect Variation in Word Recognition

  Open Access•Rachel Schmale, Alejandrina Cristia et al.•Infancy•2010

  Incluir item

• Infant‐Directed Speech Facilitates Word Segmentation

  Open Access•Erik D Thiessen, Emily Hill et al.•Infancy•2005

  Incluir item

• Intersensory redundancy guides attentional selectivity and perceptual learning in infancy

  Lorraine E Bahrick, Robert Lickliter•Developmental Psychology•2000

  Incluir item

• Infants' early ability to segment the conversational speech signal predicts later language development

  Robert S Newman, Rochelle Newman et al.•Developmental Psychology•2006

  Incluir item

• When cues collide

  Erik D Thiessen, Jenny Saffran et al.•Developmental Psychology•2003

  Incluir item