Auditory detection is modulated by theta phase of silent lip movements
Emmanuel BiauiD, Danying WangiD, Hyojin ParkiD, Ole B. JenseniD, Simon HanslmayriD
Abstract
Audiovisual speech perception relies, among other things, on our expertise to map a speakers lip movements with speech sounds. This multimodal matching is facilitated by salient syllable features that align lip movements and acoustic envelope signals in the 4 - 8 Hz theta band. Although non-exclusive, the predominance of theta rhythms in speech processing has been firmly established by studies showing that neural oscillations track the acoustic envelope in the primary auditory cortex. Equivalently, theta oscillations in the visual cortex entrain to lip movements, and the auditory cortex is recruited during silent speech perception. These findings suggest that neuronal theta oscillations may play a functional role in organising information flow across visual and auditory sensory areas. We presented silent speech movies while participants performed a pure tone detection task to test whether entrainment to lip movements directs the auditory system and drives behavioural outcomes. We showed that auditory detection varied depending on the ongoing theta phase conveyed by lip movements in the movies. In a complementary experiment presenting the same movies while recording participants electro-encephalogram (EEG), we found that silent lip movements entrained neural oscillations in the visual and auditory cortices with the visual phase leading the auditory phase. These results support the idea that the visual cortex entrained by lip movements filtered the sensitivity of the auditory cortex via theta phase synchronisation.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 20
- FWCI
- 3.87
- Field percentile
- top 7%
- Organism
- Assay
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Neocortical and hippocampal theta oscillations track audiovisual integration and replay of speech memories
Emmanuel Biau, Danying Wang, … Simon Hanslmayr·Journal of NeurosciencePeer-reviewed·May 19, 2025
- Visual speech enhances auditory onset timing and envelope tracking through distinct mechanisms
Cody Zhewei Cao, William C. Stacey, … David Brang·bioRxiv·Nov 23, 2024
- Phase resetting in human auditory cortex to visual speech
Pierre Mégevand, Manuel R. Mercier, … Ashesh D. Mehta·Journal of NeurosciencePeer-reviewed·Oct 6, 2020
- Visual cortical entrainment to unheard acoustic speech reflects intelligibility of lip movements and is mediated by dorsal stream regions
Anne Hauswald, Chrysa D. Lithari, … Nathan Weisz·Current BiologyPeer-reviewed·Apr 19, 2018
- Auditory cortex encodes lipreading information through spatially distributed activity
Ganesan Karthik, Cody Zhewei Cao, … David Brang·Current BiologyPeer-reviewed·Aug 16, 2024
- Differential auditory and visual phase-locking are observed during audio-visual benefit and silent lip-reading for speech perception
Máté Aller, Heidi Solberg Økland, … Matthew H. Davis·Journal of NeurosciencePeer-reviewed·Jun 27, 2022