Deep-layer cortical tracking abruptly collapses in the absence of language comprehension
Chentianyi YangiD, Andrew ThwaitesiD, Cai WingfieldiD, Chao Zhang, Alexandra WoolgariD
Abstract
The brain builds meaning from speech in stages, transforming acoustic input into linguistic comprehension. Yet where comprehension separates from general acoustic processing has been difficult to localize, because the two are tightly entangled in continuous speech. Here we align the activity of ~145,000 individual artificial neurons of an audio large language model with high-resolution magnetoencephalography, using single-neuron interpretability to track, layer by layer, which computations the cortex follows during natural listening. Contrasting native listeners with listeners hearing an unfamiliar language, while holding the acoustics physically identical, we find that comprehension selectively sustains brain-model alignment through the model's deep layers. Without comprehension, alignment in the acoustic encoder is preserved but deep-layer tracking abruptly collapses, and the sparse alignments that survive correspond only to physical acoustic features. This pinpoints the stage at which comprehension departs from perception and yields an interpretable, non-invasive index of whether speech is understood.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A tradeoff between acoustic and linguistic feature encoding in spoken language comprehension
Filiz Tezcan, Hugo Weissbart, Andrea E. Martin·eLifePeer-reviewed·Jun 19, 2023
- Heard or understood? Neural tracking of language features in a comprehensible story, an incomprehensible story and a word list
Marlies Gillis, Jonas Vanthornhout, Tom Francart·eNeuroPeer-reviewed·Jul 1, 2023
- Deep speech-to-text models capture the neural basis of spontaneous speech in everyday conversations
Ariel Goldstein, Haocheng Wang, … Uri Hasson·bioRxiv·Jun 26, 2023
- Delta-band Cortical Tracking of Acoustic and Linguistic Features in Natural Spoken Narratives
- Neural markers of speech comprehension: measuring EEG tracking of linguistic speech representations, controlling the speech acoustics
Marlies Gillis, Jonas Vanthornhout, … Christian Brodbeck·Journal of NeurosciencePeer-reviewed·Nov 3, 2021
- Natural language processing models reveal neural dynamics of human conversation
Jing Cai, Alex E. Hadjinicolaou, … Sydney S. Cash·Nature CommunicationsPeer-reviewed·Apr 9, 2025