Neural Tracking Measures of Speech Intelligibility: Manipulating Intelligibility while Keeping Acoustics Unchanged
I. M. Dushyanthi KarunathilakeiD, Joshua P. KulasinghamiD, Jonathan Z. SimoniD
Abstract
Neural speech tracking has advanced our understanding of how our brains rapidly map an acoustic speech signal onto linguistic representations and ultimately meaning. It remains unclear, however, how speech intelligibility is related to the corresponding neural responses. Many studies addressing this question vary the level of intelligibility by manipulating the acoustic waveform, but this makes it difficult to cleanly disentangle effects of intelligibility from underlying acoustical confounds. Here, using magnetoencephalography (MEG) recordings, we study neural measures of speech intelligibility by manipulating intelligibility while keeping the acoustics strictly unchanged. Acoustically identical degraded speech stimuli (three-band noise vocoded, [~]20 s duration) are presented twice, but the second presentation is preceded by the original (non-degraded) version of the speech. This intermediate priming, which generates a pop-out percept, substantially improves the intelligibility of the second degraded speech passage. We investigate how intelligibility and acoustical structure affects acoustic and linguistic neural representations using multivariate Temporal Response Functions (mTRFs). As expected, behavioral results confirm that perceived speech clarity is improved by priming. TRF analysis reveals that auditory (speech envelope and envelope onset) neural representations are not affected by priming, but only by the acoustics of the stimuli (bottom-up driven). Critically, our findings suggest that segmentation of sounds into words emerges with better speech intelligibility, and most strongly at the later ([~]400 ms latency) word processing stage, in prefrontal cortex (PFC), in line with engagement of top-down mechanisms associated with priming. Taken together, our results show that word representations may provide some objective measures of speech comprehension. Significance StatementElectrophysiological studies have shown that brain tracks different speech features. How these neural tracking measures are modulated by speech intelligibility, however, remained elusive. Using noise-vocoded speech and a priming paradigm, we disentangled the neural effects of intelligibility from the underlying acoustical confounds. Neural intelligibility effects are analyzed at both acoustic and linguistic level using multivariate Temporal Response Functions. Here, we find evidence for an effect of intelligibility and engagement of top-down mechanisms, but only in responses to lexical structure of the stimuli, suggesting that lexical responses are strong candidates for objective measures of intelligibility. Auditory responses are not influenced by intelligibility but only by the underlying acoustic structure of the stimuli.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 29
- FWCI
- 4.35
- Field percentile
- top 4%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Neural tracking of speech does not unequivocally reflect intelligibility
Anne Kösem, Bohan Dai, … Peter Hagoort A·bioRxiv·Jul 25, 2022
- Speech intelligibility changes the temporal evolution of neural speech tracking
Ya‐Ping Chen, Fabian Schmidt, … Nathan Weisz·NeuroImagePeer-reviewed·Jan 21, 2023
- Prior exposure to speech rapidly modulates cortical processing of high-level linguistic structure
Qingqing Meng, Yiwen Li Hegner, … Blake W. Johnson·Cerebral CortexPeer-reviewed·May 19, 2026
- The effect of stimulus choice on an EEG-based objective measure of speech intelligibility
Eline Verschueren, Jonas Vanthornhout, Tom Francart·Ear and HearingPeer-reviewed·Apr 3, 2020
- Distracting Linguistic Information Impairs Neural Tracking of Attended Speech
Bohan Dai, James M. McQueen, … Anne Kösem·Current Research in NeurobiologyPeer-reviewed·Jan 1, 2022
- Modulation masking and fine structure shape neural envelope coding to predict speech intelligibility across diverse listening conditions
Vibha Viswanathan, Hari Bharadwaj, … Michael G. Heinz·The Journal of the Acoustical Society of AmericaPeer-reviewed·Sep 1, 2021