Predicting individual speech intelligibility from the neural tracking of acoustic- and phonetic-level speech representations

Abstract

ObjectiveTo objectively measure speech intelligibility of individual subjects from the EEG, based on cortical tracking of different representations of speech: low-level acoustical, higher-level discrete, or a combination. To compare each models prediction of the speech reception threshold (SRT) for each individual with the behaviorally measured SRT.\n\nMethodsNineteen participants listened to Flemish Matrix sentences presented at different signal-to-noise ratios (SNRs), corresponding to different levels of speech understanding. For different EEG frequency bands (delta, theta, alpha, beta or low-gamma), a model was built to predict the EEG signal from various speech representations: envelope, spectrogram, phonemes, phonetic features or a combination of phonetic Features and Spectrogram (FS). The same model was used for all subjects. The model predictions were then compared to the actual EEG of each subject for the different SNRs, and the prediction accuracy in function of SNR was used to predict the SRT.\n\nResultsThe model based on the FS speech representation and the theta EEG band yielded the best SRT predictions, with a difference between the behavioral and objective SRT below 1 decibel for 53% and below 2 decibels for 89% of the subjects.\n\nConclusionA model including low- and higher-level speech features allows to predict the speech reception threshold from the EEG of people listening to natural speech. It has potential applications in diagnostics of the auditory system.\n\nSearch Termscortical speech tracking, objective measure, speech intelligibility, auditory processing, speech representations.\n\nHighlightsO_LIObjective EEG-based measure of speech intelligibility\nC_LIO_LIImproved prediction of speech intelligibility by combining speech representations\nC_LIO_LICortical tracking of speech in the delta EEG band monotonically increased with SNRs\nC_LIO_LICortical responses in the theta EEG band best predicted the speech reception threshold\nC_LI\n\nDisclosureThe authors report no disclosures relevant to the manuscript.