High-resolution neural recordings improve the accuracy of speech decoding
Suseendrakumar DuraiveliD, Shervin RahimpouriD, Chia‐Han ChiangiD, Michael TrumpisiD, Charles WangiD, Katrina J. BarthiD, Stephen C. HarwardiD, Shivanand Pramod LadiD, Allan H. Friedman, Derek G. SouthwelliD, Saurabh R. SinhaiD, Jonathan ViventiiD, Gregory B. CoganiD
Abstract
Patients suffering from debilitating neurodegenerative diseases often lose the ability to communicate, detrimentally affecting their quality of life. One promising solution to restore communication is to decode signals directly from the brain to enable neural speech prostheses. However, decoding has been limited by coarse neural recordings which inadequately capture the rich spatio-temporal structure of human brain signals. To resolve this limitation, we performed novel, high-resolution, micro-electrocorticographic (ECoG) neural recordings during intra-operative speech production. We obtained neural signals with 57x higher spatial resolution and 48% higher signal-to-noise ratio compared to standard invasive recordings. This increased signal quality improved phoneme decoding by 35% compared to standard intracranial signals. Accurate decoding was dependent on the high-spatial resolution of the neural interface. Non-linear decoding models designed to utilize enhanced spatio-temporal neural information produced better results than linear techniques. We show for the first time that ECoG can enable high-quality speech decoding, demonstrating its ability to improve neural interfaces for neural speech prostheses.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 75
- FWCI
- 8.95
- Field percentile
- top 1%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A Neural Speech Decoding Framework Leveraging Deep Learning and Speech Synthesis
Xupeng Chen, Ran Wang, … Adeen Flinker·Nature Machine IntelligencePeer-reviewed·Apr 8, 2024
- Delineating neural contributions to electroencephalogram-based speech decoding
Motoshige Sato, Yasuo Kabe, … Shuntaro Sasai·bioRxiv·May 9, 2024
- Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network
Artur Petrosyan, Alexey Voskoboinikov, … Alexei E. Ossadtchi·Journal of Neural EngineeringPeer-reviewed·Nov 10, 2022
- Neural decoding of the speech envelope: Effects of intelligibility and spectral degradation
Alexis Deighton MacIntyre, Robert P. Carlyon, Tobias Goehring·Trends in HearingPeer-reviewed·Jan 1, 2024
- Natural speech re-synthesis from direct cortical recordings using a pre-trained encoder-decoder framework
Jiawei Li, Chunxu Guo, … Yuanning Li·bioRxiv·Dec 16, 2024
- Intelligible speech synthesis from neural decoding of spoken sentences
Gopala K. Anumanchipalli, Josh Chartier, Edward F. Chang·NaturePeer-reviewed·Apr 24, 2019