bioRxivNeurosciencePreprint
Representation of Verbal Thought in Motor Cortex and Implications for Speech Neuroprostheses
Erin M. KunziD, Benyamin Meschede-KrasaiD, Foram B. KamdariD, Donald T. AvansinoiD, Samuel R. NasoniD, Nicholas S. CardiD, Brandon G. JacquesiD, Payton H. BechefskyiD, Nick V. HahniD, Carrina IacobacciiD, Leigh R. HochbergiD, David M. BrandmaniD, Sergey D. StaviskyiD, Nicholas Au YongiD, Chethan PandarinathiD, Shaul DruckmanniD, Jaimie M. HendersoniD, Francis R. WillettiD
Abstract
Speech brain-computer interfaces show great promise in restoring communication for people who can no longer speak1-3, but have also raised privacy concerns regarding their potential to decode private verbal thought4-6. Using multi-unit recordings in three participants with dysarthria, we studied the representation of inner speech in the motor cortex. We found a robust neural encoding of inner speech, such that individual words and continuously imagined sentences could be decoded in real-time This neural representation was highly correlated with overt and perceived speech. We investigated the possibility of "eavesdropping" on private verbal thought, and demonstrated that verbal memory can be decoded during a non-speech task. Nevertheless, we found a neural "overtness" dimension that can help to avoid any unintentional decoding. Together, these results demonstrate the strong representation of verbal thought in the motor cortex, and highlight important design considerations and risks that must be addressed as speech neuroprostheses become more widespread.
- Citations
- 8
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A high-performance speech neuroprosthesis
Francis R. Willett, Erin M. Kunz, … Jaimie M. Henderson·NaturePeer-reviewed·Aug 23, 2023
- Intelligible speech synthesis from neural decoding of spoken sentences
Gopala K. Anumanchipalli, Josh Chartier, Edward F. Chang·NaturePeer-reviewed·Apr 24, 2019
- Imagined speech can be decoded from low- and cross-frequency features in perceptual space
Timothée Proix, Jaime F. Delgado Saa, … Anne‐Lise Giraud·bioRxiv·Jan 26, 2021
- Neural ensemble dynamics in dorsal motor cortex during speech in people with paralysis
Sergey D. Stavisky, Francis R. Willett, … Jaimie M. Henderson·eLifePeer-reviewed·Dec 9, 2019
- Real-time Synthesis of Imagined Speech Processes from Minimally Invasive Recordings of Neural Activity
Miguel Angrick, Maarten Christiaan Ottenhoff, … Christian Herff·Communications BiologyPeer-reviewed·Sep 23, 2021
- An instantaneous voice synthesis neuroprosthesis
Maitreyee Wairagkar, Nicholas S. Card, … Sergey D. Stavisky·NaturePeer-reviewed·Jun 12, 2025