Speech Synthesis from Electrocorticography during Imagined Speech Using a Transformer-Based Decoder and a Pretrained Vocoder
Shuji Komeiji, Kai Shigemi, Takumi Mitsuhashi, Yasushi Iimura, Hiroharu Suzuki, Hidenori Sugano, Koichi Shinoda, Kohei Yatabe, Toshihisa Tanaka
This paper synthesizes speech from imagined speech ECoG using a Transformer decoder and pre-trained vocoder, achieving high correlation with proxy targets.
bioRxiv · Aug 21, 2024 · PreprintNeuroscience