From Sight to Insight: A Multi-task Approach with the Visual Language Decoding Model
Wei Huang, Pengfei Yang, Ying Tang, Qin Fan, Hengjiang Li, Diwei Wu, Wei Ren, Sizhuo Wang, Yuhao Zhao, Jing Wang, Haoxiang Liu, Jingpeng Li, Yucheng Zhu, Bo Zhou, Jingyuan Sun, , Huafu Chen
This paper introduces a Visual Language Decoding Model (VLDM) that simultaneously decodes visual categories, semantic labels, and textual descriptions from neural data, achieving significant improvements over chance levels.
Information Fusion · Jul 4, 2024Peer-reviewedNeuroscience