bioRxivNeurosciencePreprint
Representation, Alignment, and Generation: A Comprehensive Survey of Foundation Models for Non-Invasive Brain Decoding
Yifan WangiD, Shaonan WangiD, Wenhao CaiiD, George Ford, Yang Cui, Yunhao ZhangiD, Changde DuiD, Cunhang Fan, Jixing LiiD, Hongpeng ZhouiD, Hongyu Zhang, Quanying LiuiD, Wei Huang, Yizhuo LuiD, Zijiao Chen, Jingyuan SuniD
Abstract
The ability to decode human thoughts, intentions, and perceptions directly from non-invasive brain recordings holds transformative potential for healthcare, communication, and human-computer interaction. However, translating the safety and scalability of methods like Functional Magnetic Resonance Imaging (fMRI), Electroencephalography (EEG), and Magnetoencephalography (MEG) into real-world utility has traditionally been hindered by low signal-to-noise ratios, limited spatial-temporal resolution, and the difficulty to collect large-scale high-quality data from an individual user. Recently, the emergence of Foundation Models (FMs)--large-scale, pre-trained architectures--has expanded the feasible operating region of non-invasive brain decoding under controlled protocols, primarily through representation learning, neuro-semantic alignment, and strong generative priors. However, evidence for robust cross-subject and real-world deployment remains uneven, as many results are still demonstrated on limited cohorts or highly controlled settings. This survey provides a comprehensive overview of how FMs are redefining the boundaries of non-invasive brain decoding. We propose a unified methodological framework that synthesizes recent advancements into a coherent process: extracting robust, transferable representations from noisy neural signals; aligning these signals with the rich semantic spaces of pre-trained vision and language models; and leveraging powerful conditional generative priors to reconstruct high-fidelity outputs. We systematically review state-of-the-art applications across three key domains: visual reconstruction, language and speech decoding, and auditory processing. Furthermore, we critically examine the persisting challenges of computational efficiency, cross-subject generalization, and privacy governance. By mapping the current landscape and identifying key gaps, this work outlines a strategic research agenda aimed at transitioning FM-driven neurotechnology from laboratory proofs-of-concept to reliable, real-world applications.
- organism: human
- assay: imaging
- research focus: benchmarking
- approach: deep learning
- approach: transformer / foundation model
- Citations
- 2
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- An EMG foundation model for neural decoding
Andrew Garrett Kurbis, Alex Mihailidis, Brokoslaw Laschowski·bioRxiv·Dec 19, 2025
- BrainLM: A foundation model for brain activity recordings
Josue Ortega Caro, Antonio H. de O. Fonseca, … David van Dijk·bioRxiv·Sep 12, 2023
- Decoding Continuous Character-based Language from Non-invasive Brain Recordings
Cenyuan Zhang, Xiaoqing Zheng, … Jianfeng Feng·bioRxiv·Mar 19, 2024
- Brain2VLM: Hierarchical Alignment Between Cortical Representations and Vision-Language Latent Spaces
N. A. Adarsh Pritam, O. Jeba Shiney, Sanyam Jain·bioRxiv·Aug 11, 2026
- AREION: A Foundation Model for Atlas-Agnostic Representation Learning of Brain Connectome
Zhao Zhang, Hongming Li, … Yong Fan A·bioRxiv·Oct 1, 2026
- Du-IN-v2: Unleashing the Power of Vector Quantization for Decoding Cognitive States from Intracranial Neural Signals
Hui Wen Zheng, Haiteng Wang, … Yunzhe Liu·bioRxiv·Oct 16, 2024