Decoding the Moving Mind: Multi-Subject fMRI-to-Video Retrieval with MLLM Semantic Grounding
Xuanliu Zhu, Yiqiao Chai, Runnan Li, Mingying Lan, Li Gao
This paper introduces a framework for multi-subject fMRI-to-video retrieval that improves retrieval accuracy by addressing temporal mismatches, integrating subject-specific patterns, and using semantic grounding from LLMs.
bioRxiv · Apr 7, 2025 · PreprintNeuroscience