Monkey See, Model Knew: Large Language Models Accurately Predict Visual Brain Responses in Humans AND Non-Human Primates
Colin Conwell, Emalie McMahon, Akshay V. Jagadeesh, Kasper Vinken, Saloni Sharma, Jacob S. Prince, George A. Alvarez, Talia Konkle, Margaret S. Livingstone, Leyla Işık
This paper shows that large language models can predict visual brain responses in humans and non-human primates, suggesting that language-aligned models capture general visual patterns rather than language-specific features.
bioRxiv · Mar 5, 2025 · PreprintNeuroscience