Illusions of Alignment Between Large Language Models and Brains Emerge From Fragile Methods and Overlooked Confounds
Nima Hadidi, Ebrahim Feghhi, Bryan H. Song, Idan Blank, Jonathan C. Kao
This study identifies methodological flaws and confounding factors in research comparing large language models to brain activity, showing results are unreliable due to issues like shuffled splits and activation extraction biases.
bioRxiv · Mar 9, 2025 · PreprintNeuroscience