Sign in
NeurosciencebioRxiv
Preprint

Emergent modularity in large language models: Insights from aphasia simulations

Chengcheng WangiD, Zhiyu FaniD, Zaizhu HaniD, Yanchao BiiD, Jixing LiiD

Abstract

Recent large language models (LLMs) have demonstrated remarkable proficiency in complex linguistic tasks and have been shown to share certain computational principles with human language processing. However, whether LLMs internal components perform distinct functions, like semantic and syntactic processing in human language systems, remains unclear. Here, we systematically disrupted components of LLMs to simulate the behavioral profiles of aphasia--a disorder characterized by specific language deficits resulting from brain injury. Our findings showed that lesioning specific components of LLMs could replicate behaviors characteristic of different aphasia subtypes. Notably, while semantic deficits as those observed in Wernickes and Conduction aphasia, were relatively straightforward to simulate, reproducing syntactic and lexical impairments, as seen in Brocas and Anomic aphasia, proved more challenging. Together, these results highlight both parallels and discrepancies between emergent modularity in LLMs and the human language system, providing new insights into how information is represented and processed in artificial and biological intelligence.

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISHong '24Patel '23Puffay '26Nemati '26Zhao '26Nakagi '24
65% semantic matchNeuroscience
Zhuoqiao Hong, Haocheng Wang, Zaid Zada+13 more·bioRxiv·Jun 12, 2024· 1 citations