Natural language processing models reveal neural dynamics of human conversation
Jing CaiiD, Alex E. HadjinicolaouiD, Angelique Christine PaulkiD, Daniel J. SoperiD, Tian Xia, Alexander F WangiD, John David RolstoniD, Robert Mark RichardsoniD, Ziv M. WilliamsiD, Sydney S. CashiD
Abstract
Through conversation, humans relay complex information through the alternation of speech production and comprehension. The neural mechanisms that underlie these complementary processes or through which information is precisely conveyed by language, however, remain poorly understood. Here, we used pretrained deep learning natural language processing models in combination with intracranial neuronal recordings to discover neural signals that reliably reflect speech production, comprehension, and their transitions during natural conversation between individuals. Our findings indicate that neural activities that encoded linguistic information were broadly distributed throughout frontotemporal areas across multiple frequency bands. We also find that these activities were specific to the words and sentences being conveyed and that they were dependent on the words specific context and order. Finally, we demonstrate that these neural patterns partially overlapped during language production and comprehension and that listener-speaker transitions were associated with specific, time-aligned changes in neural activity. Collectively, our findings reveal a dynamical organization of neural activities that subserve language production and comprehension during natural conversation and harness the use of deep learning models in understanding the neural mechanisms underlying human language.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 34
- FWCI
- 16.98
- Field percentile
- top 1%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Deep speech-to-text models capture the neural basis of spontaneous speech in everyday conversations
Ariel Goldstein, Haocheng Wang, … Uri Hasson·bioRxiv·Jun 26, 2023
- Linguistic coupling between neural systems for speech production and comprehension during real-time dyadic conversations
Zaid Zada, Samuel A. Nastase, … Diana Tamir·NeuronPeer-reviewed·Dec 17, 2025
- Correspondence between the layered structure of deep language models and temporal structure of natural language processing in the human brain
Ariel Goldstein, Eric Ham, … Uri Hasson·bioRxiv·Jul 11, 2022
- Deep-layer cortical tracking abruptly collapses in the absence of language comprehension
Chentianyi Yang, Andrew Thwaites, … Alexandra Woolgar·bioRxiv·Sep 8, 2026
- The neural architecture of language: Integrative modeling converges on predictive processing
Martin Schrimpf, Idan Blank, … Evelina G. Fedorenko·Proceedings of the National Academy of SciencesPeer-reviewed·Nov 4, 2021
- Dynamic brain interactions during picture naming
Aram Giahi Saravani, Kiefer James Forseth, … Xaq Pitkow·eNeuroPeer-reviewed·Jun 13, 2019