bioRxivBioengineeringPreprint
Convolutional-recurrent neural networks approximate diffusion tractography from T1-weighted MRI and associated anatomical context
L. Y. Cai, H. H. Lee, N. R. Newlin, C. I. Kerley, P. Kanakaraj, Q. Yang, G. W. Johnson, D. Moyer, K. G. Schilling, F. Rheault, B. A. Landman
Abstract
Diffusion MRI (dMRI) streamline tractography is the gold-standard for in vivo estimation of white matter (WM) pathways in the brain. However, the high angular resolution dMRI acquisitions capable of fitting the microstructural models needed for tractography are often time-consuming and not routinely collected clinically, restricting the scope of tractography analyses. To address this limitation, we build on recent advances in deep learning which have demonstrated that streamline propagation can be learned from dMRI directly without traditional model fitting. Specifically, we propose learning the streamline propagator from T1w MRI to facilitate arbitrary tractography analyses when dMRI is unavailable. To do so, we present a novel convolutional-recurrent neural network (CoRNN) trained in a teacher-student framework that leverages T1w MRI, associated anatomical context, and streamline memory from data acquired for the Human Connectome Project. We characterize our approach under two common tractography paradigms, WM bundle analysis and structural connectomics, and find approximately a 5-15% difference between measures computed from streamlines generated with our approach and those generated using traditional dMRI tractography. When placed in the literature, these results suggest that the accuracy of WM measures computed from T1w MRI with our method is on the level of scan-rescan dMRI variability and raise an important question: is tractography truly a microstructural phenomenon, or has dMRI merely facilitated its discovery and implementation?
- organism: human
- assay: structural biology
- assay: imaging
- research focus: synaptic & neural circuits
- research focus: cell type annotation
- research focus: trajectory inference
- approach: deep learning
- approach: transformer / foundation model
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Implementation considerations for deep learning with diffusion MRI streamline tractography
L. Y. Cai, H. H. Lee, … B. A. Landman·bioRxiv·Apr 3, 2023
- Learn to Track: Deep Learning for Tractography
Philippe Poulin, Marc-Alexandre Côté, … Maxime Descoteaux·Lecture notes in computer sciencePeer-reviewed·Jan 1, 2017
- Modeling a Shared Reality of Tractography through Varied Structural Imaging
Trent Schwartz, Elyssa M. McMaster, … Zhiyuan Li·SPIE Medical Imaging: Image ProcessingPeer-reviewed·Apr 3, 2026
- Track-To-Learn: A general framework for tractography with deep reinforcement learning
Antoine Théberge, Christian Desrosiers, … Pierre‐Marc Jodoin·Medical Image AnalysisPeer-reviewed·May 3, 2021
- Anatomy-to-Tract Mapping Infers White Matter Pathways Without Diffusion Streamline Propagation
Yee Fan Tan, Khoi Minh Huynh, … Pew‐Thian Yap·Nature CommunicationsPeer-reviewed·Nov 29, 2025
- Using diffusion MRI data acquired with ultra-high gradients to improve tractography in routine-quality data
Chiara Maffei, Cliff Lee, … Anastasia Yendiki·NeuroImagePeer-reviewed·Nov 12, 2021