bioRxivNeurosciencePreprint
Quantifying Uncertainty in Brain Age Predictions via Conformal Prediction
Ujjwal Samanta, Golia ShafieiiD, Helmet Talib KarimiD, Theodore Daniel SatterthwaiteiD, Andrew Chen
Abstract
Youth can exhibit signs of delayed or accelerated neurodevelopment, measurable via brain magnetic resonance imaging (MRI). Brain age prediction seeks to estimate brain age at an individual level using machine learning models fitted on healthy individuals. The brain age gap (BAG): the difference between brain age and chronological age, has been studied as a potential biomarker. However, BAG suffers from known limitations, including dependence on chronological age, regression to the mean, and challenges in interpretability. As an alternative framework, we introduce brain age intervals (BAIs) as a normative interval on an individual's chronological age, based on MRI measures. BAIs can be derived using a recent statistical framework called conformal prediction that yields prediction intervals with guaranteed coverage. We train several brain age prediction models on structural and functional MRI scans from the Reproducible Brain Charts dataset (aged 6-22) and estimated BAIs. The BAIs demonstrated stable empirical coverage close to the nominal 90% level (median coverage=91%, width=7.36 years, root mean square error (RMSE)=2.20 years across 100 repeated train-test splits). Associations between interval coverage and clinical measures (p-factor, parental education) were weak, with only a modest directional signal for parental education. Together, these findings demonstrate the feasibility of uncertainty-aware brain age modeling in youth populations while highlighting the need for larger and more diverse samples to detect meaningful clinical and environmental associations.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Mind the gap: performance metric evaluation in brain-age prediction
Ann‐Marie G. de Lange, Melis Anatürk, … James Howard Cole·Human Brain MappingPeer-reviewed·Mar 21, 2022
- Quantifying uncertainty in brain-predicted age using scalar-on-image quantile regression
Marco Palma, Shahin Tavakoli, … for the Alzheimer’s Disease Neuroimaging Initiative·NeuroImagePeer-reviewed·Jun 2, 2020
- Considerations on brain age predictions from repeatedly sampled data across time
Max Korbmacher, Mengyun Wang, … Karsten Specht·Brain and BehaviorPeer-reviewed·Aug 16, 2023
- Statistical Pitfalls in Brain Age Analyses
Ellyn R. Butler, Andrew A. Chen, … Russell Taki Shinohara·bioRxiv·Jun 21, 2020
- Prediction of brain age using structural magnetic resonance imaging: A comparison of accuracy and test-retest reliability of publicly available software packages
Ruben P. Dörfel, Joan M. Arenas‐Gomez, … Pontus Plavén‐Sigray·Human Brain MappingPeer-reviewed·Oct 16, 2023
- Replication and Refinement of Brain Age Model for adolescent development.
Bhaskar Ray, Jiayu Chen, … Jingyu Liu·IEEE International Symposium on Biomedical Imaging (ISBI)Peer-reviewed·May 27, 2024