Numerical Variability of functional MRI Graph Measures
Mina Alizadeh, Yohan ChatelainiD, Gregory KiariD, Tristan GlatardiD
Abstract
Network neuroscience provides a powerful framework for studying the mechanisms underlying brain-related diseases. As analyses become increasingly computational, ensuring their numerical reliability has become a critical challenge. Small perturbations introduced during processing can propagate through complex pipelines, leading to variability in outcomes and raising concerns about the reproducibility of reported findings. Addressing this issue requires systematic evaluation of pipeline stability to ensure results remain within acceptable numerical limits. While the numerical variability of structural imaging workflows has been investigated, with findings ranging from negligible to substantial, functional MRI (fMRI) pipelines and their derived graph measures remain underexplored. Without rigorous stability assessment, conclusions drawn from these measures may remain uncertain. We systematically evaluated the numerical variability of graph measures of functional connectivity derived from the widely-used fMRIPrep pipeline and compared it to population variability. The resulting Numerical-Population Variability Ratio (NPVR) values typically ranged from 0.1 to 0.2 for most graph metrics, indicating a measurable influence of numerical variability on network-derived outcomes. NPVR values varied across brain regions, thresholding choices, and confound regression strategies. These findings highlight numerical variability as an important factor in functional network studies, particularly when examining subtle effects or working with small sample sizes.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Searching for Consistent Brain Network Topologies Across the Garden of (Shortest) Forking Paths
Andrea I. Luppi, Helena Marie Gellersen, … Emmanuel Andreas Stamatakis·bioRxiv·Jul 13, 2021
- Numerical Uncertainty in Analytical Pipelines Lead to Impactful Variability in Brain Networks
Gregory Kiar, Yohan Chatelain, … Tristan Glatard·PLoS ONEPeer-reviewed·Nov 1, 2021
- Test-retest reliability of functional connectivity networks during naturalistic fMRI paradigms
Jiahui Wang, Yudan Ren, … Christine Cong Guo·Human Brain MappingPeer-reviewed·Jan 17, 2017
- Converging on consistent functional connectomics
Andrea I. Luppi, Helena Marie Gellersen, … Emmanuel Andreas Stamatakis·bioRxiv·Jun 23, 2023
- Effect of analytical variability in estimating EEG-based functional connectivity
Sahar Allouch, Aya Kabbara, … Mahmoud Hassan·bioRxiv·Aug 17, 2023
- Moving Beyond Processing and Analysis-Related Variation in Neuroscience
Xinhui Li, Nathália Bianchini Esper, … Michael Peter Milham·Nature Human BehaviourPeer-reviewed·Aug 5, 2024