NeuroImageNeurosciencePeer-reviewed journal article
TOWARD A CONNECTIVITY GRADIENT-BASED FRAMEWORK FOR REPRODUCIBLE BIOMARKER DISCOVERY
Seok‐Jun HongiD, Ting XuiD, Aki NikolaidisiD, Jonathan SmallwoodiD, Daniel S. MarguliesiD, Boris C. BernhardtiD, Joshua T VogelsteiniD, Michael Peter MilhamiD
Abstract
AO_SCPLOWBSTRACTC_SCPLOWDespite myriad demonstrations of feasibility, the high dimensionality of fMRI data remains a critical barrier to its utility for reproducible biomarker discovery. Recent studies applying dimensionality reduction techniques to resting-state fMRI (R-fMRI) have unveiled neurocognitively meaningful connectivity gradients that are present in both human and primate brains, and appear to differ meaningfully among individuals and clinical populations. Here, we provide a critical assessment of the suitability of connectivity gradients for biomarker discovery. Using the Human Connectome Project (discovery subsample=209; two replication subsamples= 209x2) and the Midnight scan club (n=9), we tested the following key biomarker traits - reliability, reproducibility and predictive validity - of functional gradients. In doing so, we systematically assessed the effects of three analytical settings, including i) dimensionality reduction algorithms (i.e., linear vs. non-linear methods), ii) input data types (i.e., raw time series, [un-]thresholded functional connectivity), and iii) amount of the data (R-fMRI time-series lengths). We found that the reproducibility of functional gradients across algorithms and subsamples is generally higher for those explaining more variances of whole-brain connectivity data, as well as those having higher reliability. Notably, among different analytical settings, a linear dimensionality reduction (principal component analysis in our study), more conservatively thresholded functional connectivity (e.g., 95-97%) and longer time-series data (at least [≥]20mins) was found to be preferential conditions to obtain higher reliability. Those gradients with higher reliability were able to predict unseen phenotypic scores with a higher accuracy, highlighting reliability as a critical prerequisite for validity. Importantly, prediction accuracy with connectivity gradients exceeded that observed with more traditional edge-based connectivity measures, suggesting the added value of a low-dimensional gradient approach. Finally, the present work highlights the importance and benefits of systematically exploring the parameter space for new imaging methods before widespread deployment. HO_SCPLOWIGHLIGHTSC_SCPLOW- There is a growing need to identify benchmark parameters in advancing functional connectivity gradients into a reliable biomarker. - Here, we explored multidimensional parameter space in calculating functional gradients to improve their reproducibility, reliability and predictive validity. - We demonstrated that more reproducible and reliable gradient markers tend to have higher predictive power for unseen phenotypic scores across various cognitive domains. - We showed that the low-dimensional connectivity gradient approach could outperform raw edge-based analyses in terms of predicting phenotypic scores. - We highlight the necessity of optimizing parameters for new imaging methods before their widespread deployment.
- Citations
- 181
- FWCI
- 9.40
- Field percentile
- top 1%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- When most fMRI connectivity cannot be detected: insights from time course reliability
Jan Willem Koten, Hans Manner, … John P. A. Ioannidis·PLoS ONEPeer-reviewed·Dec 13, 2024
- What is the test-retest reliability of common task-fMRI measures? Newempirical evidence and a meta-analysis
Maxwell L. Elliott, Annchen R. Knodt, … Ahmad R. Hariri·bioRxiv·Jan 16, 2020
- Computational Mechanisms of Neuroimaging Biomarkers Uncovered by Multicenter Resting-State fMRI Connectivity Variation Profile
Okito Yamashita, Ayumu Yamashita, … Brain/MINDS Beyond Human Brain MRI Group·Molecular PsychiatryPeer-reviewed·Aug 7, 2025
- Test-retest reliability of resting-state fMRI functional connectivity: impact of scan length and number of participants
Beatriz Vale, Marta Correia, Patricia Figueiredo·bioRxiv·Jun 8, 2026
- Suboptimal phenotypic reliability impedes reproducible human neuroscience
Aki Nikolaidis, Andrew A. Chen, … Haochang Shou·bioRxiv·Jul 22, 2022
- A Comparative Machine Learning Study of Connectivity-Based Biomarkers of Schizophrenia
Victoria Shevchenko, R. Austin Benn, … Daniel S. Margulies·bioRxiv·Jan 5, 2024