The multiverse of data preprocessing and analysis in graph-based fMRI: A systematic literature review of analytical choices fed into a decision support tool for informed analysis
Daniel KristantoiD, Micha BurkhardtiD, Christiane M. ThieliD, Stefan DebeneriD, Carsten GießingiD, Andrea HildebrandtiD
Abstract
The large number of different analytical choices researchers use may be partly responsible for the replication challenge in neuroimaging studies. For robustness analysis, knowledge of the full space of options is essential. We conducted a systematic literature review to identify the analytical decisions in functional neuroimaging data preprocessing and analysis in the emerging field of cognitive network neuroscience. We found 61 different steps, with 17 of them having debatable options. Scrubbing, global signal regression, and spatial smoothing are among the controversial steps. There is no standardized order in which different steps are applied, and the options within several steps vary widely across studies. By aggregating the pipelines across studies, we propose three taxonomic levels to categorize analytical choices: 1) inclusion or exclusion of specific steps, 2) distinct sequencing of steps, and 3) parameter tuning within steps. To facilitate access to the data, we developed a decision support app with high educational value called METEOR, which allows researchers to explore the space of choices as reference for well-informed robustness (multiverse) analysis. HighlightsO_LIData analysis variability in neuroimaging hinders replicability. C_LIO_LIAnalysis across multiple defensible options examines the robustness of results. C_LIO_LIWe conducted a systematic literature review to identify analytical options. C_LIO_LIWe identified 61 steps and 102 options in performing graph-fMRI analysis. C_LIO_LIInteractive visualization of these steps and options is available as a Shiny app. C_LI
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 15
- FWCI
- 0.96
- Field percentile
- top 31%
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- FMRIPrep: a robust preprocessing pipeline for functional MRI
Oscar Estéban, Christopher Johnson Markiewicz, … Krzysztof J. Gorgolewski·Nature MethodsPeer-reviewed·Dec 4, 2018
- Variability in the analysis of a single neuroimaging dataset by many teams
Rotem Botvinik‐Nezer, Felix Holzmeister, … Xiangzhen Kong·NaturePeer-reviewed·May 20, 2020
- fMRIflows: a consortium of fully automatic univariate and multivariate fMRI processing pipelines
Michael P. Notter, Peer Herholz, … Micah M. Murray·Brain TopographyPeer-reviewed·Dec 27, 2022
- Moving Beyond Processing and Analysis-Related Variation in Neuroscience
Xinhui Li, Nathália Bianchini Esper, … Michael Peter Milham·Nature Human BehaviourPeer-reviewed·Aug 5, 2024
- Meta all the way down: An overview of neuroimaging meta-analyses
Kendra Oudyk, Jérôme Dockès, … J.-B. Poline·bioRxiv·Jan 21, 2025
- Analysis of task-based functional MRI data preprocessed with fMRIPrep
Oscar Estéban, Rastko Ćirić, … Krzysztof J. Gorgolewski·Nature ProtocolsPeer-reviewed·Jun 8, 2020