The Hidden Landscape of Missed Effects in Human Functional Neuroimaging
Stephanie NobleiD, Hallee SheareriD, Matthew RosenblattiD, Jean YeiD, Rongtao JiangiD, Link TejavibulyaiD, Maya L. FosteriD, Qinghao LiangiD, Javid DadashkarimiiD, Margaret L. WestwateriD, Iris Q. ChengiD, Max J. RolisoniD, Hannah Peterson, Brendan D. AdkinsoniD, Saloni MehtaiD, Chris CampiD, Alexandra K. FischbachiD, Fabricio CravoiD, Amanda F. MejiaiD, Thomas E. NicholsiD, Joshua E. CurtissiD, Dustin ScheinostiD
Abstract
Functional neuroimaging aims to uncover brain processes underlying behavior and disease, yet studies are often underpowered to detect these effects. How this literature has shaped our understanding of brain function remains unknown, and little guidance exists for planning better powered studies. An underappreciated barrier is that commonly reported effect sizes across the brain are inflated, biasing study planning. Here, we introduce a correction for this inflation bias and show how more accurate studies can be planned using corrected effect size benchmarks from a mega-analysis of 63 typical studies across seven large datasets (52,979 participants). We find that common methods of planning studies based on uncorrected effects lead to roughly half the expected detections at typical sample sizes, with limited spatial overlap with original findings. These missed effects collectively explain meaningful additional variance in the desired outcome. We show how to recover missed effects by planning not only for power but also for a target number of detections via corrected benchmarks, or by taking a whole-brain approach with multivariate effects that individual research groups can detect (n 1,000 for a typical univariate effect). These findings lay the groundwork for more informed study planning and a richer understanding of the widespread nature of brain effects, with implications for shared challenges (and solutions) across biomedicine.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Leveling up: improving power in fMRI by moving beyond cluster-level inference
Stephanie Noble, Amanda F. Mejia, … Dustin Scheinost·Proceedings of the National Academy of SciencesPeer-reviewed·Aug 4, 2022
- Power and sample size calculations for fMRI studies based on the prevalence of active peaks.
Joke Durnez, Jasper Degryse, … Thomas E. Nichols·bioRxiv·Apr 20, 2016
- Reproducibility of neuroimaging studies of brain disorders with hundreds -not thousands- of participants
Ilan Libedinsky, Koen Helwegen, … Martijn P. van den Heuvel·bioRxiv·Jul 5, 2022
- Towards Reproducible Brain-Wide Association Studies
Scott A. Marek, Brenden Tervo‐Clemmens, … Nico U.F. Dosenbach·bioRxiv·Aug 21, 2020
- Is the Statistic Value All We Should Care about in Neuroimaging?
Gang Chen, Paul A Taylor, Robert W Cox·NeuroImagePeer-reviewed·Feb 1, 2017
- Scanning the Horizon: Towards transparent and reproducible neuroimaging research
R. Poldrack, C. I. Baker, … T. Yarkoni·bioRxiv·Aug 1, 2016