Meta-matching: a simple framework to translate phenotypic predictive models from big to small data
Tong HeiD, Lijun AniD, Pansheng CheniD, Jianzhong CheniD, Jiashi FengiD, Danilo BzdokiD, Avram J. HolmesiD, Simon Bodo EickhoffiD, B.T. Thomas YeoiD
Abstract
There is significant interest in using brain imaging data to predict non-brain-imaging phenotypes in individual participants. However, most prediction studies are underpowered, relying on less than a few hundred participants, leading to low reliability and inflated prediction performance. Yet, small sample sizes are unavoidable when studying clinical populations or addressing focused neuroscience questions. Here, we propose a simple framework - "meta-matching" - to translate predictive models from large-scale datasets to new unseen non-brain-imaging phenotypes in boutique studies. The key observation is that many large-scale datasets collect a wide range inter-correlated phenotypic measures. Therefore, a unique phenotype from a boutique study likely correlates with (but is not the same as) some phenotypes in some large-scale datasets. Meta-matching exploits these correlations to boost prediction in the boutique study. We applied meta-matching to the problem of predicting non-brain-imaging phenotypes using resting-state functional connectivity (RSFC). Using the UK Biobank (N = 36,848), we demonstrated that meta-matching can boost the prediction of new phenotypes in small independent datasets by 100% to 400% in many scenarios. When considering relative prediction performance, meta-matching significantly improved phenotypic prediction even in samples with 10 participants. When considering absolute prediction performance, meta-matching significantly improved phenotypic prediction when there were least 50 participants. With a growing number of large-scale population-level datasets collecting an increasing number of phenotypic measures, our results represent a lower bound on the potential of meta-matching to elevate small-scale boutique studies.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 101
- FWCI
- 10.95
- Field percentile
- top 1%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Translating phenotypic prediction models from big to small anatomical MRI data using meta-matching
Naren Wulan, Lijun An, … B.T. Thomas Yeo·Imaging NeurosciencePeer-reviewed·Jan 1, 2024
- Multilayer meta-matching: translating phenotypic prediction models from multiple datasets to small data
Pansheng Chen, Lijun An, … B.T. Thomas Yeo·bioRxiv·Dec 5, 2023
- Performance reserves in brain-imaging-based phenotype prediction
Marc-André Schulz, Danilo Bzdok, … Kerstin Ritter·Cell ReportsPeer-reviewed·Dec 29, 2023
- Brain-phenotype predictions can survive across diverse real-world data
Brendan D. Adkinson, Matthew Rosenblatt, … Dustin Scheinost·bioRxiv·Jan 23, 2024
- The Burden of Reliability: How Measurement Noise Limits Brain-Behaviour Predictions
Martin Gell, Simon Bodo Eickhoff, … Robert Langner·bioRxiv·Feb 9, 2023
- Rescuing missing data in connectome-based predictive modeling
Qinghao Liang, Rongtao Jiang, … Dustin Scheinost·Imaging NeurosciencePeer-reviewed·Jan 4, 2024