Multilayer meta-matching: translating phenotypic prediction models from multiple datasets to small data
Pansheng CheniD, Lijun AniD, Naren WulaniD, Chen ZhangiD, Shaoshi ZhangiD, Leon Qi Rong OoiiD, Ru KongiD, Jianzhong CheniD, Jianxiao WuiD, Sidhant ChopraiD, Danilo BzdokiD, Simon Bodo EickhoffiD, Avram J. HolmesiD, B.T. Thomas YeoiD
Abstract
Resting-state functional connectivity (RSFC) is widely used to predict phenotypic traits in individuals. Large sample sizes can significantly improve prediction accuracies. However, for studies of certain clinical populations or focused neuroscience inquiries, small-scale datasets often remain a necessity. We have previously proposed a "meta-matching" approach to translate prediction models from large datasets to predict new phenotypes in small datasets. We demonstrated large improvement of meta-matching over classical kernel ridge regression (KRR) when translating models from a single source dataset (UK Biobank) to the Human Connectome Project Young Adults (HCP-YA) dataset. In the current study, we propose two meta-matching variants ("meta-matching with dataset stacking" and "multilayer meta-matching") to translate models from multiple source datasets across disparate sample sizes to predict new phenotypes in small target datasets. We evaluate both approaches by translating models trained from five source datasets (with sample sizes ranging from 862 participants to 36,834 participants) to predict phenotypes in the HCP-YA and HCP-Aging datasets. We find that multilayer meta-matching modestly outperforms meta-matching with dataset stacking. Both meta-matching variants perform better than the original "meta-matching with stacking" approach trained only on the UK Biobank. All meta-matching variants outperform classical KRR and transfer learning by a large margin. In fact, KRR is better than classical transfer learning when less than 50 participants are available for finetuning, suggesting the difficulty of classical transfer learning in the very small sample regime. The multilayer meta-matching model is publicly available at GITHUB_LINK.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Translating phenotypic prediction models from big to small anatomical MRI data using meta-matching
Naren Wulan, Lijun An, … B.T. Thomas Yeo·Imaging NeurosciencePeer-reviewed·Jan 1, 2024
- Meta-matching: a simple framework to translate phenotypic predictive models from big to small data
Tong He, Lijun An, … B.T. Thomas Yeo·Nature NeurosciencePeer-reviewed·May 16, 2022
- Deep Neural Networks and Kernel Regression Achieve Comparable Accuracies for Functional Connectivity Prediction of Behavior and Demographics
Tong He, Ru Kong, … B.T. Thomas Yeo·NeuroImagePeer-reviewed·Oct 11, 2019
- Contributions of Site Heterogeneity in Multi-site Brain-Phenotype Predictions
Guanru Chen, Megan Jones, … Simon Vandekar·bioRxiv·Nov 4, 2026
- Brain-phenotype predictions can survive across diverse real-world data
Brendan D. Adkinson, Matthew Rosenblatt, … Dustin Scheinost·bioRxiv·Jan 23, 2024
- Performance reserves in brain-imaging-based phenotype prediction
Marc-André Schulz, Danilo Bzdok, … Kerstin Ritter·Cell ReportsPeer-reviewed·Dec 29, 2023