External Evaluation of Multi-Omics Prognostic Models Across TCGA-BRCA and METABRIC: Transportability, Stability, and Incremental Performance
Abstract
Cross-cohort evaluation of multi-omics prognostic models can fail because molecular features are not assayable, fitted models do not transport, feature selection is unstable, or molecular data add little beyond clinical predictors. We used a dual-track evaluation design with TCGA-BRCA as the source cohort and METABRIC as the independent target cohort. Track A tested outcome-blind transport of fixed historical RNA and copy-number models without target-cohort refitting, whereas Track B reconstructed the dependency-aware selection procedure within METABRIC using leakage-controlled repeated cross-validation. Literal transport provided little or negative incremental overall-survival discrimination: RNA reduced Harrell's C-index relative to clinical prediction (Delta C = -0.0136), while copy number was essentially neutral. Track B showed no reliable overall-survival gain for RNA, copy number, or mutation; methylation and the reconstructed multimodal model performed worse than matched clinical comparators. In a protocol-locked post-hoc extension, the same fixed features were retained but model parameters were re-estimated within METABRIC. Incremental C-index increased by 0.0162 for RNA, 0.0091 for copy number, and 0.0201 for the combined panel. Random-panel benchmarks showed that the RNA gain was common among alternative panels, whereas the historical copy-number panel ranked above all 200 panels sampled from its recovered assayable candidate space. The recurrence-free-survival sensitivity analysis showed a positive RNA contrast (Delta C = 0.0146). These results separate failure of fixed-model transport from loss of information in the underlying feature set and show that successful local redevelopment does not by itself establish feature-set specificity.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- SurvBoard: Standardised Benchmarking for Multi-omics Cancer Survival Models
David Wissel, Nikita Janakarajan, … Valentina Boeva·bioRxiv·Nov 18, 2022
- Evaluation effects can rival reported concordance gains in cross-cancer survival prediction
Ricky Nguyen, Fatemeh Vafaee·bioRxiv·Nov 9, 2026
- Methylation-To-Expression Feature Models of Breast Cancer Accurately Predict Overall Survival, Distant-Recurrence Free Survival, And Pathologic Complete Response in Multiple Cohorts
Jeffrey A. Thompson, Brock C. Christensen, Carmen J. Marsit·Scientific ReportsPeer-reviewed·Mar 26, 2018
- OmniT2I: a unified table-to-image framework for survival prediction and cross-modal inference with incomplete multimodal cancer data
P. Li, Z. Majeed, … Elshad Hasanov·bioRxiv·Nov 10, 2026
- SurvBenchmark: comprehensive benchmarking study of survival analysis methods using both omics data and clinical data
Yunwei Zhang, Germaine Wong, … Jean Yee Hwa Yang·GigaSciencePeer-reviewed·Jan 1, 2022
- SurvivalML: an integrative platform for the discovery and exploration of prognostic models in multi-center cancer cohorts
Zaoqu Liu, Hui Xu, … Xinwei Han·bioRxiv·Oct 25, 2022