A conditional survival distribution-based method for censored data imputation: overcoming the hurdle in machine learning-based survival analysis
Yizhuo WangiD, Christopher R. FlowersiD, Ziyi LiiD, Xuelin HuangiD
Abstract
Data analyses by machine learning (ML) algorithms are gaining popularity in biomedical research. When time-to-event data are of interest, censoring is common and needs to be properly addressed. Most ML methods cannot conveniently and appropriately take the censoring information into consideration, potentially leading to inaccurate or biased results. We aim to develop a general-purpose method for imputing censored survival data, facilitating downstream ML analysis. In this study, we propose a novel method of imputing the survival times for censored observations. The proposal is based on their conditional survival distributions (CondiS) derived from Kaplan-Meier estimators. CondiS can replace censored observations with their best approximations from the statistical model, allowing for direct application of ML methods. When covariates are available, we extend CondiS by incorporating the covariate information through ML modeling (CondiS-X), which further improves the accuracy of the imputed survival time. Compared with existing methods with similar purposes, the proposed methods achieved smaller prediction errors and higher concordance with the underlying true survival times in extensive simulation studies. We also demonstrated the usage and advantages of the proposed methods through two real-world cancer datasets. The major advantage of CondiS is that it allows for the direct application of standard ML techniques for analysis once the censored survival times are imputed. We present a user-friendly R package to implement our method, which is a useful tool for ML-based biomedical research in this era of big data.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 2
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- SuperSurv: A Unified Framework for Machine Learning Ensembles in Survival Analysis
Y B Lyu, Steven Hsesheng Lin, … Ziyi Li·bioRxiv·Mar 27, 2026
- Fenchel duality of Cox partial likelihood and its application in survival kernel learning
Christopher M. Wilson, Kaiqiao Li, … Xuefeng Wang·Artificial Intelligence in MedicinePeer-reviewed·Apr 24, 2021
- dsSurvival 2.0: Privacy enhancing survival curves for survival models in the federated DataSHIELD analysis system
Soumya Banerjee, Tom R. P. Bishop·bioRxiv·May 25, 2023
- Semi-supervised Calibration of Risk with Noisy Event Times (SCORNET) Using Electronic Health Record Data
Yuri Ahuja, Liang Liang, … Tianxi Cai·BiostatisticsPeer-reviewed·Jan 25, 2022
- dsSurvival: Privacy preserving survival models for federated individual patient meta-analysis in DataSHIELD
Soumya Banerjee, Ghislain N. Sofack, … Tom R. P. Bishop·BMC Research NotesPeer-reviewed·Jun 3, 2022
- Efficient gradient boosting for prognostic biomarker discovery
Kaiqiao Li, Sijie Yao, … Xuefeng Wang·BioinformaticsPeer-reviewed·Dec 29, 2021