bioRxivBioinformaticsPreprint
Comparison of missing data handling methods for variant pathogenicity predictors
Mikko SärkkäiD, Sami Myöhänen, Kaloyan Marinov, Inka SaarineniD, Leo LahtiiD, Vittorio FortinoiD, Jussi PaananeniD
Abstract
1BackgroundModern clinical genetic tests utilize next-generation sequencing (NGS) approaches to comprehensively analyze genetic variants from patients. Out of these millions of variants, clinically relevant variants that match the patients phenotype need to be identified accurately within a rapid timeframe that facilitates clinical action. As manual evaluation of variants is not a feasible option for meeting the speed and volume requirements of clinical genetic testing, automated solutions are needed. Various machine learning (ML), artificial intelligence (AI), and in silico variant pathogenicity predictors have been developed to solve this challenge. These solutions rely on the comprehensiveness of the available data and struggle with the sparse nature of genetic variant data. Therefore, careful treatment of missing data is necessary, and the selected methods may have a huge impact on the accuracy, reliability, speed and associated computational costs. ResultsWe present an open-source framework called AMISS that can be used to evaluate performance of different methods for handling missing genetic variant data in the context of variant pathogenicity prediction. Using AMISS, we evaluated 14 methods for handling missing values. The performance of these methods varied substantially in terms of precision, computational costs, and other attributes. Overall, simpler imputation methods and specifically mean imputation performed best. ConclusionsSelection of the missing data handling method is crucial for AI/ML-based classification of genetic variants. We show that utilizing sophisticated imputation methods is not worth the cost when used in the context of genetic variant pathogenicity classification.
- assay: whole-exome sequencing
- assay: whole-genome sequencing
- research focus: variant effect prediction
- research focus: benchmarking
- research focus: variant calling
- approach: machine learning (classical)
- approach: statistical model
- Citations
- 2
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Critical assessment of missense variant effect predictors on disease-relevant variant data
Ruchir Rastogi, Ryan Chung, … Nilah M. Ioannidis·Human GeneticsPeer-reviewed·Mar 1, 2025
- MVP: predicting pathogenicity of missense variants by deep learning
Hongjian Qi, Chen Chen, … Yufeng Shen·bioRxiv·Apr 2, 2018
- Genetic variant pathogenicity prediction trained using disease-specific clinical sequencing datasets
Perry Evans, Chao Wu, … Ahmad N. Abou Tayoun·Genome ResearchPeer-reviewed·Jul 1, 2019
- Assessment of variant effect predictors unveils variants difficulty as a critical performance indicator
Ragousandirane Radjasandirane, Julien Diharce, … Alexandre G. de Brevern·GenomicsPeer-reviewed·Mar 22, 2025
- A New Era in Missense Variant Analysis: Statistical Insights and the Introduction of VAMPP-Score for Pathogenicity Assessment
Eylul Aydin, Berk Ergun, … Özkan Özdemir·bioRxiv·Jul 11, 2024
- Ancestry-specific performance of variant effect predictors in clinical variant classification
Rachel A. Hoffing, Daniel Zeiberg, … Predrag Radivojac A·bioRxiv·Feb 17, 2026