Disagreement among variant effect predictors guides experimental prioritization of target proteins
Nicolas JonssoniD, Joseph A. MarshiD, Kresten Lindorff‐LarseniD
Abstract
Interpreting the functional consequences of genetic variation, especially rare missense variants, remains a significant challenge in human genetics. Computational variant effect predictors (VEPs) and multiplexed assays of variant effects (MAVEs) provide complementary approaches, with VEPs offering scalable predictions and MAVEs delivering detailed empirical measurements. However, MAVEs are resource intensive and cannot yet be applied broadly across the proteome, making it important to identify proteins where experimental mapping will be most informative. We hypothesised that MAVEs should be particularly valuable for proteins where computational predictors disagree, as such disagreement may highlight mechanistic blind spots. To test this, we analysed predictions from ten distinct VEPs across more than 13,000 human proteins and quantified inter-predictor concordance. We observed substantial variability across proteins in the degree of agreement across predictors and investigated structural, functional and gene-level features associated with this variation. We find that inter-VEP concordance showed no relationship with agreement to experimental MAVE data. If predictor agreement reflected how intrinsically predictable a protein is, these quantities would be expected to correlate. Their decoupling instead suggests that MAVEs may provide orthogonal information to VEPs, supporting the use of inter-VEP disagreement to prioritise proteins where experimental data will be most informative. We therefore propose using inter-VEP disagreement as a practical strategy to prioritise proteins for experimental characterization. Focusing on proteins with low predictor concordance should maximise the informational value of new MAVEs, and improve variant interpretation in both research and clinical contexts.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Why variant effect predictors and multiplexed assays agree and disagree
Benjamin Livesey, Joseph A. Marsh·Nature CommunicationsPeer-reviewed·Aug 27, 2026
- Clinical evidence yield as a framework for evaluating computational predictors and multiplexed assays of variant effect
Yifei Shang, Mihaly Badonyi, Joseph A. Marsh·bioRxiv·Mar 30, 2026
- Leakage-Controlled Benchmarking of Variant Effect Predictors and Development of Gradient-Boosting Consensus Model
Martin Havlasek, Petr Kabourek, … David Bednar·bioRxiv·Nov 2, 2026
- Variant effect predictor correlation with functional assays is reflective of clinical classification performance
Benjamin Livesey, Joseph A. Marsh·Genome biologyPeer-reviewed·Apr 22, 2025
- Assessment of variant effect predictors unveils variants difficulty as a critical performance indicator
Ragousandirane Radjasandirane, Julien Diharce, … Alexandre G. de Brevern·GenomicsPeer-reviewed·Mar 22, 2025
- Understanding the heterogeneous performance of variant effect predictors across human protein-coding genes
Fawzy Mohamed, Joseph A. Marsh·Scientific ReportsPeer-reviewed·Oct 30, 2024