An openly licensed benchmark and per-gene calibration map for missense pathogenicity predictors on activating cancer drivers
Abstract
Missense pathogenicity predictors such as AlphaMissense are increasingly used in clinical variant interpretation, yet they are trained on germline labels dominated by loss-of-function (LOF) variants. Using an openly licensed, reproducible benchmark of 768 Cancer Gene Census genes scored with 49 predictors (labels from CIViC, COSMIC, cancerhotspots, ClinVar and gnomAD), we show that 42 of 49 tools (86%) score oncogene, gain-of-function (GOF) variants worse than tumour-suppressor variants. This under-scoring is mechanistically characterized: missed drivers occupy low-conservation, solvent-exposed, non-destabilizing positions (phyloP 2.51 versus 7.89; relative solvent accessibility 0.671 versus 0.185; gene-clustered p = 4.8x10-{superscript 2} and 2.3x10-3), and, counter-intuitively, the unsupervised and protein-language models now entering clinical use are the most affected. Per-gene oncogenic thresholds span 0.07-0.99, so a single global cut-off is mis-calibrated for most genes; we provide a per-gene calibration map. A cancer-calibrated stack (OncoCal) modestly improves discrimination over the best single tool (AUROC {approx} 0.93 versus 0.87), rescues drivers such as JAK2 V617F (0.334[->]0.57), and generalizes to independent deep mutational scanning data. We provide an openly licensed framework to interpret and recalibrate these tools in the somatic setting rather than a replacement predictor.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Gene identity, not variant effect, dominates ClinVar benchmarks of missense pathogenicity predictors
Saad Harrizi, Imane Nait Irahal, … Damien Arnoult·bioRxiv·Aug 24, 2026
- Are the Next-Generation Pathogenicity Predictors Applicable to Cancer?
Daria S. Ostroverkhova, Yiru Sheng, Anna R. Panchenko·Journal of Molecular BiologyPeer-reviewed·Jun 5, 2024
- An interpretable molecular framework for predicting cancer driver missense mutations
Yan Yang, Weikang Sun, … Minghui Li·Proceedings of the National Academy of SciencesPeer-reviewed·Feb 3, 2026
- Leveraging cancer mutation data to predict the pathogenicity of germline missense variants
Bushra Haque, David Cheerie, … Gregory Costain·medRxiv·Mar 11, 2024
- A Collaborative Approach to Improving Missense Mutational Effect Predictions in Oncoproteins
Ayten Dizkırıcı, Mustafa Tekpinar·medRxiv·May 15, 2025
- MARiO: predicting cancer variant pathogenicity by integrating in silico evaluation and patient-level mutational contexts
Haruko Nakagawa, Takashi Kamatani, … Sadakatsu Ikeda·bioRxiv·Jul 10, 2026