Beyond a single threshold: calibration of CADD v1.7 and AlphaGenome for ACMG/AMP computational evidence across variant classes, model versions, and reference data
José Patricio MirandaiD, Lorena Carvajal, Ignacio Aldana, Pablo Alarcón, Cristian Saavedra
Abstract
Clinical laboratories use computational predictors as supporting evidence for or against pathogenicity under the ACMG/AMP guidelines, but this evidence is reliable only when score thresholds are calibrated. Genome-wide predictors such as CADD are often applied using a single cutoff across all variant types and model versions, and the new AlphaGenome Variant Impact score (AVI) has not been calibrated. Following a prespecified plan and the ClinGen calibration method, we calibrated CADD v1.7 and AVI on rare ClinVar missense variants. Both predictors provided moderate evidence of pathogenicity and strong evidence of benignity, and their thresholds held for variants classified after calibration. AVI performed better than CADD in each comparison and approached the missense-specific predictors. Thresholds available in 2024 gave AVI evidence in the final direction for 72.5% of the variants of uncertain significance (VUS) resolved by 2026, compared with 60.5% for CADD. Applied to 1.2 million current missense VUS, the calibrated predictors agreed on pathogenic or benign evidence for four in ten, and on strong pathogenic evidence for 186 VUS reviewed by expert panels, which can be reassessed first. Outside missense variants, the same thresholds failed, producing false-benign evidence for pathogenic noncoding variants. A change in CADD version altered the evidence level for a third of variants without improving discrimination. Our results suggest that computational evidence is most reliable within the variant class and model version in which it was calibrated. In practice, laboratories may prioritize missense-specific predictors, use AVI when a genome-wide predictor is needed, and reassess thresholds after model updates.
02 /Specification & Classification
Click any tag to browse matching papers- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Evidence-based calibration of computational tools for missense variant pathogenicity classification and ClinGen recommendations for clinical use of PP3/BP4 criteria
Vikas Rao Pejaver, Alicia B. Byrne, … Scott Topper·The American Journal of Human GeneticsPeer-reviewed·Nov 21, 2022
- Calibration of additional computational tools expands ClinGen recommendation options for variant classification with PP3/BP4 criteria
Timothy R. Bergquist, Sarah L. Stenton, … Tina F. Pesaran·Genetics in MedicinePeer-reviewed·Mar 10, 2025
- Clinical evidence yield as a framework for evaluating computational predictors and multiplexed assays of variant effect
Yifei Shang, Mihaly Badonyi, Joseph A. Marsh·bioRxiv·Mar 30, 2026
- Gene- and domain-aware calibration increases the clinical utility of variant effect predictors
Y P Chen, Shawn Fayer, … Vikas Rao Pejaver·bioRxiv·Mar 31, 2026
- Empirically calibrated allele frequency thresholds for ACMG BA1, BS1 and PM2 evidence criteria
V.K. Dubey, Christopher Edward Eisenhart·medRxiv·Sep 9, 2026
- Variant effect predictors are shaping the ClinVar classifications used to train and evaluate them
Minyu Tao, Joseph A. Marsh·bioRxiv·Oct 27, 2026