Why variant effect predictors and multiplexed assays agree and disagree
Abstract
Computational variant effect predictors (VEPs) and multiplexed assays of variant effect (MAVEs) are two key tools for assessing the functional consequences of genetic variants. While their outputs are often concordant, there are also many differences. Here, we analyse missense MAVE data from 37 different human proteins, comparing them to five state-of-the-art VEPs in order to quantify and explain their points of agreement and disagreement. We find that discordance is not random but reflects fundamental differences in how each method infers functional impact. VEPs, which rely heavily on sequence conservation and basic structural features, tend to overcall pathogenicity at buried and hydrophobic residues, while underestimating impact in disordered regions and on charged surface residues. MAVEs, by contrast, capture context-specific mechanisms more accurately, but can miss pathogenic variants when the assay fails to reflect disease biology, or be subject to high levels of experimental noise. By comparing both global patterns and specific clinically relevant variants, we show how protein features, assay design, and variant type shape predictive discordance. Our findings provide a framework for interpreting when and why VEPs and MAVEs diverge and point toward strategies for improving variant interpretation through integrated, mechanism-aware approaches.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 6
- FWCI
- 15.83
- Field percentile
- top 1%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Disagreement among variant effect predictors guides experimental prioritization of target proteins
Nicolas Jonsson, Joseph A. Marsh, Kresten Lindorff‐Larsen·bioRxiv·Mar 20, 2026
- Clinical evidence yield as a framework for evaluating computational predictors and multiplexed assays of variant effect
Yifei Shang, Mihaly Badonyi, Joseph A. Marsh·bioRxiv·Mar 30, 2026
- Variant effect predictor correlation with functional assays is reflective of clinical classification performance
Benjamin Livesey, Joseph A. Marsh·Genome biologyPeer-reviewed·Apr 22, 2025
- Understanding the heterogeneous performance of variant effect predictors across human protein-coding genes
Fawzy Mohamed, Joseph A. Marsh·Scientific ReportsPeer-reviewed·Oct 30, 2024
- Inferring Protein Variant Impacts Across Contexts
Alireza Rasoulzadeh, Vignesh Senguttuvan, … Frederick P. Roth·bioRxiv·Aug 20, 2026
- MaveRegistry: a collaboration platform for multiplexed assays of variant effect
Da Kuang, Jochen Weile, … Frederick P. Roth·BioinformaticsPeer-reviewed·Mar 26, 2021