Availability of benign missense variant truthsets for validation of functional assays: current status and a novel systematic approach
Charlie F RowlandsiD, Sophie AlleniD, Alice GarrettiD, Miranda DurkieiD, George J. BurgheliD, Rachel RobinsoniD, Alison CallawayiD, Joanne Field, Bethan A. Frugtniet, Sheila Palmer-Smith, Jonathan GrantiD, Judith Pagan, Trudi McDevittiD, Katie M.G. SnapeiD, Helen HansoniD, Terri Patricia McVeighiD, Clare TurnbulliD, CanVIG-UK
Abstract
Multiplex assays of variant effect (MAVEs) provide promising new sources of functional evidence, potentially empowering improved classification of germline genomic variants, particularly rare missense variants, which are commonly assigned as VUS (variants of uncertain significance). However, paradoxically, quantification of clinically applicable evidence strengths for MAVEs requires construction of "truthsets" comprising missense variants already robustly classified as pathogenic and benign. In this study, we demonstrate how benign truthset size is the primary driver of applicable functional evidence towards pathogenicity (PS3). We demonstrate, when using existing ClinVar classifications as a source of benign missense truthset variants, for only 19.8% (23/116) of established cancer susceptibility genes was a PS3 evidence strength of "strong" attainable when simulating validation for a hypothetical new MAVE (applying also favourable assumption of perfect concordance). We describe a "proactive-systematic" framework for benign truthset construction, in which all possible missense variants in a gene of interest are concurrently assessed for assignation of (likely) benignity via established ACMG/AMP combination rules including population frequency, in silico evidence codes and case-control signal. We apply this framework to eight hereditary breast and ovarian cancer genes, demonstrating that proactive-systematically generated benign missense truthsets allow maximum application of PS3 at greater (or equivalent) strength - reaching "moderate" for CHEK2 and "strong" for the other seven genes - than those derived from ClinVar [≥]2* classifications alone. We propose, given many genes have few existing benign-classified missense variants, application of this proactive-systematic framework to disease genes more broadly will be important for leveraging full value from MAVEs.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 6
- FWCI
- 3.51
- Field percentile
- top 6%
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- 'Truthsets' for clinical validation of large-scale functional assays: Practice recommendations from Cancer Variant Interpretation Group UK (CanVIG-UK)
Sophie Allen, Charlie F Rowlands, … Cancer Variant Interpretation Group UK (CanVIG-UK)·medRxiv·Jul 13, 2026
- Clinical validation of large-scale functional assays: insights from 2,120 gene-truthset-assay evaluations
Sophie Allen, Charlie F Rowlands, … Cancer Variant Interpretation Group UK (CanVIG-UK)·medRxiv·Jul 14, 2026
- Validating data from Multiplex Assays of Variant Effect (MAVEs): A CanVIG-UK National Survey of NHS Clinical Scientists
Sophie Allen, Alice Garrett, … CanVIG-UK·The American Journal of Human GeneticsPeer-reviewed·Jun 1, 2025
- Clinical evidence yield as a framework for evaluating computational predictors and multiplexed assays of variant effect
Yifei Shang, Mihaly Badonyi, Joseph A. Marsh·bioRxiv·Mar 30, 2026
- Assigning credit where it's due: An information content score to capture the clinical value of Multiplexed Assays of Variant Effect
John Michael O. Rañola, Carolyn Horton, … Brian H. Shirts·BMC BioinformaticsPeer-reviewed·Sep 6, 2024
- When Two plus Four Does Not Equal Six: Combining Computational and Functional Evidence to Classify BRCA1 Key Domain Missense Substitutions.
Scott Pew, Madison B. Wiffler, … Sean V. Tavtigian·The American Journal of Human GeneticsPeer-reviewed·Aug 18, 2025