bioRxivBioinformaticsPreprint
Codon language model scores provide information beyond protein language models for missense variant interpretation
Ruyi CheniD, Nathan J. PalpantiD, Gabriel FoleyiD, Mikael Bodén AiD
- Citations
- 1
Abstract
Predicting variant effects remains a central challenge in genomics. Protein language models (PLMs) capture amino-acid-level sequence constraints, whereas codon language models operate on coding sequences and may retain information that is lost upon translation. Here, we tested whether scores from the codon language model CaLM provide predictive information beyond protein-level representations for missense-variant interpretation. Across 71,436 ClinVar missense variants from 11,554 genes, adding CaLM to PLM baselines produced modest but reproducible improvements under gene-held-out cross-validation. PLM-only ensemble controls and explicit mutational-context analyses indicated that this improvement could not be explained solely by generic ensembling or simple codon-substitution features. Aggregating CaLM probabilities across synonymous codons attenuated codon-degeneracy-associated discordance while preserving most of the broader differences between CaLM and PLM scores. Gene-level analyses further showed that CaLM contribution varied continuously across genes and depended partly on the protein-model background. Across ClinMAVE functional assays, however, improvements were less consistent, indicating that codon-protein complementarity is context dependent rather than universal. Together, these results identify a modest but reproducible component of variant-effect information in CaLM-derived codon-level scores that is not fully captured by protein-level language-model representations.
- assay: whole-exome sequencing
- research focus: variant effect prediction
- research focus: benchmarking
- research focus: variant calling
- approach: statistical model
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- cdsBERT - Extending Protein Language Models with Codon Awareness
Logan Hallee, Nikolaos Rafailidis, Jason P. Gleghorn·bioRxiv·Sep 15, 2023
- Fine-tuning protein language models on human spatial constraint improves variant effect prediction by reducing wild-type sequence bias
Gyasu Bajracharya, John A. Capra·bioRxiv·Oct 15, 2025
- Codon language embeddings provide strong signals for protein engineering
Carlos Outeiral, Charlotte Mary Deane·bioRxiv·Dec 15, 2022
- A Suite of Foundation Models Captures the Contextual Interplay Between Codons
Mohsen Naghipourfar, Siyu Chen, … Hani Goodarzi·bioRxiv·Oct 10, 2024
- A protein language model for domain, functional site, and variant effect prediction
Peng Wang, Mian Umair Ahsan, … Kai Wang·bioRxiv·Nov 5, 2026
- Assessing Codon Language Models for Context-Aware Codon Optimization in Nucleic Acid-Based Medicines
Shushan Toneyan, Kerstin Scholz, … Joshua L. Payne·bioRxiv·Aug 19, 2026