Protein language models learn the underlying accessibility of mutations alongside protein fitness landscapes
Oscar A. MacLeaniD, Kieran lamb, Spyros LytrasiD, Laura Noelia MojsiejczukiD, Ke YuaniD, Joseph HughesiD, David L. RobertsoniD
Abstract
Protein language models (PLMs) score the effects of amino acid replacements as pseudo-probabilities, which are widely utilised to map protein fitness landscapes. However, because their training data relies on natural amino acid sequences, these models conflate protein structural constraints with nucleotide mutation biases and codon accessibility. Using the rapid emergence of the divergent influenza A H3N2 K lineage as a stress test, we investigate how base PLMs (ESM-2 and ESM-C) versus fine-tuned versions of these models capture mutational processes. We systematically implement a parameter sweep to explicitly couple (or decouple) empirical nucleotide mutational supply from PLM-assessed amino acid substitution pseudo-probabilities across evolutionary forecasting tasks. We find that base PLMs implicitly learn generic nucleotide-level mutational constraints, an effect strongly amplified by virus-specific fine-tuning. Incorporating explicit mutational accessibility significantly improves the binary prediction of observed amino acid changes. Conversely, when predicting the final circulating frequency of variants that have already emerged, adding mutational supply degrades performance, confirming that selection dominates post-emergence dynamics. Additionally, we perform amino-acid-level epistatic scanning to investigate protein structural constraints in the context of genetic background. This indicates the improbable antigenic substitution I160K is dependent on co-occurring S144N and N158D mutations in the H3N2 K lineage. Ultimately, current PLM pseudo-probabilities are a composite metric that conflates protein structural fitness with historical biases in mutational supply. Explicitly decoupling these independent evolutionary processes optimises predictive accuracy for real-world pathogen forecasting and isolates pure protein fitness for synthetic design pipelines.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Tree-aware conditional language modeling recovers mutational patterns of viral evolution
Polina Polunina, Wolfgang Maier, Alan F. Rubin·bioRxiv·Aug 26, 2026
- Protein Language Model Fitness Is a Matter of Preference
Cade Gordon, Amy X. Lu, Pieter Abbeel·bioRxiv·Oct 3, 2024
- Simple baselines rival protein language models in dense combinatorial protein landscapes
Itay Talpir, Sarel Jacob Fleishman·bioRxiv·May 8, 2026
- From a single sequence to evolutionary trajectories: protein language models capture the evolutionary potential of SARS-CoV-2 protein sequences
Kieran D. Lamb, Joseph Hughes, … David L. Robertson·bioRxiv·Jul 5, 2024
- Protein Language Models Capture Structural and Functional Epistasis in a Zero-Shot Setting
Ananthan Nambiar, Sayantani B. Littlefield, … Sergei Maslov·bioRxiv·Sep 14, 2025
- Intrinsic dataset features drive mutational effect prediction by protein language models
Luiz Carlos Vieira, Sophia Lin, Claus O. Wilke·bioRxiv·Jun 17, 2026