Generalizing Protein Fitness Prediction Across Distribution Shifts via Structural and Co-evolutionary Priors
Nopsinth VithayapalertiD, Maytus PiriyajitakonkijiD, Francesca GrisoniiD
Abstract
Protein fitness prediction is essential for protein engineering. Recent fitness-landscape benchmarks such as FLIP2 have shown that methods performing well under conventional train-test splits can fail when the test set is shifted out of distribution (OOD), including mutations at unseen positions and variants from unseen protein backbones. In particular, current protein language models (pLMs) often suffer substantial performance degradation under such distribution shifts, limiting their practical use in protein engineering. We therefore develop a framework that augments sequence representations with structural and co-evolutionary information for fitness prediction. Specifically, we pair structure-aware pLMs with features pooled from an AlphaFold-style trunk applied to each sequence and its multiple sequence alignment (MSA), and use a lightweight prediction probe to map these frozen representations to fitness scores. Our framework consistently outperforms the best previously reported FLIP2 scores across several types of distribution shift. We then systematically study the contribution of each component in our framework to generalization. Structural priors yield the largest performance gains on held-out protein backbones, whereas trunk features improve generalization to held-out mutation positions. Rather than proposing a single best method, we characterize which modalities are effective for different protein families and distribution shifts, providing practical guidance for choosing representations according to the generalization regime. These findings support the development of more generalizable fitness predictors that can serve as effective reward functions or oracles for protein design toward desired functions.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Protein Language Model Fitness Is a Matter of Preference
Cade Gordon, Amy X. Lu, Pieter Abbeel·bioRxiv·Oct 3, 2024
- FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications
Kieran Didi, Sarah Alamdari, … Kevin K. Yang·bioRxiv·Aug 7, 2026
- Protein Language Models: Learning From Evolution, Designing Beyond It
Maurice Brenner, Julius Schlensok, … Michael Heinzinger·bioRxiv·Sep 24, 2026
- Likelihood-based fine-tuning of protein language models for few-shot fitness prediction and design
Alex Hawkins‐Hooker, Shikha Surana, … Paul Duckworth·bioRxiv·May 28, 2024
- Contrastive Fitness Learning: Reprogramming Protein Language Models for Low-N Learning of Protein Fitness Landscape
Junming Zhao, Chao Zhang, Yunan Luo·bioRxiv·Feb 11, 2024
- Designing diverse and high-performance proteins with a large language model in the loop
Carlos Alberto Gomez-Uribe, Japheth E. Gado, Meiirbek Islamov·PLoS Computational BiologyPeer-reviewed·Jun 5, 2025