Fine-tuning protein language models on human spatial constraint improves variant effect prediction by reducing wild-type sequence bias
Abstract
Protein language models (PLMs) achieve state-of-the-art performance in predicting effects of missense variants, yet they do not explicitly consider variation within the human population. Here, we introduce Human Spatial Constraint (HuSC), a framework for quantifying intraspecies constraint on missense variants that integrates population-scale human genetic variation with 3D protein structures. We then fine-tune PLMs on HuSC scores. HuSC models the expected frequency of missense variation under neutral evolution and compares it to observed variation, accounting for both variation in mutational processes and 3D structural context. HuSC outperforms traditional inter- and intraspecies conservation metrics in predicting pathogenic variants. By focusing on intraspecies variation, HuSC reveals protein sites under human-specific constraint that cannot be captured by interspecies models. Integrating this intraspecies perspective into PLMs by fine-tuning on HuSC scores improves the prediction of variant fitness from deep mutational scans across diverse taxa and functional assay types. The improvement after fine-tuning comes largely from reducing bias toward wild-type sequences in regions that tolerate variation. Together, these results demonstrate that combining intraspecies constraint with cross-species PLMs improves their performance in variant-effect interpretation.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Improving Variant Effect Prediction by Steering Sparse Mechanistic Features in Protein Language Models
Mingqing Wang, Meng Yuan, … Zhixiang Ren·bioRxiv·May 15, 2026
- Codon language model scores provide information beyond protein language models for missense variant interpretation
Ruyi Chen, Nathan J. Palpant, … Mikael Bodén A·bioRxiv·Mar 12, 2025
- Genome-wide prediction of disease variants with a deep protein language model
Nadav Brandes, Grant Goldman, … Vasilis Ntranos·bioRxiv·Aug 25, 2022
- From Likelihood to Fitness: Improving Variant Effect Prediction in Protein and Genome Language Models
Charles W. J. Pugh, Paulina G. Nuñez-Valencia, … Jonathan Frazer·neural information processing systemsPeer-reviewed·Jan 1, 2025
- Expert-guided protein Language Models enable accurate and blazingly fast fitness prediction
Céline Marquet, Julius Schlensok, … Élodie Laine·BioinformaticsPeer-reviewed·Nov 1, 2024
- From a single sequence to evolutionary trajectories: protein language models capture the evolutionary potential of SARS-CoV-2 protein sequences
Kieran D. Lamb, Joseph Hughes, … David L. Robertson·bioRxiv·Jul 5, 2024