A foundation model learns the sequence and functional grammar of fully human heavy-chain-only antibodies
Abstract
Antibody language models learn from large natural repertoires, but whether generic representations capture the constraints of specialized antibody formats remains unclear. We first characterized fully human heavy-chain-only antibodies (HCAbs) independently of HCAb-trained models. Source-aware comparisons with conventional human VH domains revealed a reproducible distributional shift localized predominantly to CDR1/2, CDR3 architecture and, where supported, a restricted framework region rather than widespread framework remodeling. These model-independent differences motivated repertoire-specific pretraining. We developed HCAbLM, to our knowledge the first foundation model pretrained specifically on a large-scale fully human HCAb repertoire, using 31.8 million sequences from 73 independently immunized HCAb mice. HCAbLM learned a region-selective sequence-compatibility prior distinct from conventional antibody language models, and its frozen representations transferred to experimentally measured SEC purity, HIC behavior and thermal stability in grouped internal validation and retrospective cross-project evaluation. These findings identify repertoire composition as an important biological design variable for foundation models of specialized antibody formats.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A generative foundation model for antibody sequence understanding
Justin Barton, Aretas Gaspariunas, … Jacob D. Galson·bioRxiv·May 22, 2024
- Learning the Language of Antibody Hypervariability
Rohit Singh, Chiho Im, … Bonnie Berger·Proceedings of the National Academy of SciencesPeer-reviewed·Dec 30, 2024
- AbBERT: Learning Antibody Humanness via Masked Language Modeling
Denis Vashchenko, Sam Nguyen, … Daniel Faissol·bioRxiv·Aug 2, 2022
- Addressing the antibody germline bias and its effect on language models for improved antibody design
Tobias Hegelund Olsen, Iain H. Moal, Charlotte Mary Deane·BioinformaticsPeer-reviewed·Oct 23, 2024
- Incorporating Pre-training Paradigm for Antibody Sequence-Structure Co-design
Kaiyuan Gao, Lijun Wu, … Tie‐Yan Liu·bioRxiv·Nov 14, 2022
- Ophiuchus-Ab: A Versatile Generative Foundation Model for Advanced Antibody-Based Immunotherapy
Yiheng Zhu, Jian Ma, … Tingjun Hou·bioRxiv·Feb 4, 2026