For antibody sequence generative modeling, mixture models may be all you need
Abstract
Antibody therapeutic candidates must exhibit not only tight binding to their target but also good developability properties, especially low risk of immunogenicity. In this work, we fit a simple generative model, SAM, to sixty million human heavy and seventy million human light chains. We show that the probability of a sequence calculated by the model distinguishes human sequences from other species with the same or better accuracy on a variety of benchmark datasets containing >400 million sequences than any other model in the literature, outperforming large language models (LLMs) by large margins. SAM can humanize sequences, generate new sequences, and score sequences for humanness. It is both fast and fully interpretable. Our results highlight the importance of using simple models as baselines for protein engineering tasks. We additionally introduce a new tool for numbering antibody sequences which is orders of magnitude faster than existing tools in the literature. Both these tools are available at https://github.com/Wang-lab-UCSD/AntPack.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 11
- FWCI
- 2.79
- Field percentile
- top 10%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Generative language modeling for antibody design
R. W. Shuai, J. A. Ruffolo, J. J. Gray·bioRxiv·Dec 13, 2021
- A generative foundation model for antibody sequence understanding
Justin Barton, Aretas Gaspariunas, … Jacob D. Galson·bioRxiv·May 22, 2024
- p-IgGen: A Paired Antibody Generative Language Model
Oliver M. Turnbull, Dino Oglić, … Charlotte Mary Deane·BioinformaticsPeer-reviewed·Nov 1, 2024
- Benchmarking Generative Large Language Models for de novo Antibody Design and Agentic Evaluation
Delower Hossain, Fuad Al Abir, … Jake Y. Chen·bioRxiv·Apr 21, 2026
- AbBERT: Learning Antibody Humanness via Masked Language Modeling
Denis Vashchenko, Sam Nguyen, … Daniel Faissol·bioRxiv·Aug 2, 2022
- Antibody Humanization via Protein Language Model and Neighbor Retrieval
Honggang Zou, Rongqing Yuan, … Jinbo Xu·bioRxiv·Sep 4, 2023