Nature Machine IntelligenceBioinformaticsPeer-reviewed journal article
Generalized Biological Foundation Model with Unified Nucleic Acid and Protein Language
Yong HeiD, Pan FangiD, Yongtao ShaniD, Yuanfei PaniD, Yanhong WeiiD, Yichang CheniD, Yihao CheniD, Yi LiuiD, Zhenyu ZengiD, Zhan Mei ZhouiD, Feng ZhuiD, Edward Charles HolmesiD, Jieping YeiD, Jun LiiD, Yuelong ShuiD, Mǎng ShīiD, Zhaorong LiiD
Abstract
AbstractThe language of biology, encoded in DNA, RNA, and proteins, forms the foundation of life but remains challenging to decode due to its complexity. Traditional computational methods often struggle to integrate information across these molecules, limiting a comprehensive understanding of biological systems. Advances in Natural Language Processing (NLP) with pre-trained models offer new possibilities for interpreting biological language. Here, we introduce LucaOne, a pre-trained foundation model trained on nucleic acid and protein sequences from 169,861 species. Through large-scale data integration and semisupervised learning, LucaOne demonstrates an understanding of key biological principles, such as DNA-Protein translation. Using few-shot learning, it effectively comprehends the central dogma of molecular biology and performs competitively on tasks involving DNA, RNA, or protein inputs. Our results highlight the potential of unified foundation models to address complex biological questions, providing an adaptable framework for bioinformatics research and enhancing the interpretation of lifes complexity.
- organism: multiple species
- assay: DNA methylation
- assay: protein sequence
- research focus: software / tool
- approach: deep learning
- approach: statistical model
- Citations
- 55
- FWCI
- 15.96
- Field percentile
- top 1%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Integration of protein and coding sequences enables mutual augmentation of the language model
Heng-Rui Zhao, Meng‐Ting Cheng, … Cong‐Zhao Zhou·bioRxiv·Oct 24, 2024
- Find Central Dogma Again: Leveraging Multilingual Transfer in Large Language Models
Liang Wang·bioRxiv·Feb 10, 2025
- Bridging biomolecular modalities for knowledge transfer in bio-language models
Mangal Prakash, Artem Moskalev, … Rui Liao·bioRxiv·Oct 15, 2024
- CD-GPT As a Biological Foundation Model Bridging the Gap between Molecular Sequences Through Central Dogma
Xiao Zhu, Chenchen Qin, … Jianhua Yao·bioRxiv·Jun 24, 2024
- Distinguishing word identity and sequence context in DNA language models
Melissa Sanabria, Jonas Hirsch, Anna R. Poetsch·BMC BioinformaticsPeer-reviewed·Sep 13, 2024
- Language modelling for biological sequences - curated datasets and baselines
José Juan Almagro Armenteros, Alexander Rosenberg Johansen, … Henrik Nielsen·bioRxiv·Mar 9, 2020