GenNA: Conditional generation of nucleotide sequences guided by natural-language annotations
Yi SheniD, Guangshuo CaoiD, Jianghong WuiD, Dijun CheniD, Cong Feng, Miaona CheniD
Abstract
Deciphering the mapping between linear biomolecular sequences and complex biological functions remains a central challenge in genomics. Although existing generative nucleotide language models have made substantial progress in modeling sequence distributions, they generally lack explicit access to high-level biological semantics, limiting their ability to support semantics-guided conditional generation. To address this limitation, we present GenNA, a generative nucleotide foundation model guided by natural-language annotations. GenNA is pretrained on a multimodal nucleotide-text corpus spanning 2,221 eukaryotic species and comprising approximately 416 billion characters, and learns the relationships between sequence patterns and functional annotations within a unified autoregressive framework. Systematic evaluations show that, even without explicit supervision from biological rules, GenNA yields distinguishable perplexity scores in response to semantic mismatches between sequences and functional annotations, to different mutation types, and to perturbations of species labels. Moreover, across a range of natural-language-guided nucleotide generation tasks, the model produces sequences consistent with both target semantics and species context. Overall, GenNA provides a unified framework for natural-language-guided nucleotide modeling and conditional generation, and offers a feasible route toward integrating high-level functional descriptions with low-level sequence design.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- OmniNA: A foundation model for nucleotide sequences
Xilin Shen, Xiangchun Li·bioRxiv·Jan 14, 2024
- The human genome's vocabulary as proposed by the DNA language model GROVER
Melissa Sanabria, Jonas Hirsch, Anna R. Poetsch·bioRxiv·Jul 19, 2023
- GENA-LM: A Family of Open-Source Foundational DNA Language Models for Long Sequences
Veniamin Fishman, Yuri Kuratov, … Mikhail Burtsev·Nucleic Acids ResearchPeer-reviewed·Dec 26, 2024
- RNA-DCGen: Dual Constrained RNA Sequence Generation with LLM-Attack
Haz Sameen Shahgir, Md. Rownok Zahan Ratul, … Atif Hasan Rahman·bioRxiv·Sep 23, 2024
- ProGen: Language Modeling for Protein Generation
Ali Madani, Bryan McCann, … Richard Socher·bioRxiv·Mar 7, 2020
- Natural Language Prompts Guide the Design of Novel Functional Protein Sequences
Niksa Praljak, Hugh Yeh, … Andrew L. Ferguson·bioRxiv·Nov 11, 2024