Sign in
BioinformaticsbioRxiv
Preprint

GenNA: Conditional generation of nucleotide sequences guided by natural-language annotations

Yi SheniD, Guangshuo CaoiD, Jianghong WuiD, Dijun CheniD, Cong Feng, Miaona CheniD

Abstract

Deciphering the mapping between linear biomolecular sequences and complex biological functions remains a central challenge in genomics. Although existing generative nucleotide language models have made substantial progress in modeling sequence distributions, they generally lack explicit access to high-level biological semantics, limiting their ability to support semantics-guided conditional generation. To address this limitation, we present GenNA, a generative nucleotide foundation model guided by natural-language annotations. GenNA is pretrained on a multimodal nucleotide-text corpus spanning 2,221 eukaryotic species and comprising approximately 416 billion characters, and learns the relationships between sequence patterns and functional annotations within a unified autoregressive framework. Systematic evaluations show that, even without explicit supervision from biological rules, GenNA yields distinguishable perplexity scores in response to semantic mismatches between sequences and functional annotations, to different mutation types, and to perturbations of species labels. Moreover, across a range of natural-language-guided nucleotide generation tasks, the model produces sequences consistent with both target semantics and species context. Overall, GenNA provides a unified framework for natural-language-guided nucleotide modeling and conditional generation, and offers a feasible route toward integrating high-level functional descriptions with low-level sequence design.

PDFDOI

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISShen '24Sanabria '23Fishman '24Shahgir '24Madani '20Praljak '24
67% semantic matchBioinformatics
Xilin Shen, Xiangchun Li·bioRxiv·Jan 14, 2024· 5 citations