bioRxivGenomicsPreprint
A multispecies foundation model for genome function prediction, gene annotation and sequence design
Sam Boshar, Benjamin Evans, Ziqi TangiD, Yanis Adel, Yohan Bornachot, Shawn Sidbon, Franziska K. LorbeeriD, Armand Picard, Chandana RajeshiD, Evan Seitz, David EmmsiD, Javier Mendoza‐RevillaiD, Ariana Hernandez, Fatimah Al-Ani, Tristan Karch, Yair SchiffiD, Marie LopeziD, Alexandre Laterre, Karim BeguiriD, Peter K. KooiD, Volodymyr KuleshoviD, Alexander StarkiD, Bernardo P. de AlmeidaiD, Thomas PierrotiD
Abstract
Comparative genomics and synthetic biology require models that can interpret, annotate, and design DNA sequences across species, yet genomic models have not combined these capabilities beyond a few well-characterized organisms. Here we introduce Nucleotide Transformer v3 (NTv3), a long-context cross-kingdom foundation model that provides a common backbone for functional prediction, gene annotation and controllable sequence generation across phylogenetically diverse species. NTv3 is pre-trained on more than 128,000 genomes using sequences up to 1Mb and post-trained on 16,262 functional tracks across 15 animal and plant genomes. NTv3 performs comparably to AlphaGenome on matched human assays and matches or exceeds evaluated published models for functional-track prediction across 19 species spanning mammals, birds, fish, plants, fungi and protists. Ablation experiments show that both genome pre-training and expanding functional supervision from human and mouse to 15 species improve track prediction. Leveraging these learned functional representations, NTv3 outperforms leading ab initio gene predictors across mammals, plants and insects, with fewer spurious gene models and improved recovery and reduced fragmentation of long genes. Finally, the same representations can be used with discrete diffusion to design regulatory DNA sequences with specific activity levels. We demonstrate this in plant and fly promoters and enhancers, and experimentally validate the activity and promoter selectivity of the generated fly enhancers. Together, NTv3 unifies genome interpretation, gene annotation and regulatory sequence design across the animal and plant kingdoms, with direct relevance to agriculture, biodiversity research and biotechnology.
- organism: human
- organism: mouse
- organism: plant (other)
- assay: whole-genome sequencing
- research focus: gene regulatory network inference
- research focus: sequence-to-function modeling
- research focus: database / resource
- approach: deep learning
- approach: transformer / foundation model
- Citations
- 21
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Annotating the genome at single-nucleotide resolution with DNA foundation models
Bernardo P. de Almeida, Hugo Dalla-Torre, … Thomas Pierrot·Nature MethodsPeer-reviewed·Oct 29, 2025
- The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics
Hugo Dalla-Torre, Liam Gonzalez, … Thomas Pierrot·Nature MethodsPeer-reviewed·Nov 28, 2024
- OmniNA: A foundation model for nucleotide sequences
Xilin Shen, Xiangchun Li·bioRxiv·Jan 14, 2024
- Investigating the performance of foundation models on human 3'UTR sequences
Сергей Андреевич Вилов, Matthias Heinig·Nucleic Acids ResearchPeer-reviewed·Sep 5, 2025
- GENA-LM: A Family of Open-Source Foundational DNA Language Models for Long Sequences
Veniamin Fishman, Yuri Kuratov, … Mikhail Burtsev·Nucleic Acids ResearchPeer-reviewed·Dec 26, 2024
- Life as a Function: Why Transformer Architectures Struggle to Gain Genome-Level Foundational Capabilities
Hassan Hassan, Kyle R. Puhger, … Maximilian Sprang·bioRxiv·Jan 13, 2025