A Long-Context Generative Foundation Model Deciphers RNA Design Principles
Yanjie HuangiD, Guangye Lv, Anyue Cheng, Wei Xie, Mengyan CheniD, Xinyi Ma, Yijun HuangiD, Yueyang Tang, Qingya ShiiD, Jiahao Wang, Junxi Wang, Junxi WangiD, Yunpeng XiaiD, Lu Zhao, Yifang CaiiD, Jack X. Chen, Shuangjia ZhengiD
Abstract
Programmable design of RNA sequences with defined functions remains a central challenge in biology. Despite recent advances, existing RNA generative models lack robust controllable design capabilities and are constrained by short context windows, limiting their capacity to model the complex evolutionary manifold of full-length transcripts. Here, we introduce EVA (Evolutionary Versatile Architect), a long-context generative RNA foundation model trained on over 114 million full-length RNA sequences spanning the full breadth of evolutionary diversity. By integrating a Mixture-of-Experts architecture with an 8,192-token context window, EVA learns a unified, evolution-consistent representation of RNA sequence space that captures both global transcript structure and fine-grained functional elements. EVA establishes a unified framework for a broad spectrum of RNA design tasks within a single architecture, ranging from mutational fitness prediction to context-aware sequence engineering. We demonstrate EVAs versatility through the de novo design and targeted optimization of diverse RNA classes, including tRNAs, aptamers, and CRISPR guide RNAs, as well as mRNA and circular RNA therapeutics. In systematic evaluations, EVA achieves state-of-the-art performance across seven of nine established benchmarks, improving structural modeling accuracy by up to an order of magnitude compared to existing approaches. EVA is fully open-source at the following repository: https://github.com/GENTEL-lab/EVA.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- GenerRNA: A generative pre-trained language model for de novo RNA design
Yichong Zhao, Kenta Oono, … Masaaki Kotera·bioRxiv·Feb 1, 2024
- EVOFLOW-RNA: GENERATING AND REPRESENTING NON-CODING RNA WITH A LANGUAGE MODEL
Smit Patel, Fred Zhangzhi Peng, … Sherwood Yao·bioRxiv·Feb 25, 2025
- RNA-DCGen: Dual Constrained RNA Sequence Generation with LLM-Attack
Haz Sameen Shahgir, Md. Rownok Zahan Ratul, … Atif Hasan Rahman·bioRxiv·Sep 23, 2024
- RNASeek: A Cross-Phyla Generative Foundation Model for Multipurpose RNA Modeling and Reinforcement Learning-Based Design
Shiyuan Chen, Neil R. Fernandes, … Joy S. Xiang·bioRxiv·Sep 28, 2026
- Capturing Natural Evolution in Function-guided RNA Design via Genomic Foundation Models
Yanjie Huang, Bibi Zhang, … Shuangjia Zheng·bioRxiv·Apr 8, 2025
- RNAGenesis: A Generalist Foundation Model for Functional RNA Therapeutics
Zaixi Zhang, Ruofan Jin, … Le Cong·bioRxiv·Dec 30, 2024