bioRxivBioinformaticsPreprint
RNAStabFormer: Region-Aware Multi-Task Hybrid Learning for RNA Stability Prediction from Pulse-Chase Transcriptomics
Abstract
RNA stability is a major post-transcriptional regulator of gene expression, yet sequence-based prediction from pulsechase transcriptomics remains difficult because labels depend on time window, quantification region, and replicate quality. We present RNAStabFormer, a controlled RNA stability framework centered on a Region-aware Multi-task Hybrid Transformer (RAMHT). RAMHT encodes 5'UTR, CDS, and 3'UTR nucleotide context, adds a CDS codon stream, upgrades engineered sequence features into a tabular interaction branch, and uses gated multi-task regression to predict four ENCODE BrU-seq/BruChase-seq stability proxies, with exon total 6 h/0 h as the primary task. Across 26 outer splits including 23 chromosome holdouts, a heterogeneous three-member RAMHT ensemble achieves 0.773 mean Pearson correlation on the primary task, statistically matching an engineered-feature XGBoost baseline (0.773; mean paired delta +0.000004; bootstrap 95% CI [- 0.003845, +0.004077]; Wilcoxon p = 0.8613). The ensemble improves over the strongest single RAMHT member (0.768 to 0.773; 23/26 split wins), while a strict nested XGBoost+RAMHT blend reaches 0.775. Same-split checks also exceed frozen full-length mRNA-LM embeddings (0.760) and public LAMAR-DR transfer (0.180). Gate, ablation, and recoding analyses show that engineered sequence grammar remains dominant, while nucleotide and codon branches provide complementary CDS-local signal. RNAStabFormer narrows the gap between neural RNA sequence modeling and strong tabular baselines while retaining an extensible architecture for interpretation and biological integration.
- organism: human
- assay: bulk RNA-seq
- research focus: differential expression
- approach: deep learning
- approach: transformer / foundation model
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- HydraRNA: a hybrid architecture based full-length RNA language model
Guipeng Li, Feifei Jiang, … Wei Chen·Genome biologyPeer-reviewed·Nov 10, 2025
- RNAElectra: An ELECTRA-Style RNA Foundation Model for RNA Regulatory Inference
Ke Ding, Lixinyu Liu, … Jiayu Wen·bioRxiv·Mar 17, 2026
- Characterizing RNA stability genome-wide through combined analysis of PRO-seq and RNA-seq data
Amit Blumberg, Yixin Zhao, … Adam C. Siepel·BMC BiologyPeer-reviewed·Feb 15, 2021
- RNA-xLSTM: Evaluating xLSTM as an Alternative Foundation to Transformers in RNA Modeling
Matija Pintarić, Rafael Josip Penić, Mile Šikić·bioRxiv·Jul 14, 2025
- Cell-type specific prediction of RNA stability from RNA-protein interactions
Sepideh Saran, Svetlana Lebedeva, … Uwe Ohler·bioRxiv·Nov 19, 2024
- RNASeek: A Cross-Phyla Generative Foundation Model for Multipurpose RNA Modeling and Reinforcement Learning-Based Design
Shiyuan Chen, Neil R. Fernandes, … Joy S. Xiang·bioRxiv·Sep 28, 2026