bioRxivBioinformaticsPreprint
A New Paradigm for Genome-wide DNA Methylation Prediction Without Methylation Input
Xiaoke HuangiD, Qi LiuiD, Yifei ZhaoiD, Xianfeng TangiD, Yuyin ZhouiD, Wenpin HouiD
Abstract
AO_SCPLOWBSTRACTC_SCPLOWDNA methylation (DNAm) is a key epigenetic modification that regulates gene expression and is pivotal in development and disease. However, profiling DNAm at genome scale is challenging: of [~]28 million CpG sites in the human genome, only about 1-3% are typically assayed in common datasets due to technological limitations and cost. Recent deep learning approaches, including masking-based generative Transformer models, have shown promise in capturing DNAm-gene expression relationships, but they rely on partially observed DNAm values for unmeasured CpGs and cannot be applied to completely unmeasured samples. To overcome this barrier, we introduce MethylProphet, a gene-guided, context-aware Transformer model for whole-genome DNAm inference without any measured DNAm input. MethylProphet compresses comprehensive gene expression profiles ([~]25K genes) through an efficient bottleneck multilayer perceptron, and encodes local CpG sequence context with a specialized DNA tokenizer. These representations are integrated by a Transformer encoder to predict site-specific methylation levels. Trained on large-scale pan-tissue whole-genome bisulfite sequencing data from ENCODE (1.6 billion CpG-sample pairs, [~]322 billion tokens), MethylProphet demonstrates strong performance in hold-out evaluations, accurately inferring DNAm at unmeasured CpGs and generalizing to unseen samples. Furthermore, application to TCGA pan-cancer data (chromosome 1, 9,194 samples; [~]450 million training pairs, 91 billion tokens) highlights its potential for pan-cancer whole-genome methylome imputation. MethylProphet offers a powerful and scalable foundation model for epigenetics, providing high-resolution methylation landscape reconstruction and advancing both biological research and precision medicine.
- Citations
- 2
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- MethylGPT: a foundation model for the DNA methylome
Kejun Ying, Jinyeop Song, … Vadim N. Gladyshev·bioRxiv·Oct 30, 2024
- D-GPM: a deep learning method for gene promoter methylation inference
Xingxin Pan, Biao Liu, … Shuai Cheng Li·GenesPeer-reviewed·Oct 14, 2019
- Accurate prediction of single-cell DNA methylation states using deep learning
Christof Angermueller, Heather J Lee, … Oliver Stegle·Genome biologyPeer-reviewed·Apr 10, 2017
- Predicting Methylation from Sequence and Gene Expression Using Deep Learning with Attention
Alona Levy-Jurgenson, Xavier Tekpli, … Zohar Yakhini B·Lecture notes in computer sciencePeer-reviewed·Jan 1, 2019
- CpGPT: a Foundation Model for DNA Methylation
Lucas Paulo de Lima Camillo, Raghav Sehgal, … Bo Wang·bioRxiv·Oct 24, 2024
- On the Prediction of non-CG DNA Methylation
Saleh Sereshki, Michalis Omirou, … Stefano Lonardi·bioRxiv·Apr 26, 2022