NucEL: Single-Nucleotide ELECTRA-Style Genomic Pre-training for Efficient and Interpretable Representations
Ke Ding, Brian John Parker, Jiayu Wen
NucEL improves genomic representation learning by using ELECTRA-style pre-training with single-nucleotide tokenization, achieving state-of-the-art performance on multiple tasks.