genomicBERT: A Light-weight Foundation Model for Genome Analysis using Unigram Tokenization and Specialized DNA Vocabulary
Tyrone Chen, Naima Vahab, Navya Tyagi, Eleanor Cummins, Anton Yariv Peleg, Sonika Tyagi
This paper introduces genomicBERT, a lightweight genome analysis model that improves efficiency and performance through specialized DNA vocabulary and tokenization, validated across diverse case studies.
bioRxiv · May 31, 2023 · PreprintBioinformatics