Computational and Structural Biotechnology JournalBioinformaticsPeer-reviewed journal article
Representation learning applications in biological sequence analysis
Hitoshi IuchiiD, Taro MatsutaniiD, Keisuke YamadaiD, Natsuki IwanoiD, Shunsuke SumiiD, Shion HosodaiD, Shitao ZhaoiD, Tsukasa FukunagaiD, Michiaki HamadaiD
Abstract
Remarkable advances in high-throughput sequencing have resulted in rapid data accumulation, and analyzing biological (DNA/RNA/protein) sequences to discover new insights in biology has become more critical and challenging. To tackle this issue, the application of natural language processing (NLP) to biological sequence analysis has received increased attention, because biological sequences are regarded as sentences and k-mers in these sequences as words. Embedding is an essential step in NLP, which converts words into vectors. This transformation is called representation learning and can be applied to biological sequences. Vectorized biological sequences can be used for function and structure estimation, or as inputs for other probabilistic models. Given the importance and growing trend in the application of representation learning in biology, here, we review the existing knowledge in representation learning for biological sequence analysis.
- assay: DNA methylation
- assay: proteomics
- assay: whole-genome sequencing
- assay: whole-exome sequencing
- research focus: benchmarking
- approach: statistical model
- approach: machine learning (classical)
- Citations
- 83
- FWCI
- 1.55
- Field percentile
- top 15%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- 16S rRNA sequence embeddings: Meaningful numeric feature representations of nucleotide sequences that are convenient for downstream analyses
Stephen Woloszynek, Zhengqiao Zhao, … GAIL L. ROSEN·PLoS Computational BiologyPeer-reviewed·Feb 26, 2019
- MathFeature: Feature Extraction Package for Biological Sequences Based on Mathematical Descriptors
Robson Parmezan Bonidia, Danilo Sipoli Sanches, André C. P. L. F. de Carvalho·bioRxiv·Dec 19, 2020
- Dysfunctional analysis of the pre-training model on nucleotide sequences and the evaluation of different k-mer embeddings
Yaozhong Zhang, Zeheng Bai, Seiya Imoto·bioRxiv·Dec 5, 2022
- Effect of Tokenization on Transformers for Biological Sequences
Edo Dotan, Gal Jaschek, … Yonatan Belinkov·BioinformaticsPeer-reviewed·Mar 29, 2024
- Modeling the Language of Life - Deep Learning Protein Sequences
Michael Heinzinger, Ahmed Elnaggar, … Burkhard Rost·BMC BioinformaticsPeer-reviewed·Dec 1, 2019
- species2vec: A novel method for species representation
B. Angelov·bioRxiv·Dec 22, 2019