Transforming the Language of Life: Transformer Neural Networks for Protein Prediction Tasks
Ananthan Nambiar, Simon Liu, Mark Hopkins, Maeve Heflin, Sergei Maslov, Anna Ritz
A RoBERTa-style Transformer, pre-trained on 450K Swiss-Prot sequences in 18 hours on 4 V100 GPUs, rivals DeepFam at family classification and beats PIPR at human protein-protein interaction prediction.
bioRxiv · Jun 15, 2020 · PreprintBioinformatics✦ In-depth digest