MSA Transformer
Roshan Rao, Jason J. Liu, Robert Verkuil, Joshua Meier, John Canny, Pieter Abbeel, Tom Sercu, Alexander W. Rives
One protein language model trained across many families on whole multiple sequence alignments, with interleaved row and column attention, reportedly outperforms unsupervised structure-learning methods by a wide margin.
bioRxiv · Feb 12, 2021 · PreprintSynthetic Biology