Ankh : Optimized Protein Language Model Unlocks General-Purpose Modelling
Ahmed Elnaggar, Hazem Essam, Wafaa Salah-Eldin, Walid Moustafa, Mohamed Elkerdawy, Charlotte Rochereau, Burkhard Rost
Protein-specific tuning of masking, depth and positional embeddings, rather than more parameters, yields an encoder-decoder model that tops structure and function benchmarks at a fraction of the compute.
bioRxiv · Jan 16, 2023 · PreprintBioinformatics✦ In-depth digest