Protein Language Models: Is Scaling Necessary?
Quentin Fournier, Robert McCoy Vernon, Almer M. van der Sloot, Benjamin Schulz, Sarath Chandar, CHRISTOPHER JAMES LANGMEAD
This paper introduces AMPLIFY, a protein language model that achieves better performance with less training cost by improving data quality and architecture, challenging the need for scaling.
bioRxiv · Sep 23, 2024 · PreprintMolecular Biology