BioinformaticsbioRxivPreprint
Training Compute-Optimal Protein Language Models
Xingyi Cheng, Bo Chen, Pan Li…·Le Song
This paper investigates optimal training of protein language models by analyzing the relationship between model size, training data, and performance, finding that diverse training data and scaling laws improve results.
23 citations