Understanding Language Model Scaling on Protein Fitness Prediction
Chao Hou, Ди Лю, Aziz Zafar, Yufeng Shen
This study shows that larger protein language models can overestimate sequence likelihood, leading to poor fitness prediction, and recommends moderate model sizes for better performance.