Maurice Brenner

This paper argues for evaluating protein language models through prospective experimental success rather than retrospective predictive accuracy.

DeePEn evaluates protein engineering models' ability to predict fitness of variants with increasing mutational distance from wildtype.

This study uses pseudoperplexity to assess whether ProtT5 memorizes its training data, finding detectable but limited memorization.