TransMEP: Transfer learning on large protein language models to predict mutation effects of proteins from a small known dataset

Abstract

Machine learning-guided optimization has become a driving force for recent improvements in protein engineering. In addition, new protein language models are learning the grammar of evolutionarily occurring sequences at large scales. This work combines both approaches to make predictions about mutational effects that support protein engineering. To this end, an easy-to-use software tool called TransMEP is developed using transfer learning by feature extraction with Gaussian process regression. A large collection of datasets is used to evaluate its quality, which scales with the size of the training set, and to show its improvements over previous fine-tuning approaches. Wet-lab studies are simulated to evaluate the use of mutation effect prediction models for protein engineering. This showed that TransMEP finds the best performing mutants with a limited study budget by considering the trade-off between exploration and exploitation. Graphical TOC Entry O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=106 SRC="FIGDIR/small/575432v1_ufig1.gif" ALT="Figure 1"> View larger version (12K): org.highwire.dtl.DTLVardef@11ccc78org.highwire.dtl.DTLVardef@1b3e51corg.highwire.dtl.DTLVardef@1869c65org.highwire.dtl.DTLVardef@85d6c0_HPS_FORMAT_FIGEXP M_FIG C_FIG