bioRxivBioinformaticsPreprint
Overcoming systematic data biases enables accurate prediction of enzyme kcat fold-changes for computational protein design
Abstract
Machine learning is increasingly used to guide protein engineering by predicting how mutations affect desired properties. Recent models for the turnover number (kcat) of enzymes report high accuracy, suggesting that mutation effects can be inferred directly from protein sequence. However, these approaches are typically evaluated on heterogeneous datasets of enzyme variants, where closely related sequences and systematic reporting patterns may confound model performance. A central challenge is therefore to determine whether current models truly capture mutation-specific effects or instead exploit statistical regularities in the data. Here we show that much of the reported accuracy in mutant kcat prediction arises from two pervasive biases: variants of the same enzyme occupy a narrow activity range, and mutations within a group often share a common direction of change. Simple baselines that exploit these biases match or exceed the performance of existing models, indicating that high apparent accuracy does not imply mechanistic understanding. To address this limitation, we introduce a bias-aware framework that reformulates prediction as a pairwise fold-change task and evaluates performance on unseen mutant-mutant pairs, thereby isolating mutation-specific signal. A proof-of-principle implementation explains approximately one-third of the variance under these conditions and outperforms existing models on leakage-controlled benchmarks. More broadly, this work establishes a general strategy for evaluating and modeling mutation effects in biochemical datasets, with implications for protein engineering and related fields.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Robust Prediction of Enzyme Variant Kinetics with RealKcat
Karuna Anna Sajeevan, Abraham Osinuga, … Ratul Chowdhury·PNAS NexusPeer-reviewed·Sep 16, 2026
- Benchmarking and Experimental Validation of Machine Learning Strategies for Enzyme Engineering
Zishuo Zeng, Jiao Jin, … Xiaozhou Luo·Journal of Chemical Information and ModelingPeer-reviewed·Oct 28, 2026
- A general method to predict the effect of single amino acid substitutions on enzyme catalytic activity
Yu-Hsiu Tony Lin, Cheng Lai Victor Huang, … Jack F. Kirsch·bioRxiv·Dec 19, 2017
- DeepEnzyme: a robust deep learning model for improved enzyme turnover number prediction by utilizing features of protein 3D structures
Tong Wang, Guangming Xiang, … Hongzhong Lu·Briefings in BioinformaticsPeer-reviewed·Jul 25, 2024
- DLKcat cannot predict meaningful kcat values for mutants and unfamiliar enzymes
Alexander Kroll, Martin J. Lercher·Biology Methods and ProtocolsPeer-reviewed·Jan 1, 2024
- CatESO: Differentiable Enzyme Sequence Optimization Guided by Substrate-Aware kcat Prediction
Zhenjia Gan, Yuzhi Xu, … John Z. H. Zhang·Journal of the American Chemical SocietyPeer-reviewed·Sep 4, 2026