Additive baselines furnish no evidence for epistasis learning by MULTI-evolve
Abstract
Recent work from Tran et al. (Science, 2026) introduced MULTI-evolve, a framework for protein engineering that combines single-mutant nomination via a protein language model (PLM) or a deep mutational scan (DMS), experimental single- and double-mutant characterization, and neural networks to engineer hyperactive multimutant proteins. The authors attribute the frameworks performance to "epistasis-aware modeling" and claim that their neural networks "learn the epistatic landscape" and "identify synergistic interactions" from limited double-mutant training data. Additive models, by definition, cannot represent epistasis, making them a natural null baseline for such claims. Here we show that MULTI-evolves multimutant predictions are almost perfectly correlated with an additive models across all three engineering applications (APEX, dCasRx, and HuABC2), such that the engineering of multimutants reduces to combining beneficial mutations with the largest additive effects--a standard protein engineering strategy for over four decades. We also find that MULTI-evolves neural networks do not outperform an additive model on held-out test set predictions, and do not even represent epistasis in their training data. Finally, we revisit a DMS benchmark finding presented as evidence of epistasis learning and show that the same pattern is expected even under a null additive model, due to an elementary statistical phenomenon; when we fit an additive model to the benchmark data, it reproduces the reported pattern. More broadly, our findings underscore the need to benchmark models for machine learning-guided directed evolution against additive null baselines before attributing performance to learned epistasis.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 2
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- From single-sequence structure prediction to protein fitness landscape through a composable, epistasis-aware mutation atlas
Weizhe Wang, Zimu Yu, … Haipeng Gong·bioRxiv·Sep 24, 2026
- Protein stability models fail to capture epistatic interactions of double point mutations
Henry Dieckhaus, Brian A. Kuhlman·Protein SciencePeer-reviewed·Dec 20, 2024
- DeePEn - A Depth sensitive benchmark for Protein Engineering
Robert Schmirler, Maurice Brenner, … Burkhard Rost·bioRxiv·Jun 11, 2026
- Origins and breadth of pairwise epistasis in an α-helix of β-lactamase TEM-1
A. Birgy, C. Roussel, … O. Tenaillon·bioRxiv·Nov 29, 2021
- Active Learning-Assisted Directed Evolution
Jason Yang, Ravi G. Lal, … Frances H. Arnold·Nature CommunicationsPeer-reviewed·Jan 16, 2025
- Beyond additivity: zero-shot methods cannot predict impact of epistasis on protein properties and function
Anastasia Kolchina, Igors Dubanevics, … Olga V. Kalinina·bioRxiv·Jul 6, 2026