ProTrek: Navigating the Protein Universe through Tri-Modal Contrastive Learning
Jin SuiD, Yan HeiD, Shiyang You, Shiyu Jason JiangiD, Xibin ZhouiD, Xuting ZhangiD, Yuxuan WangiD, Xining SuiD, Igor TolstoyiD, Xing ChangiD, Hongyuan LuiD, Fajie YuaniD
Abstract
ProTrek redefines protein exploration by seamlessly fusing sequence, structure, and natural language function (SSF) into an advanced tri-modal language model. Through contrastive learning, ProTrek bridges the gap between protein data and human understanding, enabling lightning-fast searches across nine SSF pairwise modality combinations. Trained on vastly larger datasets, ProTrek demonstrates quantum leaps in performance: (1) Elevating protein sequence-function interconversion by 30-60 fold; (2) Surpassing current alignment tools (i.e., Foldseek and MMseqs2) in both speed (100-fold acceleration) and accuracy, identifying functionally similar proteins with diverse structures; and (3) Outperforming ESM-2 in 9 of 11 downstream prediction tasks, setting new benchmarks in protein intelligence. These results suggest that ProTrek will become a core tool for protein searching, understanding, and analysis.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 50
- FWCI
- 13.43
- Field percentile
- top 1%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Multi-Modal Large Language Model Enables Protein Function Prediction
Mingjia Huo, Han Wen Guo, … Pengtao Xie·bioRxiv·Aug 19, 2024
- xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Protein
Bo Chen, Xingyi Cheng, … Le Song·bioRxiv·Jul 5, 2023
- ProteinCLIP: enhancing protein language models with natural language
Kevin Wu, Howard Y. Chang, James Zou·bioRxiv·May 14, 2024
- SaProt: Protein Language Modeling with Structure-aware Vocabulary
Jin Su, Chenchen Han, … Fajie Yuan·bioRxiv·Oct 1, 2023
- Prot2Token: A multi-task framework for protein language processing using autoregressive language modeling
Mahdi Pourmirzaei, Farzaneh Esmaili, … Dong He Xu·bioRxiv·May 31, 2024
- Bilingual Language Model for Protein Sequence and Structure
Michael Heinzinger, Konstantin Weißenow, … Burkhard Rost·NAR Genomics and BioinformaticsPeer-reviewed·Sep 28, 2024