Developing SCL2205 : A Protein Sequence-based Spatial Modelling Dataset for the Protein Language Model Frontier
Abstract
Deep learning (DL) has advanced computational genome annotation tasks such as protein sub-cellular localisation (SCL) prediction. Nonetheless, its potential remains underutilised, primarily because of the limited availability of high-quality reference data and suboptimal input preparation strategies. In this study, we develop and analyse a high-quality dataset derived from the latest release of the universal protein knowledgebase (UniProtKB), designed to address existing challenges and support robust DL-based SCL modelling. The dataset was constructed through extensive quality preprocessing to ensure reliability, manual label mapping to enhance the quantity and diversity of the training data, and stringent partitioning to minimise data leakage. We validated the dataset using independent test sets, achieving up to 10.8% performance improvement, measured by the area under the precision-recall curve (PR-AUC), compared to the state-of-the-art (SoTA). Furthermore, we highlighted potential performance metric inflation in existing SoTA predictors by demonstrating, for the first time, at least 4.8% training-to-testing data leakage (pre-sequence representation) when using only 10% of the training set under homology augmentation (augmentation based on sequence similarity database searches; details in Sub-section 2.1), a commonly used data augmentation strategy in DL-based SCL prediction modelling. SCL2205 will efficiently support the development of robust, trustworthy, and generalisable DL-based SCL predictors, while minimising data leakage and promoting reproducibility. It is openly available under the Creative Commons Zero (CC0 1.0) licence on DRYAD and is conveniently deployed as a package on the Python Package Index - p-scldata.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- FWCI
- 0.00
- Field percentile
- top 38%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Prot-SCL: State Of The Art Prediction Of Protein Subcellular Localization From Primary Sequence Using Contrastive Learning
Sam G. Giannakoulias, John Joseph Ferrie, … Carter A. Mitchell·bioRxiv·Sep 1, 2023
- Prediction of protein subcellular localization using deep learning and data augmentation
Majid Ghorbani-Eftekhar·bioRxiv·May 19, 2020
- Protein Language Model for Prediction of Subcellular Localization of Protein Sequences from Gram-negative bacteria (ProtLM.SCL)
Gurpreet Singh, Ravi Tyagi, … Ahmed Essaghir·bioRxiv·Dec 16, 2022
- DMLDA-LocLIFT: Identification of multi-label protein subcellular localization using DMLDA dimensionality reduction and LIFT classifier
Qi Zhang, Shan Li, … Qin Ma·Chemometrics and Intelligent Laboratory SystemsPeer-reviewed·Sep 4, 2020
- ProteinGLUE: A multi-task benchmark suite for self-supervised protein modeling.
Henriette Capel, Robin Weiler, … K. Anton Feenstra·Scientific ReportsPeer-reviewed·Sep 26, 2022
- ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing
Ahmed Elnaggar, Michael Heinzinger, … Burkhard Rost·IEEE Transactions on Pattern Analysis and Machine IntelligencePeer-reviewed·Jul 7, 2021