Cross-Domain Transfer Learning from Peptides to Lipids Using a Multi-Property Fine-Tuned LLM
Uchenna Alex AnyaegbunamiD, David TeschneriD, Thierry SchmidliniD, Andreas HildebrandtiD, Johannes U Mayer, Maximilian SprangiD, Miguel Angel Andrade-NavarroiD
Abstract
Accurate knowledge of liquid chromatography retention time (RT) is essential for confident compound identification in metabolomics and lipidomics. Yet, it is often constrained by the scarcity of experimental data for many molecular classes. Current workflows depend on experimental RT libraries, which are time-consuming to build and limited to previously observed compounds. Here, we present a transfer learning pipeline that leverages large, publicly available peptide datasets to enable accurate lipid RT prediction in data-sparse scenarios. We first show that a ChemBERTa language model, when pre-trained on peptides with a multi-task objective (predicting both RT and fundamental RDKit molecular descriptors), learns a more robust and generalizable chemical representation than a single-task (RT-only) model. This multi-property pre-training yielded superior generalization in lipids, achieving test R2 values of 0.842 against 0.814 (RT-only). Crucially, transferring this peptide-based model to lipid data provided a pronounced advantage in data-sparse scenarios. When fine-tuned on only 5% of available lipid data, the transferred model improved the median test R2 by +0.234 over a model trained from scratch. Significant benefits persisted at intermediate data scales (50-75%), with performance converging only when 100% of the lipid data was used. Notably, the pre-trained model never underperformed the baseline, exhibiting more stable training across all data scales. These results demonstrate that multi-property pre-training guides language models towards chemically meaningful representations that support better RT prediction in different molecular domains. Furthermore, peptide-based pre-training facilitates cross-domain transfer of chemical properties to lipid. Our work provides a practical, scalable strategy to mitigate data scarcity in lipidomics by transferring knowledge from data-rich peptide databases, offering a computational alternative to extensive experimental library generation and enabling more confident identification in small-scale omics studies.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- DeepLC introduces transfer learning for accurate LC retention time prediction and adaptation to substantially different modifications and setups
Robbin Bouwmeester, Alireza Nameni, … Lennart Martens·bioRxiv·Jun 1, 2025
- A Task-Specific Transfer Learning Approach to Enhancing Small Molecule Retention Time Prediction with Limited Data
Yuhui Hong, Haixu Tang·bioRxiv·Jun 26, 2025
- Scaling SMILES-Based Chemical Language Models for Therapeutic Peptide Engineering
Aaron L. Feller, Maxim Secor, … Kristine Deibler·Journal of Chemical Information and ModelingPeer-reviewed·Jul 13, 2026
- Peptide-aware chemical language model successfully predicts membrane diffusion of cyclic peptides
Aaron L. Feller, Claus O. Wilke·Journal of Chemical Information and ModelingPeer-reviewed·Jan 8, 2025
- Deep learning from harmonized peptide libraries enables retention time prediction of diverse post translational modifications
Damien B. Wilburn, Ariana E. Shannon, … Brian C. Searle·bioRxiv·May 30, 2023
- PepBERT: Lightweight language models for bioactive peptide representation
Zhenjiao Du, Doina Caragea, … Yonghui Li·Future FoodsPeer-reviewed·Mar 21, 2026