bioRxivBioinformaticsPreprint
Learning from tandem mass spectra at scale with a self-supervised foundation model for proteomics
Mechiel Nieuwoudt, Marco ReverennaiD, Divanisha PateliD, Rachel CatzeliD, Isaac H.J. HoungueiD, Jemma DanieliD, Kevin EloffiD, Alberto SantosiD, Nicolás López CarranzaiD, Timothy P. JenkinsiD, Jeroen Van GoeyiD, Konstantinos KalogeropoulosiD
Abstract
Mass spectrometry-based proteomics increasingly relies on machine learning, yet existing models are trained for defined supervised tasks such as peptide identification, de novo sequencing or fragment intensity prediction, limiting transfer across datasets, instruments and acquisition methods. Here we present InstaNovo-FM, a self-supervised foundation model for bottom-up proteomics trained to reconstruct masked regions of tandem mass spectra. We assemble a diverse training corpus spanning 1.63 billion MS/MS spectra and 184.6 million high-confidence annotations. We train an encoder-only transformer on the annotated tier using a physics-aware masked reconstruction objective. We demonstrate that the InstaNovo-FM embeddings encode fundamental experimental and biological properties, including fragmentation method, sequence properties and post-translational modifications, without requiring peptide labels. Furthermore, this foundation model directly enables diverse downstream applications, including de novo peptide sequencing, database-free identification and analytical run classification. InstaNovo-FM establishes a unified representation space for peptide fragmentation spectra, enabling robust transferability across the proteomics ecosystem.
- assay: metagenomics
- assay: proteomics
- research focus: protein structure prediction
- research focus: benchmarking
- research focus: software / tool
- approach: transformer / foundation model
- approach: contrastive learning
- approach: statistical model
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Sequence-to-sequence translation from mass spectra to peptides with a transformer model
Melih Yilmaz, William E. Fondrie, … William Stafford Noble·Nature CommunicationsPeer-reviewed·Jul 30, 2024
- De novo mass spectrometry peptide sequencing with a transformer model
Melih Yilmaz, William E. Fondrie, … William Stafford Noble·bioRxiv·Feb 7, 2022
- De novo peptide sequencing with InstaNovo: Accurate, database-free peptide identification for large scale proteomics experiments
Kevin Eloff, Konstantinos Kalogeropoulos, … Timothy P. Jenkins·Nature Machine IntelligencePeer-reviewed·Mar 31, 2025
- CoSpred: Machine learning workflow to predict tandem mass spectrum in proteomics
Liang Xue, Shivani Tiwary, … Robert V. Stanton·PROTEOMICSPeer-reviewed·Jun 30, 2025
- π-SPECFormer: A Mass Spectrometry-based Foundation Model for Decoding the Dark Proteome
Tianze Ling, Tao Liu, … Cheng Chang·bioRxiv·Nov 9, 2026
- Pairwise Attention: Leveraging Mass Differences to Enhance De Novo Sequencing of Mass Spectra
Joel Lapin, Alfred Nilsson, … Lukas Käll·Journal of Proteome ResearchPeer-reviewed·Jun 2, 2025