Resolution of recursive data corruption to transform T-cell epitope discovery
Grzegorz Preibisch, Michał Tyrolski, Piotr KucharskiiD, Stanisław GizińskiiD, Piotr Grzegorczyk, Sungho MooniD, Sangwoo Kim, Balyn W. ZaroiD, Anna GambiniD
Abstract
Accurate prediction of MHC class I-presented peptides is essential for any vaccine or T-cell therapy design, yet reported gains on in silico benchmarks have not translated into clinical successes. Here we show that this discrepancy may come from a common methodological error: immunopeptidomics datasets are fundamentally contaminated by existing prediction models through prediction-based deconvolution and filtering, resulting in an iterative confirmation bias. An audit of the IEDB, the biggest database in the field, reveals that as of January 2025, 55.8% of assessable data are labeled by computational models rather than verified experimentally. This inflates in silico benchmarks while degrading real-world applicability on new data, effectively making it impossible to objectively test model performance, which can lead to choosing suboptimal solutions and decreasing the chance of any therapys clinical success. In silico simulation shows that iterative data corruption maintains high AUROC while top-of-list retrieval collapses. We reframe epitope discovery as a protein-centric learning-to-rank task and introduce deepMHCflare, a model evaluated exclusively on clean data. deepMHCflare achieves 0.80 Precision@4 on mono-allelic benchmarks versus 0.55-0.65 for gold-standard prediction models. A preclinical cancer vaccine study validated that 2 of the 4 deepMHCflare-nominated peptides were immunogenic, with a third independently confirmed in the literature.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Benchmarking predictions of MHC class I restricted T cell epitopes
S. Paul, N. P. Croft, … B. Peters·bioRxiv·Jul 8, 2019
- On the feasibility of mining CD8+ T-cell receptor patterns underlying immunogenic peptide recognition.
N. De Neuter, W. Bittremieux, … P. Meysman·bioRxiv·Mar 20, 2017
- Deep Neural Networks Predict MHC-I Epitope Presentation and Transfer Learn Neoepitope Immunogenicity
Benjamin Alexander Albert, Yunxiao Yang, … Rachel Karchin·Nature Machine IntelligencePeer-reviewed·Jul 20, 2023
- epitopepredict: A tool for integrated MHC binding prediction
Damien Farrell·GigabytePeer-reviewed·Feb 24, 2021
- DeepImmuno: Deep learning-empowered prediction and generation of immunogenic peptides for T cell immunity
Guangyuan Li, Balaji Iyer, … Nathan Salomonis·Briefings in BioinformaticsPeer-reviewed·Apr 6, 2021
- Predicting CD4 T-cell epitopes based on antigen cleavage, MHCII presentation, and TCR recognition
Dina Schneidman‐Duhovny, Natalia Khuri, … Andrej Šali·PLoS ONEPeer-reviewed·Nov 6, 2018