A structural antibody benchmark for leakage-aware deep-learning evaluation
Tomer CoheniD, Haimasree BhattacharyaiD, Michal Ozery-FlatoiD, Dina Schneidman‐DuhovnyiD
Abstract
Deep-learning methods for antibody structure prediction, antibody-antigen interaction modelling and design are advancing rapidly. However, comparisons across studies remain difficult because training and test sets are often constructed independently, and a temporal cutoff alone does not prevent train-test leakage. We present SABLE (Structural Antibody Benchmark for deep-Learning Evaluation), a versioned structural antibody resource that couples a fixed training collection with a leakage-controlled held-out test set for reproducible machine-learning development and evaluation. SABLE combines 16,511 experimental training entries with 327 manually reviewed test entries and 3,274 high-confidence, patent-derived AlphaFold3 models spanning 476 antigens. Candidate test structures were selected after the AlphaFold3 temporal cutoff and filtered against the training set using antibody and antigen sequence similarity filters. Each test entry records its nearest training set neighbour, allowing users to quantify remaining relatedness and stratify performance by similarity. Versioned releases provide metadata, processed structures, CDR annotations, redundancy labels and model-confidence fields. A Python/PyTorch API and standardised benchmark metrics provide reproducible database access and evaluation code without requiring additional antibody-structure processing.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Antibody structure prediction using interpretable deep learning
J. A. Ruffolo, J. Sulam, J. J. Gray·bioRxiv·May 27, 2021
- DLAB - Deep learning methods for structure-based virtual screening of antibodies
Constantin Schneider, Andrew G. Buchanan, … Charlotte Mary Deane·BioinformaticsPeer-reviewed·Sep 15, 2021
- Fast, accurate antibody structure prediction from deep learning on massive set of natural antibodies
Jeffrey A. Ruffolo, Lee‐Shin Chu, … Jeffrey J. Gray·bioRxiv·Apr 20, 2022
- SAbDab2: The structural antibody database in the age of machine learning
Henriette Capel, Odysseas Vavourakis, … Charlotte Mary Deane·Nucleic Acids ResearchPeer-reviewed·Oct 25, 2026
- Evaluating Deep Learning Based Structure Prediction Methods on Antibody-Antigen Complexes
Samuel Fromm, Marko Ludaic, Arne Elofsson·BioinformaticsPeer-reviewed·Mar 21, 2026
- Structural Plausibility Without Binding Specificity: Limits of AI-Based Antibody-Antigen Structure Prediction Confidence Scores
Eva Smorodina, Montader Ali, … Victor Greiff·bioRxiv·Mar 3, 2026