bioRxivBioinformaticsPreprint
Flock: A Negative-Enriched Protein-Protein Interaction Dataset
Abstract
Protein-protein interactions (PPIs) govern fundamental biological processes and are central to therapeutic discovery, yet computational prediction methods remain severely limited by a lack of high-quality negative data (non-interacting PPIs). Existing models are trained almost exclusively on positive interactions or random pairs designated as negatives, while legacy negative datasets are limited in scale and contain correctness errors. To address this, we introduce Flock, a negative-enriched PPI dataset of unprecedented scale, containing 26,934 positive and 377,643 negative pairs. Flock integrates biological assemblies from the PDB with highly confident, curated negatives mined from scientific literature using a state-of-the-art agentic LLM workflow. To address the evaluation leakage seen in protein structure modelling, we also present Flock's Leakage-Free Set, a benchmark that strictly controls for sequence and interface similarity, and historical date-based cutoffs used in the training of co-folding models. Our evaluation reveals that the co-folding model ESMFold2 shows performance degradation on the Leakage-Free set, whereas the protein language model ESMC demonstrates stronger generalisation. Flock provides the most comprehensive and challenging PPI benchmark to date, establishing a rigorous new standard for evaluating the generalisability of protein structure and language models on this task.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- PLM-interact: extending protein language models to predict protein-protein interactions
Dan Liu, Francesca Young, … Ke Yuan·bioRxiv·Nov 5, 2024
- Constructed Negatives Shape the Evaluation of Sequence-Based Protein--Protein Interaction Models
Enzo Durand, Sergei Grudinin, … Élodie Laine·bioRxiv·Oct 15, 2026
- Protein-Protein Interaction Prediction is Achievable with Large Language Models
Logan Hallee, Jason P. Gleghorn·bioRxiv·Jun 7, 2023
- PINDER: The protein interaction dataset and evaluation resource
Daniel Kovtun, Mehmet Akdel, … Luca Naef·bioRxiv·Jul 17, 2024
- PiNUI: A Dataset of Protein-Protein Interactions for Machine Learning
Geoffroy Dubourg-Felonneau, Daniel Wesego, … Ranjani Varadan·bioRxiv·Dec 12, 2023
- A flaw in using pre-trained pLLMs in protein-protein interaction inference models
Joseph Szymborski, Amin Emad·Nature Machine IntelligencePeer-reviewed·Feb 13, 2026