henhaobio
Sign in

bioRxivBioinformaticsPreprint

Towards reconstruction of the human interactome from positive and negative experimental evidence

Joel ÅsiD, K. PelziD, Judith BernettiD, Francesco Battini, Markus ListiD, David B. BlumenthaliD, Martin H. SchaeferiD

PDFDOICodeData

In-depth summary

Claude Opus 5.5 · xhigh effort · 8 Nov 2026 · from the full text of version 1 (13 Sept 2026) · CC BY 4.0

Inferring tested-but-undetected pairs from prey lists of 5,530 published interaction screens yields 97 million tested human protein pairs and 18,982,508 non-interactions (≥3 tests) for calibrating screens and predictors.

Protein-protein interaction (PPI) databases list only detections, so a pair tested often but never detected looks like an untested one, and predictors commonly use randomly sampled non-reported pairs as negatives. Unlike the Negatome's curated, text-mined and structural negatives or SAINT/ComPASS scoring within single affinity-purification mass spectrometry (AP-MS) screens, this work reconstructs search spaces of 5,530 published screens from interactions aggregated in IntAct.

Key results

  1. ShownReconstructing each study's prey search space recovers tested-but-undetected pairs at scale. It gives a small set of high-replication interactions (HRIs) and a very large set of high-replication non-interactions (HRNIs) from AP-MS and yeast two-hybrid (Y2H) data.

    491,601 interactions from 5,530 IntAct studies map to 97 M unique tested pairs over 182 M tests; most pairs were tested once or twice, the most-tested 69 times. HRIs (beta-binomial Q2.5 > 0.29, e.g. 3 of 3 detections): 6,221 pairs, mean detection ratio 0.934. HRNIs (≥3 tests, none detected): 18,982,508 pairs, mean 3.9 tests, max 20. · Mapping the search space; 1. Estimation of pair-wise probability of…; Figure legends

  2. ShownHRIs share Gene Ontology biological-process terms, subcellular localisation, high co-expression and loss-of-function intolerance more often than HRNIs. The signal is clearest for AP-MS and weaker for Y2H.

    Shared-annotation OR > 1 (q < 0.05, Benjamini-Hochberg) for 24 of 25 terms in the MS and combined sets vs 9 of 24 for Y2H (nucleoplasm the only enriched Y2H localisation). High ARCHS4 co-expression OR 1.36 to 1.56 across datasets. Both-LoF-intolerant pairs (gnomAD LOEUF): OR 1.18 (95% CI 1.11-1.25) MS, 1.19 (1.12-1.26) combined, 1.08 (0.96-1.21, p=0.16) Y2H. · Validating non-interacting pairs; 2. Co-annotation analysis HRNI vs HRI; Figure legends

  3. ShownRepeatedly tested non-interactions give false discovery rate (FDR) estimates for held-out experimental screens and for RF2-PPI structure-based predictions. High-confidence RF2-PPI calls fall among HRNIs far less often, and HRNIs with 3 tests behave much like those with 7.

    One large held-out study per assay: FDR 21% (Y2H) and 40% (MS) when any test counts as negative, 5% and 16% when ≥3 tests are required. RF2-PPI (43.6 M pairs) vs 351,552 reported interactions: FDR 0.886/0.651/0.320 at p > 0.5 and 0.153/0.038/0.010 at p > 0.99 for HRNI tiers ≥3/≥5/≥7 tests. Size-adjusted enrichment was 2.31 to 2.33 and 99.54 to 110.25, nearly the same across tiers. · Experimental negatives as a benchmarking tool; Figure legends; Tables

  4. SuggestedD measures how much a protein's detection depends on its partner. Known Y2H auto-activators and CRAPome AP-MS contaminants tend towards low D, and those with the highest detection rates sit near partner-independent detection (D ≈ 1), suggesting D as a stickiness score for unlabelled proteins.

    D is the mean Pearson chi-square contribution against the protein's global detection ratio in a given role. Known problematic proteins with high detection rates (71 curated Y2H auto-activators; 576 CRAPome 1.0 proteins with mean spectral count > 1) cluster at D ≈ 1, while most proteins with similar detection rates spread to higher D. The comparison is visual; no test statistic is reported. · Role-specific binding variance ranks…; Figure legends

  5. SuggestedTraining sequence-based classifiers on HRNIs instead of randomly sampled non-observed pairs did not improve accuracy, but it did change which pairs were predicted as non-interacting.

    ESM-2 + XGBoost, node-disjoint degree-balanced splits; accuracy similarly low with either negative type. Jaccard agreement on HRNI-set predictions: median 0.59 to 0.74 for HRNI- vs non-observed-trained models, 0.61 to 0.76 among non-observed-trained ones. HRNI-trained models agreed with each other less than non-observed-trained ones, despite training-set overlap of Jaccard 0.9 to 0.95 vs near zero. · Training and evaluating machine learning of PPIs; Discussion; 4. ML-splits strategy and model setup; Classification setup and protein-embeddings

Methods, data and reproducibility

Prey detected with any bait in a multi-bait AP-MS or Y2H study define the search space for every bait in it. Per-pair test and detection counts aggregated across IntAct are fitted with a beta-binomial model to call high-replication interactions (HRIs, Q2.5 > 0.29) and non-interactions (HRNIs, ≥3 tests, never detected), which are then validated and used for benchmarking and classifier training.

  • IntAct human PSI-MITAB release (2026-01-14), filtered to selected AP-MS and Y2H detection methods, canonical UniProt isoforms, no self-interactions or single-interaction studies · human · n = 491,601 interactions; 5,530 studies; 97 M tested pairs; 182 M tests
  • GO biological-process annotations retrieved with MyGene, terms with ≥400 genes · human
  • Human Protein Atlas subcellular main-location annotations (Supported, Approved or Enhanced reliability), terms with ≥400 genes · human
  • ARCHS4 precomputed pairwise Pearson co-expression from GEO RNA-seq, binned into top and bottom 15%
  • gnomAD v2.1.1 LOEUF loss-of-function tolerance estimates · human (estimates across human genomes, as stated)
  • Published RF2-PPI interaction probabilities (Zhang et al.) for pairs preselected on DCA > 0.12 · n = 43.6 M protein pairs
  • Curated list of known Y2H auto-activators · n = 71
  • CRAPome 1.0 proteins with mean spectral count > 1 · n = 576
Methods & tools
IntAct, UniProt, MyGene, Human Protein Atlas, ARCHS4, gnomAD v2.1.1 LOEUF, CRAPome 1.0, RF2-PPI, ESM-2 (esm2_t33_650M_UR50D), XGBoost, Snakemake, graph-tool
Data & accessions
https://hippie-db.net/
Software & environment
Snakemake workflow; Python 3.12, R for plotting, Julia MixedModel v5.9.0; Conda and Apptainer for environments; ESM-2 run in a Hugging Face transformers Docker image (04-2026); full software version list in the repository (main, commit 7bbe392).
Assay conditions & compute
ESM-2 embeddings on an Nvidia H200 GPU (IEO HPC); remaining analyses on a 48-core Intel Xeon Silver 4214 CPU with 188 GB RAM.
Reproducibility gaps
HIPPIE hosts negative pairs tested five or more times rather than the full ≥3-test HRNI set, plus the balanced ML splits. RF2-PPI scores were reused from a published dataset, not recomputed. Run times are not reported.
Limitations (6)
  • The search space is only partly reconstructed: it is inferred from detected prey alone. Baits (artificially expressed) and studies reporting a single interaction are excluded. · stated by the authors
  • The near log-normal detectability distribution of well-tested proteins may describe proteins detectable by MS or Y2H rather than the true interactome, and proteins that interact with nothing can never generate negative data here. · stated by the authors
  • A proteome-wide structure-based screen and retraining of structural predictors were beyond the computational budget. Only published RF2-PPI scores and a sequence-based XGBoost model were evaluated. · stated by the authors
  • HRNI negatives did not improve classifier performance. What drives the altered prediction agreement is unknown, and a hint of better performance at stricter HRI thresholds was underpowered to test. · stated by the authors
  • The experimental FDR estimates rest on a single held-out study per assay, chosen for its size, so they are a proof of concept rather than general error rates for AP-MS or Y2H. · noted in this summary
  • HRNIs assume that a prey detected with one bait was detectable with every bait in that study. This is argued, not tested directly, and validation is indirect (annotation, co-expression and constraint enrichment). · noted in this summary

Read this if you train or benchmark PPI predictors and need experimentally grounded negatives, or want to estimate error rates and flag sticky proteins or auto-activators in aggregated AP-MS or Y2H data.

Citations
1

Abstract

Protein-protein interactions (PPIs) have been detected and reported in the millions, but while they are used in many different contexts for better understanding cellular processes in health and disease, the knowledge of the human PPI network is far from complete, containing many false positive measurements and being highly biased. Both to chart the extent of those problems and to solve them requires not just a knowledge of high-confidence positive interactions, but also likely non-interacting protein pairs. However, this information is typically not reported in PPI studies. We developed a methodology to reconstruct this knowledge from existing PPI data. We reconstruct the experimental search space in which PPI screens have been performed and then create a model that informs how likely a PPI is real given its testing and observation frequency. We argue that negative protein pairs allow us to estimate the error rates of experimental and computational screens. We show how this knowledge could be incorporated for calibration. Finally, we evaluate a simple machine learning approach to PPI prediction and propose how such negative data can be used for training instead of random protein pairs. Together, our results show that reconstructing the experimental search space recovers a largely overlooked layer of information from existing PPI data that can help guide a more accurate and complete mapping of the human interactome.

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.