bioRxivBioinformaticsPreprint
Additive-input encoding fails operator-level target-held-out prediction on current Perturb-seq screens
Abstract
Pooled Perturb-seq screens are often interpreted through a linear steady-state model in which each targeted gene supplies an additive perturbation input. Although this formulation identifies an operator on the observed response subspace in closed form, identifiability alone does not establish that inferred operators generalize to new perturbation targets. We evaluated fixed program-space additive inputs in three Perturb-seq screens -- Replogle K562 essential, Replogle RPE1 essential, and Jost 2020 -- using target-grouped nested cross-validation and matched signal-to-noise linear-truth controls. For inverse operator prediction, real held-out error remained at the predict-zero baseline (0.96, 1.00, and 1.00), whereas matched linear controls achieved 0.18, 0.53, and 0.72. This discrepancy persisted across random K562 target panels, an overdetermined Jost dimension sweep, direction-only fits, ridge and truncated-SVD estimators, and five linear ground-truth ensembles. Forward target-held-out prediction was more nuanced: fixed, footprint, and learned linear encodings modestly beat a predict-training-mean baseline in K562 but not in RPE1 or Jost, and the K562 gains recovered only about 7% of the gap to the matched linear control. On the tested screens, fitted fixed program-space operators should not be interpreted as validated target-generalizing regulatory operators. We release anchor-op, a reproducible toolkit for target-grouped evaluation, identifiability checks, and matched-geometry positive controls for perturbation-response models.
- organism: human
- assay: perturbation screen
- research focus: benchmarking
- approach: statistical model
- approach: benchmark study
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- PETRO enables robust estimation of on-target perturbation effects in Perturb-seq
Zhongxuan Sun, Hyunseung Kang, Sündüz Keleş·bioRxiv·Oct 21, 2026
- Reliability-weighted target prioritization in CD4+ T-cell Perturb-seq: a generalizability-theory decomposition
Che Cheng·bioRxiv·Jul 15, 2026
- SubcellPert: Benchmarking Subcellular Perturbation Prediction
Jinghao Wang, Hanqun Cao, … Pheng Ann Heng·bioRxiv·Oct 17, 2026
- Genetic Perturbation Prediction Models Fail Out-of-Distribution: A Rigorous Benchmark and Systematic Evaluation
Kanupriya Tiwari, Gaurang Mahajan, … Abhishek K Jha·bioRxiv·Oct 19, 2026
- Resolving how genetic perturbations act through gene regulatory paths
Lixin Ren, Zhana Duren·bioRxiv·Nov 3, 2026
- Sequential Optimal Experimental Design of Perturbation Screens Guided by Multi-modal Priors
Kexin Huang, Romain Lopez, … Aviv Regev·Lecture notes in computer sciencePeer-reviewed·Jan 1, 2024