bioRxivBioinformaticsPreprint
Cause-excluded Effect Evaluation: a framework for the faithful assessment of genetic perturbation target identification
Jiaxin HuiD, Xiaoning QiiD, Limeng Tian, Jie Yan, Nian Liu, Xin Li
Abstract
Identifying which gene drives a desired cell-state transition is a foundational inverse problem in target discovery and cell-state engineering, yet far less developed than forward prediction. We show that prevailing benchmarks inflate performance through two artefacts: training leakage, where test-perturbation cells are seen during fitting, and evaluation leakage, where the perturbed gene's own expression change exposes the answer. Here, we introduce Cause-excluded Effect Evaluation (CEE), a framework that separates train and test perturbation targets, removes target-gene self-effects from expression profiles and scores candidates in downstream response space. With CEE, we find that simple structure-based methods consistently outperform complex deep learning models across 16 single-cell perturbation datasets, revealing that the recoverable signal is governed by low-rank and additive structure in perturbation responses rather than by model complexity. Our work disentangles evaluation artefacts from genuine predictive capacity and offers a design principle for developing perturbation target identification methods.
- assay: scRNA-seq
- research focus: benchmarking
- research focus: perturbation response prediction
- research focus: differential expression
- approach: statistical model
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Deep Learning-Based Genetic Perturbation Models Do Outperform Uninformative Baselines on Well-Calibrated Metrics
Henry E. Miller, Gabriel Mejia, … Lucas Paulo de Lima Camillo·bioRxiv·Oct 20, 2025
- SHERLOCK: Structured representation learning and causal inference of downstream perturbation effects
Mingxuan Zhang, Joshua D. Myers, … Elham Azizi·bioRxiv·Sep 26, 2026
- Beyond Expression Prediction: Benchmarking Differential Expression Classification in Single-Cell Perturbation Models
Junwei Sun, Yuxun He, … Yiqun T. Chen·bioRxiv·Jul 24, 2026
- Spurious correlation inflates performance in single-cell perturbation prediction
Phillip B. Nicol, Shriya Shivakumar, Rafael A. Irizarry·bioRxiv·Aug 11, 2026
- Towards Principled Evaluation of Single-Cell Perturbation Prediction Models
Philipp Sven Lars Schäfer, Kendall A. Reid, … Julio Sáez-Rodríguez·bioRxiv·Jul 27, 2026
- GenePert: Leveraging GenePT Embeddings for Gene Perturbation Prediction
Yiqun T. Chen, James Zou·bioRxiv·Oct 27, 2024