Signature Recontextualization: Mapping perturbational signatures across biological contexts
Andrew CheniD, Noa RappaportiD, Nicholas J. SchorkiD, Thomas GirkeiD, Stefano MontiiD
Abstract
Perturbational transcriptomics is a powerful tool for understanding gene function and drug effects, yet predicting how perturbations manifest across different biological contexts remains a central challenge, limiting translation from model systems to clinically relevant tissues. Despite growing interest in this problem, benchmarking efforts have been hindered by inconsistent evaluation tasks, heterogeneous metrics, and limited assessment across perturbation types and biological systems. Here, we introduce a benchmarking framework for cross-context perturbation-signature prediction (a task we define as signature recontextualization), grounded in explicit definitions of the prediction task, target-data availability, and evaluation metrics centered on signature recovery. The framework evaluates prediction performance across three target-context data regimes: (1) control only, where only control profiles from the target context are measured; (2) low coverage, where a limited subset of perturbations in the target context are measured; and (3) high coverage, where most perturbations in the target context are measured. This design enables systematic assessment of how prediction performance depends on target-context sample size while providing a standardized basis for comparing methods. We evaluate newly developed projection-based (projectCor) and network-based (netProp) methods alongside deep learning-based foundation models (scGPT, STACK) and statistical baselines. The benchmark spans diverse perturbational datasets: CRISPR knockdowns and drug perturbations in cell lines, plus in vivo chemical perturbations in rat tissues from DrugMatrix, extending evaluation beyond isolated cell-line models to tissue-level responses. For each method, evaluation was limited to the datasets, and perturbation types each model supports. Across tasks, projection and network propagation approaches show strong flexibility across perturbation types and biological contexts, and in several cases match or exceed the performance of deep learning and foundation models. We further show that perturbation predictability varies substantially with pathway conservation, transcriptional response strength, and baseline similarity between source and target contexts. All datasets, methods, and evaluation utilities are released as an open-source R package (sigRecon), providing a foundation for reproducible benchmarking and future method development.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A Systematic Comparison of Single-Cell Perturbation Response Prediction Models
Lanxiang Li, Yue You, … Luyi Tian·Science AdvancesPeer-reviewed·Sep 9, 2026
- A structured study of cross-condition prediction of transcriptional responses to gene perturbations
Ouyang Zhu, Jun Li·bioRxiv·Aug 5, 2026
- Learning Perturbation-specific Cell Representations for Prediction of Transcriptional Response across Cellular Contexts
Gal Keinan, Karen Sayal, … Jeremy L. England·bioRxiv·Mar 20, 2023
- Genetic Perturbation Prediction Models Fail Out-of-Distribution: A Rigorous Benchmark and Systematic Evaluation
Kanupriya Tiwari, Gaurang Mahajan, … Abhishek K Jha·bioRxiv·Oct 19, 2026
- Gradient-aware modeling advances AI-driven prediction of genetic perturbation effects
Dixian Zhu, Livnat Jerby‐Arnon·bioRxiv·Oct 3, 2025
- Signal, Bounds, and Baselines: Principles for Evaluating Virtual Cell Perturbation Models
Michael Vollenweider, Peter Bühlmann·bioRxiv·May 27, 2026