X-Cell: Scaling Causal Perturbation Prediction Across Diverse Cellular Contexts via Diffusion Language Models
Chloe WangiD, Mehran KarimzadehiD, Neal G. RavindraiD, Lexi R. BoundsiD, Nader AlerasooliD, Ann HuangiD, Shihao MaiD, Daniel R. GulbransoniD, Haotian CuiiD, Yongju LeeiD, Anusuya Arjavalingam, Elliot J. MacKrelliD, Matthew S. Wilken, Jieming CheniD, Benjamin W. Herken, Jesse A. Weber, Massimo M. OnestoiD, Bárbara González‐TerániD, Nicole F. Leung, Sally Yu ShiiD, Byron J. Smith, Sharon K. Lam, Adam Barner, Philip Wright, Elizabeth M Rumsey, , Bo WangiD
Abstract
Causal models of cellular systems hold the promise to empower broad biological discovery, including the systematic identification of novel targets for drug discovery. Predicting how genetic and pathway perturbations reshape gene expression across diverse cellular contexts is a prerequisite for building generalizable cellular foundation models. However, current methods typically fail to extrapolate beyond their training distributions because they rely predominantly on observational expression atlases rather than interventional perturbation data. We present X-Atlas/Pisces, the largest genome-wide CRISPRi Perturb-seq compendium to date, comprising 25.6 million perturbed single-cell transcriptomes across 16 biologically diverse contexts, including widely used cell lines, induced pluripotent stem cells (iPSCs), resting and CD3/CD28 activated Jurkat T lymphoma cells, and multi-lineage differentiating iPSCs. Leveraging this resource, we develop X-Cell, a diffusion language model that predicts perturbation responses by iteratively refining control-to-perturbed state transitions through cross-attention to multi-modal biological priors derived from natural language, protein language models, interaction networks, genetic dependency maps, and morphological profiles. X-Cell outperforms existing state-of-the-art models by up to five-fold on key metrics such as Pearson{Delta} (correlation between predicted and observed perturbation-induced log-fold changes), and demonstrates zero-shot prediction of T cell inactivating perturbations in stimulated Jurkat cells. We scale X-Cell to 4.9 billion parameters (X-Cell-Ultra), the largest causal perturbation model to date. We demonstrate for the first time that perturbation prediction follows power-law scaling with an exponent matching large language models. X-Cell-Ultra demonstrates zero-shot generalization to novel biological contexts, including unseen iPSC-derived melanocyte progenitors and primary human CD4+ T cells from multiple donors, and outperforms all baselines after self-supervised test-time adaptation. These results demonstrate that coordinated scaling of causal perturbation data and model capacity yields foundation models capable of generalizable perturbation prediction across cellular contexts, with potential applications for improving computational target identification, validation, and context-specific therapeutic prioritization.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 13
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Tabular Foundation Models Are Competitive Cellular Perturbation Predictors Across Biological Scales
Giovanni Palla, Alexander V. Hillsley, … Löıc A. Royer·bioRxiv·Jul 19, 2026
- pertTF: context-aware AI modeling for genome-scale and cross-system perturbation prediction
Yangqi Su, Dingyu Liu, … Wei Li·bioRxiv·Mar 16, 2026
- ExPert infers causal perturbations from cell states across biological and clinical contexts
Leon Schwartz, Jacob L. Schlamowitz, … Yogesh Goyal·bioRxiv·Nov 3, 2026
- Unified multimodal learning enables generalized cellular response prediction to diverse perturbations
Chen Li, Lei Wei, Xuegong Zhang·bioRxiv·Nov 13, 2025
- Predicting how perturbations reshape cellular trajectories with PerturbGen
Kevin Chi Hao Ly, Adib Miraki Feriz, … Mohammad Lotfollahi·bioRxiv·Mar 5, 2026
- Predicting cellular responses to perturbation across diverse contexts with STATE
Abhinav Adduri, Dhruv Gautam, … Yusuf Roohani·CellPeer-reviewed·Aug 31, 2026