Double Machine Learning with Multi-Gene Shared Backgroundfor Causal Inference in Single-Cell Data: Grouping Deviation Follows a Random Walk and the Accuracy-Compute Trade-Off
Abstract
In high-throughput single-cell transcriptomics (p {approx} 20,000 genes), performing double machine learning (DML) causal inference on q {approx} 5,000 target genes requires nuisance function fits that grow linearly with the number of targets (Kf cross-fitting folds, Kf = 5 or 10), far exceeding feasible computational budgets, especially with deep learning. We propose a Randomized Partition Strategy (RPS): randomly divide target genes into groups, share one background compression per group, reducing deep learning model training to q/m runs (m = group size) --- a factor of m savings. The cost of grouping is accuracy loss --- we prove that the cumulative deviation of the estimator follows a one-dimensional drift-free symmetric random walk, with diffusion variance growing linearly with group size and mean squared displacement equaling the mean squared error, so accuracy loss is predictable: m = 1 is always optimal, accuracy cost is monotonically increasing, and a small accuracy sacrifice yields m-fold compute savings. On GSE189050 SLE single-cell data (Memory B cells, n = 2120), both PCA and DL methods converge to the same conclusion, confirming the random walk mechanism is method-independent; an unexpected finding is that DL diffusion growth is only 16%, far slower than PCAs 7.4 times. This work provides a quantifiable theoretical foundation for compute strategy selection in single-cell high-dimensional causal inference.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Comparison of nuisance function construction strategies for double machine learning causal inference in single-cell transcriptomics: shared unsupervised deep learning does not require cross-fitting
Wei Ye, Xinyu Jiang, Feng(Ben) Shen·bioRxiv·Jul 26, 2026
- Cell-level random splits leak group-owned answers in single-cell benchmarks
- Causal disentanglement for single-cell representations and controllable counterfactual generation
Yicheng Gao, Kejing Dong, … Qi Liu·Nature CommunicationsPeer-reviewed·Jul 23, 2025
- CausalCell: applying causal discovery to single-cell analyses
Yujian Wen, Jielong Huang, … Hao Zhu·eLifePeer-reviewed·May 2, 2023
- Simple Causal Relationships in Gene Expression Discovered through Deep Learned Collective Variables
Ching-Hao Wang, Kalin Vetsigian, … Jeremy L. England·bioRxiv·Jan 18, 2023
- Machine Learning Approaches Identify Genes Containing Spatial Information from Single-Cell Transcriptomics Data.
Phillipe Loher, Nestoras Karathanasis·Frontiers in GeneticsPeer-reviewed·Feb 1, 2021