Genomics Proteomics & BioinformaticsGenomicsPeer-reviewed journal article
Precision and Accuracy in Quantitative Measurement of Gene Expression from Single-Cell/Nuclei RNA Sequencing Data
Rujia DaiiD, Ming ZhangiD, Tianyao ChuiD, Richard F. KoppiD, Chunling ZhangiD, Kefu LiuiD, Yue WangiD, Xusheng WangiD, Chao CheniD, Chunyu LiuiD
Abstract
Single-cell and single-nucleus RNA sequencing (sc/snRNA-Seq) have become essential tools for profiling gene expression across different cell types in biomedical research. While factors like RNA integrity, cell count, and sequencing depth are known to influence data quality, quantitative benchmarks and actionable guidelines are lacking. This gap contributes to variability in study designs and inconsistencies in downstream analyses. In this study, we systematically evaluated quantitative precision and accuracy in expression measures across 23 sc/snRNA-Seq datasets comprising 3,682,576 cells from 339 samples. Precision was assessed using technical replicates based on pseudo-bulks created from subsampling. Accuracy was evaluated using sample-matched scRNA-Seq and pooled-cell RNA-Seq data of mononuclear phagocytes from four species. Our results show that precision and accuracy are generally low at the single-cell level, with reproducibility being strongly influenced by cell count and RNA quality. We establish data-driven thresholds for optimizing study design, recommending at least 500 cells per cell type per individual to achieve reliable quantification. Furthermore, we show that signal-to-noise ratio is a key metric for identifying reproducible differentially expressed genes. To support future research, we developed VICE (Variability In single-Cell gene Expressions), a tool that evaluates sc/snRNA-seq data quality and estimates the true positive rate of differential expression results based on sample size, observed noise levels, and expected effect size. These findings provide practical, evidence-based guidelines to enhance the reliability and reproducibility of sc/snRNA-seq studies.
- organism: human
- organism: mouse
- organism: rat
- assay: scRNA-seq
- assay: snRNA-seq
- research focus: benchmarking
- approach: statistical model
- Citations
- 9
- FWCI
- 2.71
- Field percentile
- top 9%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Power Analysis of Single Cell RNA‐Sequencing Experiments
Valentine Svensson, Kedar N Natarajan, … Sarah A Teichmann·bioRxiv·Sep 8, 2016
- Reliable and accurate gene expression quantification with subpopulation structure-aware constraints for single-cell RNA sequencing
Ching-Chih Tu, Jui‐Hung Hung·bioRxiv·Nov 8, 2022
- Assessing the measurement transfer function of single-cell RNA sequencing
Hannah R. Dueck, Rizi Ai, … Junhyoung Kim·bioRxiv·Mar 24, 2016
- Missing Data and Technical Variability in Single-Cell RNA- Sequencing Experiments
Stephanie C. Hicks, F. William Townes, … Rafael A. Irizarry·BiostatisticsPeer-reviewed·Sep 15, 2017
- SAVER: Gene expression recovery for UMI-based single cell RNA sequencing
Mo Chao Huang, Jingshu Wang, … Nancy Ruonan Zhang·Nature MethodsPeer-reviewed·Jun 22, 2018
- Quantification and statistical modeling of Chromium-based single-nucleus RNA-sequencing data
Albert Kuo, Kasper D. Hansen, Stephanie C. Hicks·bioRxiv·May 20, 2022