Not every gene is special: one simple rule to control the false discovery rate when analysing high-throughput sequencing data
Scott J Dos SantosiD, Andreea C. Murariu, Justin D. SilvermaniD, Gregory Brian GlooriD
Abstract
1Differential expression and differential abundance analyses are commonplace in studies employing high-throughput sequencing approaches; however different tools often fail to return comparable results when applied to the same dataset. Most tools employ various normalisations to attempt to correct for technical variation in the count data. Previously, we demonstrated that these normalisations are often inappropriate due to incorrect assumptions regarding the overall scale (i.e. size) of the biological system in question. In this study, we conducted 100 permutation analyses of 10 RNA-seq datasets to show that scale misspecification results in poor control of the false discovery rate by several commonly-used analysis tools. Moreover, we demonstrate that this can be ameliorated by using a scale model in ALDEx2 or ALDEx3 to account for uncertainty around the size of the system scale. We show that there is an inherent trade-off between satisfactory control of false-discovery rates and sensitivity and that no tool offers both. We also quantify how increasing scale uncertainty affects the difference between groups required for a feature to be reported as differentially expressed. Finally, we provide universal guidance on choosing an appropriate amount of scale uncertainty for any type of analysis. Overall, our work highlights the strengths and pitfalls of commonly used tools for differential expression analyses and highlights the choice between sensitivity and false-discovery rate control that all researchers are making when analysing sequencing data.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 1
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Explicit Scale Simulation for analysis of RNA-sequencing withALDEx2
Gregory Brian Gloor, Michelle Pistner Nixon, Justin D. Silverman·bioRxiv·Oct 21, 2023
- Beyond Normalization: Incorporating Scale Uncertainty in Microbiome and Gene Expression Analysis
Michelle Pistner Nixon, Gregory Brian Gloor, Justin D. Silverman·bioRxiv·Apr 1, 2024
- Replacing Normalizations with Interval AssumptionsImproves the Rigor and Robustness of DifferentialExpression and Differential Abundance Analyses
Kyle C. McGovern, Justin D. Silverman·bioRxiv·Oct 15, 2024
- A Comparison of Methods: Normalizing High-Throughput RNA Sequencing Data
Rahul Reddy·bioRxiv·Sep 3, 2015
- Excess False Positive Rates in Methods for Differential Gene Expression Analysis using RNA-Seq Data
David M Rocke, Luyao Ruan, … Sharon Aviran·bioRxiv·Jun 11, 2015
- Differential expression analysis of log-ratio transformed counts: benchmarking methods for RNA-Seq data
Thomas P. Quinn, Tamsyn M. Crowley, Mark F. Richardson·BMC BioinformaticsPeer-reviewed·Jul 18, 2018