bioRxivBioinformaticsPreprint
Enabling Megascale Microbiome Analysis with DartUniFrac
Jianshu ZhaoiD, Daniel T. McDonaldiD, I. SfiligoiiD, Manuel E. LladseriD, Lucas PateliD, Yuhan WengiD, Lora A. KhatibiD, Samuel DegregoriiD, Antonio Gonzalez, Catherine LozuponeiD, Rob D. KnightiD
Abstract
We introduce a new algorithm, DartUniFrac, and a near-optimal implementation with GPU acceleration, up to three orders of magnitude faster than the state of the art and scaling to millions of samples (pairwise) and billions of taxa. DartUniFrac connects UniFrac with weighted Jaccard similarity and exploits sketching algorithms for fast computation. We benchmark DartUniFrac against exact UniFrac implementations, demonstrating that DartUniFrac is statistically indistinguishable from them on real-world microbiome and metagenomic datasets.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- EMDUnifrac: Exact linear time computation of the Unifrac metric and identification of differentially abundant organisms
J. McClelland, D. Koslicki·bioRxiv·Nov 14, 2016
- Streaming histogram sketching for rapid microbiome analytics
Will P. M. Rowe, Anna Paola Carrieri, … Martyn Winn·MicrobiomePeer-reviewed·Mar 16, 2019
- dbOTU3: A new implementation of distribution-based OTU calling
Scott W Olesen, Claire Duvallet, Eric J Alm·bioRxiv·Sep 22, 2016
- Meta-Prism 2.0: Enabling algorithm for ultra-fast, accurate and memory-efficient search among millions of microbial community samples
- Metalign: Efficient alignment-based metagenomic profiling via containment min hash
Nathan LaPierre, Mohammed Alser, … Serghei Mangul·Genome biologyPeer-reviewed·Sep 10, 2020
- mb-PHENIX: Diffusion and Supervised Uniform Manifold Approximation for denoising microbiota data
Cristian Padrón-Manrique, Aarón Vázquez-Jiménez, … Osbaldo Reséndis-Antonio·BioinformaticsPeer-reviewed·Nov 28, 2023