Scalable, ultra-fast, and low-memory construction of compacted de Bruijn graphs with Cuttlefish 2
Jamshed KhaniD, Marek KokotiD, Sebastian DeorowicziD, Rob PatroiD
Abstract
The de Bruijn graph is a key data structure in modern computational genomics, and construction of its compacted variant resides upstream of many genomic analyses. As the quantity of genomic data grows rapidly, this often forms a computational bottleneck. We present CO_SCPLOWUTTLEFISHC_SCPLOW 2, significantly advancing the state-of-the-art for this problem. On a commodity server, it reduces the graph construction time for 661K bacterial genomes, of size 2.58Tbp, from 4.5 days to 17-23 hours; and it constructs the graph for 1.52Tbp white spruce reads in [~]10 hours, while the closest competitor requires 54-58 hours, using considerably more memory.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 53
- FWCI
- 3.92
- Field percentile
- top 4%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Cuttlefish: Fast, parallel, and low-memory compaction of de Bruijn graphs from large-scale genome collections
Jamshed Khan, Rob Patro·BioinformaticsPeer-reviewed·Apr 30, 2021
- Faster and Scalable Parallel External-Memory Construction ofColored Compacted de Bruijn Graphs with Cuttlefish 3
Jamshed Khan, Laxman Dhulipala, … Rob Patro·bioRxiv·Feb 2, 2025
- Bifrost - Highly parallel construction and indexing of colored and compacted de Bruijn graphs
Guillaume Holley, Páll Melsted·Genome biologyPeer-reviewed·Sep 17, 2020
- Extremely-fast construction and querying of compacted and colored de Bruijn graphs with GGCAT
Andrea Cracco, Alexandru Ioan Tomescu·Genome ResearchPeer-reviewed·May 30, 2023
- deGSM: memory scalable construction of large scale de Bruijn Graph
Hongzhe Guo, Yilei Fu, … Bo Liu·IEEE Transactions on Computational Biology and BioinformaticsPeer-reviewed·Apr 30, 2019
- Simplitigs as an efficient and scalable representation of de Bruijn graphs
Karel Břinda, Michael Baym, Grégory Kucherov·Genome biologyPeer-reviewed·Apr 6, 2021