Improving the efficiency of de Bruijn graph construction using compact universal hitting sets
Yael Ben-Ari, Dan FlominiD, Lianrong PuiD, Yaron OrensteiniD, Ron Shamir AiD
Abstract
High-throughput sequencing techniques generate large volumes of DNA sequencing data at ultra-fast speed and extremely low cost. As a consequence, sequencing techniques have become ubiquitous in biomedical research and are used in hundreds of genomic applications. Efficient data structures and algorithms have been developed to handle the large datasets produced by these techniques. The prevailing method to index DNA sequences in those data structures and algorithms is by using k-mers (k-long substrings) known as minimizers. Minimizers are the smallest k-mers selected in every consecutive window of a fixed length in a sequence, where the smallest is determined according to a predefined order, e.g., lexicographic. Recently, a new k-mer order based on a universal hitting set (UHS) was suggested. While several studies have shown that orders based on a small UHS have improved properties, the utility of using them in high-throughput sequencing analysis tasks has not been demonstrated to date. Here, we demonstrate the practical benefit of UHSs for the first time, in the genome assembly task. Reconstructing a genome from billions of short reads is a fundamental task in high-throughput sequencing analyses. De Bruijn graph construction is a key step in genome assembly, which often requires very large amounts of memory and long computation time. A critical bottleneck lies in the partitioning of DNA sequences into bins. The sequences in each bin are assembled separately, and the final de Bruijn graph is constructed by merging the bin-specific subgraphs. We incorporated a UHS-based order in the bin partition step of the Minimum Substring Partitioning algorithm of Li et al. (2013). Using a UHS-based order instead of lexicographic- or random-ordered minimizers produced lower density minimizers with more balanced bin partitioning, which led to a reduction in both runtime and memory usage.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 3
- FWCI
- 0.35
- Field percentile
- top 46%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Minimizer-space de Bruijn graphs
Barış Ekim, Bonnie Berger, Rayan Chikhi·bioRxiv·Jun 9, 2021
- deGSM: memory scalable construction of large scale de Bruijn Graph
Hongzhe Guo, Yilei Fu, … Bo Liu·IEEE Transactions on Computational Biology and BioinformaticsPeer-reviewed·Apr 30, 2019
- Efficient minimizer orders for large values of k using minimum decycling sets
David Pellow, Lianrong Pu, … Yaron Orenstein·Genome ResearchPeer-reviewed·Aug 9, 2023
- Bifrost - Highly parallel construction and indexing of colored and compacted de Bruijn graphs
Guillaume Holley, Páll Melsted·Genome biologyPeer-reviewed·Sep 17, 2020
- Genome assembly with variable order de Bruijn graphs
Diego Diaz-Domínguez, Pierfrancesco Martinello, … Leena Salmela·bioRxiv·Sep 6, 2022
- A randomized parallel algorithm for efficiently finding near-optimal universal hitting sets
Barış Ekim, Bonnie Berger, Yaron Orenstein·Lecture notes in computer sciencePeer-reviewed·Jan 1, 2020