bioRxivBioinformaticsPreprint
Sourmash Branchwater Enables Lightweight Petabyte-Scale Sequence Search
Abstract
We introduce branchwater, a flexible and fast petabase-scale search for the 767,000 public metagenomes presently in the NCBI Sequence Read Archive. Our search is based on the FracMinHash k-mer sketching technique and can search all public metagenomes with 1000 query genomes in approximately 36 hours using 50 GB of RAM and 32 threads. Branchwater is a Rust-based multithreading front-end built on top of the sourmash library. We provide biological use cases, examine performance, and discuss design and performance considerations.
- assay: metagenomics
- research focus: database / resource
- research focus: benchmarking
- approach: statistical model
- Citations
- 21
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Large-scale sequence comparisons with sourmash
N. Tessa Pierce‐Ward, Luiz C. Irber, … C. Titus Brown·F1000ResearchPeer-reviewed·Jul 4, 2019
- GSearch: Ultra-Fast and Scalable Microbial Genome Search by combining Kmer Hashing with Hierarchical Navigable Small World Graphs
Jianshu Zhao, Jean Pierre Both, … Konstantinos T. Konstantinidis·Nucleic Acids ResearchPeer-reviewed·Jun 27, 2024
- Mash: fast genome and metagenome distance estimation using MinHash
Brian D. Ondov, Todd J. Treangen, … Adam M. Phillippy·Genome BiologyPeer-reviewed·Jun 20, 2016
- Fast, lightweight, and accurate metagenomic functional profiling using FracMinHash sketches
Mahmudur Rahman Hera, Shaopeng Liu, … David Koslicki·bioRxiv·Nov 6, 2023
- Accelerating k-mer-based sequence filtering
Igor Martayan, Léa Vandamme, … Antoine Limasset·Peer Community JournalPeer-reviewed·Jun 17, 2026
- Connecting Syncmers to FracMinHash: similarities and advantages
Shaopeng Liu, David Koslicki·bioRxiv·Nov 9, 2023