The small genomics lab experience optimizing data cold storage
Abstract
Translational research is often a collaborative enterprise that involves basic science researchers, clinicians, and experts in genomics and bioinformatics. While there are central university and industry cores to support data generation, long-term storage often falls to the individual investigators. We frequently fulfill the role of long-term FASTQ file storage for our collaborators. To reduce our cold storage space, we tested the space savings for gzip and zstandard algorithms on an old set of FASTQ files. We found that zstandard had a better overall compression ratio than the best gzip algorithm, amounting to more than 20% space savings overall compared to gzip. It may be worth transitioning to zstandard compression for small, collaborative genomics labs to minimize cold storage costs.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Deep FASTQ and BAM co-compression in Genozip 15
Divon Mordechai Lan, Daniel Hughes, Bastien Llamas·bioRxiv·Jul 7, 2023
- FaStore - a space-saving solution for raw sequencing data
Łukasz Roguski, Idoia Ochoa, … Sebastian Deorowicz·BioinformaticsPeer-reviewed·Mar 27, 2018
- FASTR: Reimagining FASTQ via Compact Image-inspired Representation
Adrian Tkachenko, Sepehr Salem, … Mohammed Alser·bioRxiv·Jan 23, 2026
- GeneSqueeze: A Novel Lossless, Reference-Free Compression Algorithm for FASTQ/A Files
Foad Nazari, Sneh Patel, … Emma K. Murray·bioRxiv·Mar 21, 2024
- CoLoRd: Compressing long reads
Marek Kokot, Adam Gudyś, … Sebastian Deorowicz·Nature MethodsPeer-reviewed·Mar 28, 2022
- Genozip 14 - advances in compression of BAM and CRAM files
Divon Mordechai Lan, Bastien Llamas·bioRxiv·Sep 12, 2022