Effect of lossy compression of quality scores on variant calling
Idoia OchoaiD, Mikel Hernaez, Rachel Goldfeder, Tsachy WeissmaniD, Euan Ashley
Abstract
Recent advancements in sequencing technology have led to a drastic reduction in the cost of genome sequencing. This development has generated an unprecedented amount of genomic data that must be stored, processed, and communicated. To facilitate this effort, compression of genomic files has been proposed. Specifically, lossy compression of quality scores is emerging as a natural candidate for reducing the growing costs of storage. A main goal of performing DNA sequencing in population studies and clinical settings is to identify genetic variation. Though the field agrees that smaller files are advantageous, the cost of lossy compression, in terms of variant discovery, is unclear.\n\nBioinformatic algorithms to identify SNPs and INDELs from next-generation DNA sequencing data use base quality score information; here, we evaluate the effect of lossy compression of quality scores on SNP and INDEL detection. We analyze several lossy compressors introduced recently in the literature. Specifically, we investigate how the output of the variant caller when using the original data (uncompressed) differs from that obtained when quality scores are replaced by those generated by a lossy compressor. Using gold standard genomic datasets such as the GIAB (Genome In A Bottle) consensus sequence for NA12878 and simulated data, we are able to analyze how accurate the output of the variant calling is, both for the original data and that previously lossily compressed. We show that lossy compression can significantly alleviate the storage while maintaining variant calling performance comparable to that with the uncompressed data. Further, in some cases lossy compression can lead to variant calling performance which is superior to that using the uncompressed file. We envisage our findings and framework serving as a benchmark in future development and analyses of lossy genomic data compressors.\n\nThe Supplementary Data can be found at http://web.stanford.edu/~iochoa/supplementEffectLossy.zip.
02 /Specification & Classification
Click any tag to browse matching papers- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- FaStore - a space-saving solution for raw sequencing data
Łukasz Roguski, Idoia Ochoa, … Sebastian Deorowicz·BioinformaticsPeer-reviewed·Mar 27, 2018
- ScaleQC: A Scalable Lossy to Lossless Solution for NGS Sequencing Data Compression
Rongshan Yu, Wenxian Yang·BioinformaticsPeer-reviewed·May 20, 2020
- Crumble: reference free lossy compression of sequence quality values
James Bonfield, Shane McCarthy, Richard Michael Durbin·BioinformaticsPeer-reviewed·Jul 9, 2018
- Impact of lossy compression of nanopore raw signal data on basecalling and consensus accuracy
Shubham Chandak, Kedar Tatwawadi, … Tsachy Weissman·BioinformaticsPeer-reviewed·Nov 24, 2020
- Nanopore quality score resolution can be reduced with little effect on downstream analysis
Martin Rivara-Espasandín, Lucía Balestrazzi, … Álvaro Martín·Bioinformatics AdvancesPeer-reviewed·Jan 1, 2022
- GeneSqueeze: A Novel Lossless, Reference-Free Compression Algorithm for FASTQ/A Files
Foad Nazari, Sneh Patel, … Emma K. Murray·bioRxiv·Mar 21, 2024