Sign in
GenomicsbioRxiv
Preprint

The Genome In A Bottle HG002 assembly-based variant benchmark set enables comprehensive benchmarking of small and structural variants.

N. D. Olson, N. Dwarshuis, N. F. Hansen, S. Koren, A. Rhie, J. H. McDaniel, J. Wagner, G. Berry, K. Shafin, A. English, C. T. Saunders, R. Kundu, J. M. Holt, D. Freed, A. A. Abdulkadir, C. Daniels, S. Majidian, L. F. Paulin, F. J. Sedlazeck, M. Fleharty, Y. Gao, L. Denti, L. Brambrink, A. Carroll, P.-C. Chang, , Lan

Abstract

High-accuracy, high-resolution benchmark data are fundamental to improving the accuracy and generalizability of sequencing technologies and associated algorithms. Most existing benchmarks for DNA sequencing rely on mapping to a single linear reference, omitting inaccessible and highly repetitive complex genomic regions. Here, we present the Genome in a Bottle (GIAB) Consortium's HG002 v5.0q benchmark set, a more comprehensive variant benchmark derived from a fully phased, highly curated, and accurate diploid assembly of HG002. Our approach leverages recent advances in long-read sequencing and assembly to provide confident small- and structural-variant calls across previously inaccessible regions, including segmental duplications, homopolymers, tandem repeats, and complex immune loci. The v5.0 benchmark significantly expands the callable genome relative to v4.2.1, adding x200 Mbp of sequence and increasing variant detection by 18 % for small variants and 3-fold for structural variants compared to previous benchmarks. The benchmark regions include more variants in repetitive regions, including 1.2 x segmental duplications, 1.8 x tandem repeats, and 2.0 x homopolymers, compared to v4.2.1. Separate and combined small- and structural-variant benchmarks are available for three versions of the human reference genome (GRCh37, GRCh38, and CHM13). We validate the reliability of this benchmark set by comparing multiple sequencing technologies and variant calling pipelines and curating differences. The v5.0q benchmark provides a critical resource for the development and validation of next-generation sequencing technologies and analysis methods.

PDFDOI

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISWagner '22Hansen '26Zook '19Coller '26Holt '26Daniels '24
77% semantic matchGenomics
Justin Wagner, Nathan D. Olson, Lindsay N. Harris+39 more·Cell Genomics·Apr 28, 2022· 205 citations