The Genome In A Bottle HG002 assembly-based variant benchmark set enables comprehensive benchmarking of small and structural variants.
N. D. Olson, N. Dwarshuis, N. F. Hansen, S. Koren, A. Rhie, J. H. McDaniel, J. Wagner, G. Berry, K. Shafin, A. English, C. T. Saunders, R. Kundu, J. M. Holt, D. Freed, A. A. Abdulkadir, C. Daniels, S. Majidian, L. F. Paulin, F. J. Sedlazeck, M. Fleharty, Y. Gao, L. Denti, L. Brambrink, A. Carroll, P.-C. Chang, , Lan
Abstract
High-accuracy, high-resolution benchmark data are fundamental to improving the accuracy and generalizability of sequencing technologies and associated algorithms. Most existing benchmarks for DNA sequencing rely on mapping to a single linear reference, omitting inaccessible and highly repetitive complex genomic regions. Here, we present the Genome in a Bottle (GIAB) Consortium's HG002 v5.0q benchmark set, a more comprehensive variant benchmark derived from a fully phased, highly curated, and accurate diploid assembly of HG002. Our approach leverages recent advances in long-read sequencing and assembly to provide confident small- and structural-variant calls across previously inaccessible regions, including segmental duplications, homopolymers, tandem repeats, and complex immune loci. The v5.0 benchmark significantly expands the callable genome relative to v4.2.1, adding x200 Mbp of sequence and increasing variant detection by 18 % for small variants and 3-fold for structural variants compared to previous benchmarks. The benchmark regions include more variants in repetitive regions, including 1.2 x segmental duplications, 1.8 x tandem repeats, and 2.0 x homopolymers, compared to v4.2.1. Separate and combined small- and structural-variant benchmarks are available for three versions of the human reference genome (GRCh37, GRCh38, and CHM13). We validate the reliability of this benchmark set by comparing multiple sequencing technologies and variant calling pipelines and curating differences. The v5.0q benchmark provides a critical resource for the development and validation of next-generation sequencing technologies and analysis methods.
02 /Specification & Classification
Click any tag to browse matching papers- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Benchmarking challenging small variants with linked and long reads
Justin Wagner, Nathan D. Olson, … Justin M. Zook·Cell GenomicsPeer-reviewed·Apr 28, 2022
- A complete diploid human genome benchmark for personalized genomics
Nancy Fisher Hansen, Nathan J. Dwarshuis, … Adam M. Phillippy·CellPeer-reviewed·Aug 1, 2026
- A robust benchmark for germline structural variant detection
Justin M. Zook, Nancy Fisher Hansen, … Marc Salit·bioRxiv·Jul 18, 2019
- Benchmarking sequence performance on the DNBSEQ-T7 using Genome in a Bottle reference genomes
Ansia van Coller, Setshaba Taukobong, … Nadia Carstens·bioRxiv·May 26, 2026
- Aardvark: Sifting through differences in a mound of variants
James M. Holt, Christopher T. Saunders, … Zev N. Kronenberg·DOAJ (DOAJ: Directory of Open Access Journals)Peer-reviewed·Jun 1, 2026
- A robust benchmark for detecting low-frequency variants in the HG002 Genome In A Bottle NIST reference material.
Camille A. Daniels, Adetola Abdulkadir, … Nathan D. Olson·bioRxiv·Dec 2, 2024