henhaobio
Sign in

Abstract

As ever-larger cohorts of human genomes are collected in pursuit of genotype/phenotype associations, sequencing informatics must scale up to yield complete and accurate genotypes from vast raw datasets. Joint variant calling, a data processing step entailing simultaneous analysis of all participants sequenced, exhibits this scaling challenge acutely. We present GLnexus (GL, Genotype Likelihood), a system for joint variant calling designed to scale up to the largest foreseeable human cohorts. GLnexus combines scalable joint calling algorithms with a persistent database that grows efficiently as additional participants are sequenced. We validate GLnexus using 50,000 exomes to show it produces comparable or better results than existing methods, at a fraction of the computational cost with better scaling. We provide a standalone open-source version of GLnexus and a DNAnexus cloud-native deployment supporting very large projects, which has been employed for cohorts of >240,000 exomes and >22,000 whole-genomes.

In-depth summary

Claude Opus 5.5 · xhigh effort · 17 Oct 2026 · from the full text of version 1 (11 Jun 2018) · CC BY 4.0

GLnexus, a joint variant caller backed by an incrementally growable gVCF database, largely matched GATK on 50,000 exomes while keeping more rare indels and using 3.8–6.6-fold fewer core-hours.

Turning per-participant genome VCFs (gVCFs) into one cohort genotype matrix (project VCF, pVCF) scales super-linearly with cohort size and struggles with overlapping alleles and rare-variant genotyping. GLnexus combines frequency-ordered allele unification and a ramped allele-frequency prior with a persistent database that absorbs new participants, and it parallelises by splitting the cohort rather than the genome.

Key results

  1. ShownRun on identical gVCFs, GLnexus and GATK made nearly identical genotype calls at corresponding sites, but GLnexus kept more alleles, especially rare indels; its indel sites with no GATK counterpart were nearly all seen in ten or fewer copies.

    Chromosome 2 exome targets, 50K DiscovEHR exomes: genotypes disagreed in 0.00073% of 12.8 billion matrix cells, or 0.12% of the 80 million cells where either pVCF showed variation; over 33% more rare indels; of 3,228 biallelic indel sites absent from GATK's pVCF, 98.7% had ten or fewer copies and 45.2% were singletons (median genotype quality, GQ, 74; the rest median 57). · 3. VALIDATION STUDY WITH 50,000 EXOMES

  2. ShownTrio checks indicate the added sensitivity did not cost genotype quality: GLnexus calls showed fewer apparent Mendelian violations than GATK, most clearly for indels, and a more unified site representation.

    877 child–mother–father trios, violations used as an error proxy: GATK flagged a violation in 8.2% of 44,107 indel-variant genotype triplets vs 6.8% for GLnexus. GLnexus had more multiallelic sites (5.9% vs 4.5%) and fewer overlapping sites (1.5% vs 2.8%); monoallelic fallback sites were 0.35% of sites. · 3. VALIDATION STUDY WITH 50,000 EXOMES

  3. ShownGLnexus, with its ramped allele-frequency prior, kept rare-variant sensitivity stable as the cohort grew, whereas GATK increasingly dropped very rare sites of below-average call quality when the same samples were joint-called inside larger cohorts.

    Nested random subsets: of GATK's 77,138 sites at 5K, 309 (0.40%) were absent at 10K, 465 (0.60%) at 25K and 492 (0.64%) at 50K (median GQ 71 for the 492). GLnexus lost fewer than 10 of its 5K sites, attributed to low-complexity-region filtering. · Joint calling scaling from N=1K to N=50K; Empirical frequency prior

  4. ShownGLnexus consumed several-fold fewer core-hours than GATK 3.8, and the advantage grew with cohort size even under conservative timing.

    Nested 1K–50K cohorts: 3.8-fold fewer core-hours at 1K rising to 6.6-fold fewer at 50K. GLnexus timings began from the original gVCFs and included a final Spark stage writing one pVCF file; the authors expect incremental, sharded operation to cost relatively less. · Runtime comparison

  5. ShownThe distributed, cohort-sharded deployment has already produced production pVCFs for hundreds of thousands of exomes and tens of thousands of whole genomes.

    243,953 exomes: 33 TB compressed gVCF to 6.8 TB pVCF (2.7 trillion entries) in about 36 h on 1,600 threads, roughly 14 thread-minutes per exome. 22,609 genomes (36.6x median coverage): 6.7 trillion-entry matrix from 481 TB of CRAM in about 35 h, under 7 core-hours per genome, for the combined CRAM-to-pVCF workflow. · 5. APPLICATIONS

Methods, data and reproducibility

A C/C++ joint caller loads gVCFs into a RocksDB key-value store keyed by 30-kilobase genomic bins and participant, greedily unifies QC-passing alleles by frequency into multiallelic sites (with monoallelic fallback sites), and re-genotypes with a ramped empirical allele-frequency prior; it was benchmarked against GATK 3.8 on chromosome 2 exome targets of 50K exomes.

  • DiscovEHR deep whole-exome sequences; chromosome 2 exome capture targets (2.6 Mbp) joint-called, plus nested random subsets of 1K, 5K, 10K and 25K · human · n = 50K
  • Child, mother and father trios within the 50K cohort, used to count Mendelian inheritance violations · human · n = 877 trios
  • Largest of the Regeneron Genetics Center exome sequencing cohorts and cohort unions joint-called with distributed GLnexus · human · n = 243,953 participants
  • Whole genomes (36.6x median coverage) from several NIH-sponsored centres, xAtlas gVCFs merged at the Baylor College of Medicine Human Genome Sequencing Center · human · n = 22,609 whole genomes
  • Exomes merged from xAtlas gVCFs with the standalone version on one 32-thread node · human · n = 16,521 exomes
Methods & tools
GLnexus, GATK HaplotypeCaller 3.8, GATK CombineGVCFs and GenotypeGVCFs, RocksDB, Apache Spark, Apache Hadoop, DNAnexus, xAtlas, Platypus, DeepVariant, Sentieon DNAseq, Edico DRAGEN
Reagents & environment
Comparator was GATK 3.8 (HaplotypeCaller gVCFs; CombineGVCFs in batches of 500, then GenotypeGVCFs). No GLnexus version, container or requirements file is given.
Assay conditions & compute
Benchmark core-hours reported only as fold differences. Production: 243,953 exomes in about 36 h on 1,600 threads; 22,609 genomes in about 35 h (under 7 core-hours each); 16,521 exomes in 30 h on one 32-thread node.
Reproducibility gaps
The text says a standalone open-source version is provided, but its URL is missing from the extracted text. No access route is given for the DiscovEHR exomes or for the DNAnexus cloud-native version.
Limitations (6)
  • Built for diploid genotyping only, unlike GATK's model that supports higher ploidies, and it does not compute all of the QC measures GATK reports. · stated by the authors
  • The comparison is with GATK 3.8; GATK 4.0's newer joint-calling tools were only tried in initial attempts, which did not find them more efficient overall. · stated by the authors
  • Calibration varies across the bundled input configurations for other gVCF callers (Platypus, xAtlas, DeepVariant, Sentieon DNAseq, Edico DRAGEN). · stated by the authors
  • The hybrid representation produces two kinds of pVCF site, and simple alleles become harder to read when longer alleles overlap them. · stated by the authors
  • The quality benchmark covers only chromosome 2 exome targets in one cohort against one comparator, with errors judged by a Mendelian-violation proxy rather than a truth set. · noted in this summary
  • The 243,953-exome and 22,609-genome deployments are reported as throughput only, with no genotype-quality assessment. · noted in this summary

Read this if you joint-genotype thousands to hundreds of thousands of exomes or genomes and want evidence on GLnexus versus GATK for compute cost, rare-indel retention and incremental cohort growth.

Citations
107

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.