bioRxivGeneticsPreprint
The MRC IEU OpenGWAS data infrastructure
Benjamin ElsworthiD, Matthew LyoniD, Tessa AlexanderiD, Yi LiuiD, Peter Matthews, Jon Hallett, Phil Bates, Tom PalmeriD, Valeriia HaberlandiD, George Davey SmithiD, Jie ZhengiD, Philip HaycockiD, Tom R. GauntiD, Gibran HemaniiD
Abstract
Data generated by genome-wide association studies (GWAS) are growing fast with the linkage of biobank samples to health records, and expanding capture of high-dimensional molecular phenotypes. However the utility of these efforts can only be fully realised if their complete results are collected from their heterogeneous sources and formats, harmonised and made programmatically accessible. Here we present the OpenGWAS database, an open source, open access, scalable and high-performance cloud-based data infrastructure that imports and publishes complete GWAS summary datasets and metadata for the scientific community. Our import pipeline harmonises these datasets against dbSNP and the human genome reference sequence, generates summary reports and standardises the format of results and metadata. Users can access the data via a website, an application programming interface, R and Python packages, and also as downloadable files that can be rapidly queried in high performance computing environments. OpenGWAS currently contains 126 billion genetic associations from 14,582 complete GWAS datasets representing a range of different human phenotypes and disease outcomes across different populations. We developed R and Python packages to serve as conduits between these GWAS data sources and a range of available analytical tools, enabling Mendelian randomization, genetic colocalisation analysis, fine mapping, genetic correlation and locus visualisation. OpenGWAS is freely accessible at https://gwas.mrcieu.ac.uk, and has been designed to facilitate integration with third party analytical tools.
- organism: human
- assay: GWAS summary statistics
- research focus: database / resource
- research focus: GWAS / association mapping
- research focus: software / tool
- approach: statistical model
In-depth summary
Claude Opus 5.5 · xhigh effort · 17 Oct 2026 · from the full text of version 1 (10 Aug 2020) · CC BY 4.0
OpenGWAS serves 14582 harmonised, complete GWAS summary datasets (125.8 billion associations) via API, R/Python clients and GWAS-VCF downloads, with glue code for Mendelian randomization, colocalisation and fine-mapping.
Mendelian randomization (MR), colocalisation and genetic correlation need only GWAS summary statistics, yet those results are scattered across sources in inconsistent formats. OpenGWAS, superseding the 2015 MR-Base database, collects complete summary datasets, harmonises them and serves them programmatically to third-party tools rather than to MR alone.
Key results
ShownThe database holds thousands of complete GWAS summary datasets, keeping every analysed variant regardless of p-value, across disease, molecular and brain imaging traits, mostly from European-ancestry samples.
14582 datasets with 125.8 billion associations, from 196 consortium publications plus biobank-wide analyses (e.g. UK Biobank, Biobank Japan). Phenotypes: 4126 binary, 3371 protein, 3217 other continuous, 3143 brain-imaging and 725 metabolite. Extracted independent top hits total 116918, and 7109 datasets have at least one. · Abstract; Summary of the database contents
ClaimedEvery dataset passes one harmonisation pipeline, so alleles, strands and rsIDs are consistent across studies, and each dataset gets a published quality-control report.
gwas2vcf validates columns, orients the non-effect allele to GRCh37/hg19 (switching effect signs and frequencies when needed), left-aligns and trims variants with vgraph and annotates dbSNP build 153. Reports cover LD score regression, genomic inflation, strictly clumped hits, allele frequencies vs 1000 Genomes, and Z-scores from effect/SE vs from p-values. · Data harmonisation and quality control; Data processing pipeline; Per-study reports; LD score regression procedure
SuggestedAn automatic effect-allele check catches mis-annotated studies, which would otherwise reverse inferred causal directions in analyses such as MR.
Reported effect allele frequencies of common variants (frequency 0.1-0.3) are compared with a population reference, and an inverse relationship flags a mislabelled allele or frequency; several studies across many batches were flagged and needed follow-up, but no counts are given. · Effect allele checks
ClaimedA REST API with R and Python clients supports positional and p-value queries, LD-proxy substitution, on-the-fly clumping, LD matrices and phenome-wide lookups of a variant across all traits.
Proxies come from pre-computed variant pairs with LD R > 0.4 within 10Mb windows, returning the highest-LD proxy with phase-aligned alleles. Default clumping runs PLINK 1.90 on one of five 1000 Genomes phase 3 super-population panels (LD R < 0.001, 10Mb, p < 5e−8). Clients are ieugwasr and ieugwaspy. · Online access to the database; Linkage disequilibrium reference panel; LD proxy lookups
ClaimedFor heavy workloads the harmonised data can be downloaded as GWAS-VCF files with dedicated query packages, and the gwasglue R package passes API or file data straight into MR, colocalisation and fine-mapping tools.
gwasvcf (R) and pygwasvcf (Python) query GWAS-VCF files for parallel HPC jobs; served data sit in an Elasticsearch cluster on Oracle Cloud Infrastructure, chosen for query speed and scalability, with study metadata and embargo permissions in a Neo4j graph. No query-speed benchmarks are reported. · Accessing the data for high performance…; Connecting the queried data to analytical tools; Metadata; GWAS summary data
Methods, data and reproducibility
An import pipeline (gwas2vcf, run by Cromwell through the API or by Snakemake on HPC) validates and harmonises GWAS summary statistics against GRCh37 and dbSNP build 153 into GWAS-VCF, generates per-dataset QC reports, and loads data into Elasticsearch with Neo4j metadata, served through a REST API, client packages and downloadable files.
- Complete GWAS summary datasets from consortium publications, biobank-wide analyses (e.g. UK Biobank, Biobank Japan) and the EBI-NHGRI GWAS Catalog · human · n = 14582 datasets; 125.8 billion associations; 196 unique publications
- Trait composition of the database · human · n = 4126 binary, 725 metabolites, 3371 proteins, 3143 imaging, 3217 other
- 1000 Genomes phase 3 panel (five super-populations; autosomal SNPs, minor allele frequency > 0.01) for clumping, LD matrices and frequency checks; HapMap3 for LD score regression · human
- Methods & tools
- gwas2vcf and the GWAS-VCF format, ieugwasr (R) and ieugwaspy (Python) API clients, gwasvcf (R) and pygwasvcf (Python), gwasglue (R), TwoSampleMR / MR-Base, PLINK 1.90, LDSC, vgraph, Cromwell and Snakemake, Elasticsearch, Neo4j and Flask-RESTPlus, dbSNP build 153; GRCh37/hg19 reference, 1000 Genomes phase 3; EBI-NHGRI GWAS Catalog
- Reagents & environment
- Python3 API built on Flask-RESTPlus and run as containerised instances behind a load balancer; processing via a containerised Cromwell pipeline or Snakemake on HPC; PLINK 1.90 and dbSNP build 153 named, other versions not given.
- Assay conditions & compute
- Hosted on Oracle Cloud Infrastructure (Elasticsearch cluster); no hardware sizes or query timings are reported.
- Reproducibility gaps
- A Web links section names the homepage, API, each package (gwasglue, gwasvcf, pygwasvcf, ieugwasr, ieugwaspy, TwoSampleMR, gwas2vcf) and a data-request page, but all URLs are missing from this text; embargoed datasets need authenticated access.
Limitations (5)
- Data are mostly from European-ancestry samples, and differences in LD structure, ancestry or environment between datasets can bias joint analyses such as two-sample MR and colocalisation. · stated by the authors
- Studies differ in GWAS model (linear vs mixed models, family designs), covariate adjustment (attenuation or collider bias) and imputation quality control, and users have no control over these choices. · stated by the authors
- Winner's curse can inflate effect sizes of top hits, and independent replication data are hard to harvest, although some traits have several independent datasets in the database. · stated by the authors
- No query-performance benchmarks or validation of harmonisation accuracy are reported, and the comparison with similar resources sits in a table not included in this text. · noted in this summary
- Contents are a snapshot at the time of writing in a growing database that mirrors new GWAS Catalog datasets automatically, and no dataset versioning scheme is described for reproducing analyses. · noted in this summary
Read this if you run Mendelian randomization, colocalisation or other summary-statistic analyses and want harmonised GWAS data you can query programmatically or download in bulk.
- Citations
- 940
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- The NHGRI-EBI GWAS Catalog: standards for reusability, sustainability and diversity
María Cerezo, Elliot Sollis, … Laura Wiseman Harris·Nucleic Acids ResearchPeer-reviewed·Oct 22, 2024
- GWASHub: An Automated Cloud-Based Platform for Genome-Wide Association Study Meta-Analysis
Nicholas P. Sunderland, Drew Hite, … R Thomas Lumbers·medRxiv·Oct 21, 2025
- Analyzing bivariate cross-trait genetic architecture in GWAS summary statistics with the BIGA cloud computing platform
Yujue Li, Fei Xue, … Bingxin Zhao·bioRxiv·Apr 28, 2023
- The variant call format provides efficient and robust storage of GWAS summary statistics
Matthew Lyon, Shea J. Andrews, … Edoardo M. Marcora·Genome biologyPeer-reviewed·Jan 13, 2021
- A GWAS platform built on iPlant cyber-infrastructure
Liya Wang, Doreen Ware, … Lincoln Stein·bioRxiv·Feb 20, 2014
- Is useful research data usually shared? An investigation of genome-wide association study summary statistics
M. Thelwall, M. Munafo, … K. Kousha·bioRxiv·May 3, 2019