The GA4GH Workflow Execution Service: A Standard API for Workflow Execution and Management in Genomics
Valentin Schneider-LunitziD, Landfried KraatziD, Patrick MageeiD, Venkat S. MalladiiD, Brian D. O’ConnoriD, S.D. VarmaiD, James A. EddyiD, Hirotaka SuetakeiD, Jeff GentryiD, Michael Robin CrusoeiD, Angel PizarroiD, Junjun ZhangiD, Denis YueniD, Kyle EllrottiD, Philip Reiner KenscheiD, Michael LukowskiiD, Reggan ThomasiD, Sasha V. SiegeliD, Alexander KanitziD, Tazro OhtaiD, Sven Olaf TwardziokiD
Abstract
Rapid growth in life science data generation has led to large and increasingly distributed collections of sensitive genomic data. To analyse this data, researchers increasingly rely on computational workflows to enable scalable, portable and reproducible analysis. However, these workflows are executed by specialized workflow engines across heterogeneous compute environments, each with its own requirements. As a result, users often need engine- and compute-environment-specific knowledge to submit, monitor and manage workflow execution, increasing the barriers to interoperability. These challenges are compounded in large-scale projects, where workflow runs must be dispatched to local clusters, cloud platforms or data hosting infrastructures with different underlying technologies. We describe the Global Alliance for Genomics and Health (GA4GH) Workflow Execution Service (WES) API, an approved GA4GH standard first released in 2018, together with its data model and the endpoints that define a unified interface for workflow execution. By standardizing workflow invocation, the WES API allows a single client to submit, monitor and cancel workflow runs across diverse workflow engines and compute backends, such as scheduling clusters or cloud platforms. We surveyed thirteen adoptions of the standard, covering standalone services and platforms in four programming languages. In a two-site demonstration, a WES implementation from Germany and one from Japan executed the same federated allele-frequency analysis with site-specific adjustments and only aggregated results leaving either site, demonstrating that it is possible to run the same analysis across independently built and operated WES services in different countries. From the gaps identified, we propose extensions for community discussion.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- H3AGWAS : A portable workflow for Genome Wide Association Studies
Jean‐Tristan Brandenburg, Lindsay V. Clark, … Scott Hazelhurst·BMC BioinformaticsPeer-reviewed·Nov 19, 2022
- Functional equivalence of genome sequencing analysis pipelines enables harmonized variant calling across human genetics projects
Allison Regier, Yossi Farjoun, … Ira M. Hall·Nature CommunicationsPeer-reviewed·Sep 26, 2018
- Harmonizing and integrating the NCI Genomic Data Commons through accessible, interactive, and cloud-enabled workflows
Ling‐Hong Hung, Bryce Nobutoshi Fukuda, … Ka Yee Yeung·bioRxiv·Aug 11, 2022
- wft4galaxy: A Workflow Tester for Galaxy
Marco Enrico Piras, Luca Pireddu, Gianluigi Zanetti·BioinformaticsPeer-reviewed·Jul 21, 2017
- GWASHub: An Automated Cloud-Based Platform for Genome-Wide Association Study Meta-Analysis
Nicholas P. Sunderland, Drew Hite, … R Thomas Lumbers·medRxiv·Oct 21, 2025
- Workflow sharing with automated metadata validation and test execution to improve the reusability of published workflows
Hirotaka Suetake, Tsukasa Fukusato, … Tazro Ohta·GigaSciencePeer-reviewed·Dec 28, 2022