Tibanna: software for scalable execution of portable pipelines on the cloud
Soohyun LeeiD, Jeremy JohnsoniD, Carl M. VitzthumiD, Koray KırlıiD, B. AlveriD, Peter J. ParkiD
Abstract
SummaryWe introduce Tibanna, an open-source software tool for automated execution of bioinformatics pipelines on Amazon Web Services (AWS). Tibanna accepts reproducible and portable pipeline standards including Common Workflow Language (CWL), Workflow Description Language (WDL) and Docker. It adopts a strategy of isolation and optimization of individual executions, combined with a serverless scheduling approach. Pipelines are executed and monitored using local commands or the Python Application Programming Interface (API) and cloud configuration is automatically handled. Tibanna is well suited for projects with a range of computational requirements, including those with large and widely fluctuating loads. Notably, it has been used to process terabytes of data for the 4D Nucleome (4DN) Network.\n\nAvailabilitySource code is available on GitHub at https://github.com/4dn-dcic/tibanna.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 13
- FWCI
- 1.77
- Field percentile
- top 10%
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Building containerized workflows using the BioDepot-workflow-builder (Bwb)
Ling‐Hong Hung, Jiaming Hu, … Ka Yee Yeung·Cell SystemsPeer-reviewed·Sep 11, 2019
- CWL-Airflow: a lightweight pipeline manager supporting Common Workflow Language
Michael Kotliar, Andrey V. Kartashov, Artem Barski·GigaSciencePeer-reviewed·Jul 1, 2019
- Flowr: Robust and efficient pipelines using a simple language-agnostic approach
Sahil Seth, Samir Amin, … Jianhua Zhang·bioRxiv·Oct 22, 2015
- Simplifying the development of portable, scalable, and reproducible workflows
Stephen Piccolo, Zachary E. Ence, … Andrea H. Bild·eLifePeer-reviewed·Oct 13, 2021
- Bioinformatics Pipeline using JUDI: Just Do It
Soumitra Pal, Teresa M. Przytycka·BioinformaticsPeer-reviewed·Dec 24, 2019
- Bioconda: A sustainable and comprehensive software distribution for the life sciences
Björn Grüning, Ryan Dale, … Matthew L. Workentine·Nature MethodsPeer-reviewed·Jun 25, 2018