Aether: Leveraging Linear Programming For Optimal Cloud Computing In Genomics
Jacob M. LuberiD, Braden T. TierneyiD, Evan M. CoferiD, Chirag J. PateliD, Aleksandar David KosticiD
Abstract
Across biology we are seeing rapid developments in scale of data production without a corresponding increase in data analysis capabilities. Here, we present Aether (http://aether.kosticlab.org), an intuitive, easy-to-use, cost-effective, and scalable framework that uses linear programming (LP) to optimally bid on and deploy combinations of underutilized cloud computing resources. Our approach simultaneously minimizes the cost of data analysis while maximizing its efficiency and speed. As a test, we used Aether to de novo assemble 1572 metagenomic samples, a task it completed in merely 13 hours with cost savings of approximately 80% relative to comparable methods.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 6
- FWCI
- 2.54
- Field percentile
- top 8%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Optimizing genomics pipeline execution with integer linear programming
Olesya Melnichenko, Venkat S. Malladi·bioRxiv·Feb 6, 2024
- Benchmarking undedicated cloud computing providers for analysis of genomic datasets.
Seyhan Yazar, George EC Gooden, … Alex Hewitt·bioRxiv·Aug 7, 2014
- FireCloud, a scalable cloud-based platform for collaborative genome analysis: Strategies for reducing and controlling costs
Chet Birger, Megan Hanna, … Gad A. Getz·bioRxiv·Nov 3, 2017
- Communication-Efficient Cluster Scalable Genomics Data Processing Using Apache Arrow Flight
Tanveer Ahmad, Chengxin Ma, … H. Peter Hofstee·International Symposium on Parallel and Distributed ComputingPeer-reviewed·Jul 1, 2022
- Accumulating computational resource usage of genomic data analysis workflow to optimize cloud computing instance selection
Tazro Ohta, Tomoya Tanjo, Osamu Ogasawara·GigaSciencePeer-reviewed·Apr 1, 2019
- Hot-starting software containers for bioinformatics analyses
Pai Zhang, Ling‐Hong Hung, … Ka Yee Yeung·GigaSciencePeer-reviewed·Jul 31, 2018