Sign in
BioinformaticsPLoS Biology
Peer-reviewed journal article

Challenges and recommendations to improve the installability and archival stability of omics computational tools

Serghei ManguliD, Thiago S. MosqueiroiD, Richard J. AbdilliD, Dat DuongiD, Keith MitchelliD, Varuni SarwaliD, Brian L. HilliD, Jaqueline BritoiD, Russell LittmaniD, Benjamin Statz, Angela Ka-Mei LamiD, Gargi DayamaiD, Laura GrieneiseniD, Lana S. MartiniD, Jonathan Flint CiD, Eleazar EskiniD, Ran BlekhmaniD

Abstract

Developing new software tools for analysis of large-scale biological data is a key component of advancing modern biomedical research. Scientific reproduction of published findings requires running computational tools on data generated by such studies, yet little attention is presently allocated to the installability and archival stability of computational software tools. Scientific journals require data and code sharing, but none currently require authors to guarantee the continuing functionality of newly published tools. We have estimated the archival stability of computational biology software tools by performing an empirical analysis of the internet presence for 36,702 omics software resources published from 2005 to 2017. We found that almost 28% of all resources are currently not accessible through URLs published in the paper they first appeared in. Among the 98 software tools selected for our installability test, 51% were deemed \"easy to install,\" and 28% of the tools failed to be installed at all due to problems in the implementation. Moreover, for papers introducing new software, we found that the number of citations significantly increased when authors provided an easy installation process. We propose for incorporation into journal policy several practical solutions for increasing the widespread installability and archival stability of published bioinformatics software.

PDFDOI

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISGardner '22Grüning '18Jalili '20Nagraj '26Pico '22Patel '22
58% semantic matchBioinformatics
Paul P. Gardner, James M. Paterson, Stephanie McGimpsey+5 more·Genome biology·Feb 16, 2022· 22 citations