bioRxivScientific Communication & Education
Analytical code sharing practices in biomedical research
N. K. Sharma, R. Ayyala, D. Deshpande, Y. M. Patel, V. Munteanu, D. Ciorba, A. Fiscutean, M. Vahed, A. Sarkar, R. Guo, A. Moore, N. Darci-Maher, N. A. Nogoy, M. S. Abedalthagafi, S. Mangul
Abstract
Data-driven computational analysis is becoming increasingly important in biomedical research, as the amount of data being generated continues to grow. However, the lack of practices of sharing research outputs, such as data, source code and methods, affects transparency and reproducibility of studies, which are critical to the advancement of science. Many published studies are not reproducible due to insufficient documentation, code, and data being shared. We conducted a comprehensive analysis of 453 manuscripts published between 2016-2021 and found that 50.1% of them fail to share the analytical code. Even among those that did disclose their code, a vast majority failed to offer additional research outputs, such as data. Furthermore, only one in ten papers organized their code in a structured and reproducible manner. We discovered a significant association between the presence of code availability statements and increased code availability (p=2.71x10-9). Additionally, a greater proportion of studies conducting secondary analyses were inclined to share their code compared to those conducting primary analyses (p=1.15*10-07). In light of our findings, we propose raising awareness of code sharing practices and taking immediate steps to enhance code availability to improve reproducibility in biomedical research. By increasing transparency and reproducibility, we can promote scientific rigor, encourage collaboration, and accelerate scientific discoveries. We must prioritize open science practices, including sharing code, data, and other research products, to ensure that biomedical research can be replicated and built upon by others in the scientific community.
- research focus: benchmarking
- research focus: database / resource
- research focus: software / tool
- approach: statistical model
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Analysis of Practices to Promote Reproducibility and Transparency in Anaesthesiology Research: Are Important Aspects Hidden Behind the Drapes?
- Evaluation of Reproducible and Transparent Research Practices in Sports Medicine Research: A Cross-sectional study
- Assessment of transparency indicators across the biomedical literature: how open is open?
S. Serghiou, D. G. Contopoulos-Ioannidis, … J. P. A. Ioannidis·bioRxiv·Oct 30, 2020
- Transparent and Reproducible Research Practices in the Surgical Literature
T. Hughes, A. Niemann, … M. Vassar·bioRxiv·Oct 7, 2019
- Biomedical researchers perspectives on the reproducibility of research: a cross-sectional international survey
K. D. Cobey, S. Ebrahimzadeh, … D. Moher·bioRxiv·Sep 18, 2023
- A Statistical Framework for Robust and Reproducible BioImage Analysis
David J. Barry, Stefania Marcotti, … Gavin P. Kelly·bioRxiv·Feb 10, 2025