bioRxivScientific Communication & EducationPreprint
Is the replication crisis a problem for biologists? A geometric morphometric approach.
J. Vrdoljak, K. I. Sanchez, R. Arreola-Ramos, E. G. Diaz Huesa, A. Villagra, L. J. Avila, M. Morando
Abstract
Replicability of findings is the key factor of scientific reliability. However, literature on this topic is scarce and apparently taboo for large scientific areas. Some authors named the failure to reproduce scientific findings replication crisis. Geometric morphometrics, a vastly used technique, is especially silent on replication crisis concern. Nevertheless, some works pointed out that sharing morphogeometric information is not a trivial fact, but need to be careful and meticulous. Here, we investigated the replicability of geometric morphometrics protocols on complex shapes and measurement error extension in three different types of taxa, as well as the potentiality of these protocols to discriminate among closely related species. We found a wide range of replication error that contributed from 19.5% to 60% of the total variation. Although, measurement error decreased with the complexity of the quantified shape, it often maintained high values. All protocols were able to discriminate between species, but more morphogeometric information does not imply better performance. We present evidence of replication crisis in life sciences and highlight the need to explore in deep different sources of variation that could lead to low replicability findings. Lastly, we enunciate some recommendations in order to improve the replicability and reliability of scientific findings.
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Is shape in the eye of the beholder? Assessing landmarking error in geometric morphometric analyses on live fish
P. Moccetti, J. R. Rodger, … D. A. Joyce·bioRxiv·Oct 11, 2022
- A statistical definition for reproducibility and replicability
Prasad Patil, Roger D. Peng, Jeffrey T. Leek·bioRxiv·Jul 29, 2016
- Eliminating accidental deviations to minimize generalization error and maximize replicability: applications in connectomics and genomics
Eric Bridgeford, Shangsi Wang, … Joshua T Vogelstein·bioRxiv·Jul 24, 2021
- A comparison of two methods for estimating measurement repeatability in morphometric studies
Z. Wylde, R. Bonduriansky·bioRxiv·May 7, 2020
- Statistics in service of metascience: Measuring replication distance with reproducibility rate
Erkan O. Buzbas, Berna Devezer·EntropyPeer-reviewed·Oct 5, 2024
- The logical structure of experiments lays the foundation for a theory of reproducibility
E. O. Buzbas, B. Devezer, B. Baumgaertner·bioRxiv·Aug 10, 2022