Science with no fiction: measuring the veracity of scientific reports by citation analysis
Peter GrabitziD, Yuri Lazebnik, Josh NicholsoniD, Sean RifeiD
Abstract
The current crisis of veracity in biomedical research is enabled by the lack of publicly accessible information on whether the reported scientific claims are valid. One approach to solve this problem is to replicate previous studies by specialized reproducibility centers. However, this approach is costly or unaffordable and raises a number of yet to be resolved concerns that question its effectiveness and validity. We propose to use an approach that yields a simple numerical measure of veracity, the R-factor, by summarizing the outcomes of already published studies that have attempted to test a claim. The R-factor of an investigator, a journal, or an institution would be the average of the R-factors of the claims they reported. We illustrate this approach using three studies recently tested by a replication initiative, compare the results, and discuss how using the R-factor can help improve the veracity of scientific research.
02 /Specification & Classification
Click any tag to browse matching papers- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Rigor and Transparency Index, a new metric of quality for assessing biological and medical science methods.
J. Menke, M. Roelandse, … A. E. Bandrowski·bioRxiv·Jan 15, 2020
- Statistics in service of metascience: Measuring replication distance with reproducibility rate
Erkan O. Buzbas, Berna Devezer·EntropyPeer-reviewed·Oct 5, 2024
- Issues in the statistical detection of data fabrication and data errors in the scientific literature: simulation study and reanalysis of Carlisle, 2017
Scott W. Piraino·bioRxiv·Aug 22, 2017
- A statistical definition for reproducibility and replicability
Prasad Patil, Roger D. Peng, Jeffrey T. Leek·bioRxiv·Jul 29, 2016
- The logical structure of experiments lays the foundation for a theory of reproducibility
E. O. Buzbas, B. Devezer, B. Baumgaertner·bioRxiv·Aug 10, 2022
- Is most published research really false?
Jeffrey T Leek, Leah R Jager·bioRxiv·Apr 27, 2016