Modeling Science Trustworthiness Under Publish Or Perish Pressure
Abstract
The scientific endeavor pivots on the accurate reporting of experimental and theoretical findings, and consequently scientific publication is immensely important. As the number of active scientists continues to increase, there is concern that rewarding scientists chiefly on publication creates a perverse incentive where careless and fraudulent research can thrive. This is compounded by the predisposition of top-tier journals towards novel or positive findings rather than negative results or investigations that merely confirm a null hypothesis, despite their intrinsic value, potentially compounding a reproducibility crisis in several fields. This is a serious problem for both science and public trust in scientific findings. To date, there has been comparatively little mathematical modeling on the factors that influence science trustworthiness, despite the importance of quantifying the problem. In this work, we present a simple phenomenological model with cohorts of diligent, careless and unethical scientists with funding allocated based on published outputs. The results of this analysis suggest that trustworthiness of published science in a given field is strongly influenced by the false positive rate and the pressures from journals for positive results, and that decreasing available funding has negative consequences for the resulting trustworthiness. We also examine strategies to combat propagation of irreproducible science, including increasing fraud detection and awarding diligence, discussing the implications of these findings.
02 /Specification & Classification
Click any tag to browse matching papers- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Is biomedical research self-correcting? Modelling insights on the persistence of spurious science
D. R. Grimes·bioRxiv·Jul 17, 2023
- How Changes in Common Practice Can Improve the Quality of Biomedical Science
M. Steinfath, S. Vogl, … G. Schoenfelder·bioRxiv·Nov 13, 2017
- Is most published research really false?
Jeffrey T Leek, Leah R Jager·bioRxiv·Apr 27, 2016
- The Reproducibility Of Research And The Misinterpretation Of P Values
D. Colquhoun·bioRxiv·Oct 25, 2017
- Science with no fiction: measuring the veracity of scientific reports by citation analysis
Peter Grabitz, Yuri Lazebnik, … Sean Rife·bioRxiv·Aug 9, 2017
- Retractions and rewards in science: An open question for reviewers and funders
M. D. Ribeiro, M. Kalichman, S. M. Vasconcelos·bioRxiv·May 31, 2022