The impact factor fallacy
Abstract
The use of the journal impact factor (JIF) as a measure for the quality of individual manuscripts and the merits of scientists has faced significant criticism in recent years. We add to the current criticism in arguing that such an application of the JIF in policy and decision making in academia is based on false beliefs and unwarranted inferences. To approach the problem, we use principles of deductive and inductive reasoning to illustrate the fallacies that are inherent to using journal based metrics for evaluating the work of scientists. In doing so, we elaborate that if we judge scientific quality based on the JIF or other journal based metrics we are either guided by invalid or weak arguments or in fact consider our uncertainty about the quality of the work and not the quality itself.
02 /Specification & Classification
Click any tag to browse matching papers- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A simple proposal for the publication of journal citation distributions
Vincent Larivière, Véronique Kiermer, … Stephen Curry·bioRxiv·Sep 11, 2016
- Analysis of citation dynamics reveals that you do not receive enough recognition for your influential science
S. Arabi, C. Ni, B. I. Hutchins·bioRxiv·Sep 7, 2023
- Impact and centrality of scientific disciplines
D. Aguilar-Velazquez·bioRxiv·Sep 1, 2023
- QUALIS: The journal ranking system undermining the impact of Brazilian science
R. Jaffe·bioRxiv·Jul 5, 2020
- How faculty define quality, prestige, and impact in research
E. Morales, E. C. McKiernan, … J. P. Alperin·bioRxiv·Apr 14, 2021
- A formula to estimate a researcher’s impact by prioritizing highly cited publications
Aleksey V. Belikov, Vitaly V. Belikov·bioRxiv·Jun 15, 2016