Beyond Bonferroni Revisited: Concerns over inflated false positives in conservation genetics, genetics, and neuroscience
Abstract
In 2006, Narum published a paper in Conservation Genetics that was motivated by the stringent nature of the Bonferroni approach for family wise error correction. That work suggested that the approach of Benjamini and Yekutieli in 2001 provided adequate correction and was more biologically relevant. However, there are crucial differences between the original Benjamini and Yekutieli procedure and that described by Narum. After carefully reviewing both papers, we believe that the Narum procedure is both different than the Benjamini and Yekutieli procedure and does not adequately control for family wise error. We provide an overview of approaches for FWE correction as well as evidence for the faulty implementation of the Benjamini and Yekutieli procedure by Narum using the equations from the respective papers, data from both papers, and the results of simulation.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 3
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Bonferroni's correction, not Tukey's, should be used to control the total number of false positives when making multiple pairwise comparisons in experiments with few replicates.
Adam Zweifach·SLAS DISCOVERYPeer-reviewed·Jul 21, 2025
- Effects of Experimental Design, Genetic Architecture and Threshold on Power and False Positive Rate of Genome-Wide Association Studies
Zhi Hao Melvin Loh, Sam Clark, Julius H. J. van der Werf·bioRxiv·Feb 19, 2022
- A tail of two sides: Artificially doubled false positive rates in neuroimaging due to the sidedness choice with t-tests
Gang Chen, Robert W. Cox, … Paul A. Taylor·Human Brain MappingPeer-reviewed·Sep 28, 2018
- Implementation of Bayesian Multiple Comparison Correction in the Second-Level Analysis of fMRI Data: With Pilot Analyses of Simulation and Real fMRI Datasets Based on Voxelwise Inference
Hyemin Han·Cognitive NeurosciencePeer-reviewed·Dec 19, 2019
- Combining Dependent P-values with an Empirical Adaptation of Brown’s Method
William Poole, David L. Gibbs, … Theo Knijnenburg·BioinformaticsPeer-reviewed·Aug 29, 2016
- Evaluating Methods of Correcting for Multiple Comparisons Implemented in SPM12 in Social Neuroscience fMRI Studies: An Example from Moral Psychology
Hyemin Han, Andrea L. Glenn·Social NeurosciencePeer-reviewed·Apr 27, 2017