Imperfect gold standard gene sets yield inaccurate evaluation of causal gene identification methods
Abstract
Causal gene discovery methods are often evaluated using gold-standard (GS) sets of causal genes. However, GS gene sets are always incomplete, leading to mis-estimation of sensitivity, specificity, AUC. Labeling biases in GS gene sets can also lead to inaccurate ordering of discovery methods. We argue that evaluation of these methods should rely on statistical techniques like those used for variant discovery, rather than on comparison with GS gene sets.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 1
- FWCI
- 0.26
- Field percentile
- top 49%
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Robust discovery of causal gene networks via measurement error estimation and correction
Rahul Biswas, V P Brintha, … Manikandan Narayanan·bioRxiv·May 9, 2023
- Towards a gold standard for benchmarking gene set enrichment analysis
Ludwig Geistlinger, Gergely Csaba, … Levi Waldron·Briefings in BioinformaticsPeer-reviewed·Nov 11, 2019
- Simplifying causal gene identification in GWAS loci
Marijn Schipper, Jacob C. Ulirsch, … Karl Heilbron·medRxiv·Jul 26, 2024
- Benchmarking genome-wide association study causal gene prioritization for drug discovery
Caleb Ji, Isabel Kerrebijn, … Michael Wainberg·medRxiv·Sep 23, 2025
- Benchmarker: an unbiased, association-data-driven strategy to evaluate gene prioritization algorithms
Rebecca S. Fine, Tune H. Pers, … Joel N. Hirschhorn·The American Journal of Human GeneticsPeer-reviewed·May 2, 2019
- Efficient And Accurate Causal Inference With Hidden Confounders From Genome-Transcriptome Variation Data
Lingfei Wang, Tom Michoel·PLoS Computational BiologyPeer-reviewed·Aug 18, 2017