bioRxivCancer BiologyPreprint
Improving reproducibility in pharmacogenomic screens through cross-study benchmarking
Kristen Michelle NaderiD, Filipp Ianevski, Aleksandr IanevskiiD, Tero A. AittokallioiD
Abstract
Drug-response measurements across pre-clinical pharmacogenomic studies remain poorly correlated, which limits biomarker discovery, precision oncology, and predictive modelling. The drivers of this inconsistency have been debated but not yet resolved. By integrating 15 pharmacogenomic studies encompassing 760 small-molecule compounds, 1,111 cell models, and 9.8 million dose-response measurements, we demonstrate that dose-response metric is the strongest driver of inconsistency, followed by experimental factors, such as treatment duration, plate format, and viability readout; in contrast, cell line molecular features contribute only minimally to reproducibility. Among drug classes, hormone therapies and PARP inhibitors show the highest concordance, whereas antimetabolites, topoisomerase inhibitors, and mitotic inhibitors exhibit substantial response variability across studies. To improve consistency, we developed a Drug Response Score (DRS), a proximity-weighted measure that emphasize pharmacologically informative concentrations near IC50, and we demonstrate in systematic benchmarking how DRS markedly improved cross-dataset concordance. Applications to patient-derived neuroblastoma organoids and leukemia patients primary cells demonstrate that DRS improves replicate-level consistency in patients drug-response profiles. To improve reproducible pharmacogenomic studies, we make openly available an integrated Drug Response Resource (iDRR, https://aittokallio.group/iDRR/), a standardized 15-dataset portal that supports robust biomarker discovery and cross-study benchmarking.
- assay: proteomics
- assay: metabolomics
- research focus: drug response / drug discovery
- research focus: benchmarking
- research focus: database / resource
- approach: benchmark study
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Assessment of pharmacogenomic agreement
Zhaleh Safikhani, Nehme El-Hachem, … Benjamin Haibe-Kains·F1000ResearchPeer-reviewed·May 9, 2016
- Revisiting inconsistency in large pharmacogenomic studies
Zhaleh Safikhani, Mark Freeman, … Benjamin Haibe-Kains·F1000ResearchPeer-reviewed·Aug 11, 2017
- PharmacoDB: an integrative database for mining in vitro anticancer drug screening studies
Petr Smirnov, Victor Kofia, … Benjamin Haibe‐Kains·Nucleic Acids ResearchPeer-reviewed·Sep 27, 2017
- Preclinical drug response metric based on cellular response phenotype provides better pharmacogenomic variables with phenotype relevance
- Meta-analysis of preclinical pharmacogenomic studies to discover robust and translatable biomarkers of drug response
P. Smirnov, S. K. Nair, … B. Haibe-Kains·bioRxiv·Oct 22, 2022
- PharmacoDB 2.0 : Improving scalability and transparency of in vitro pharmacogenomics analysis
Nikta Feizi, Sisira Kadambat Nair, … Benjamin Haibe‐Kains·Nucleic Acids ResearchPeer-reviewed·Oct 20, 2021