Biological rationales from language models enable leakage-resistant forecasts of target-indication success
Wanheng ZhangiD, Jie XuiD, Zichen ZhangiD, Minghui LiuiD, Ryan SuniD, Bissan Al‐LazikaniiD, Xiling SheniD, Scott KopetziD, Lang Wu, Bingxin ZhaoiD, Chong WuiD
Abstract
Identifying which target-indication (T-I) hypotheses can translate into clinical success remains a central challenge in drug discovery. We present PRIORITI (Prospective Rationale-Informed Outcome Reasoning for Integrated Target-indication Intelligence), a leakage-resistant framework that separates upstream biological evidence synthesis from outcome prediction. Given only a target gene and disease indication, a domain-instructed large language model (LLM) synthesizes drug-agnostic human genetics across prespecified channels. These evidence were embedded and combined with static entity context derived from gene summaries and disease definitions. The resulting representation is used to fit a supervised model trained on 6,784 temporally curated historical T-I outcomes, which is one of the largest cohorts assembled for this task. On a held-out historical test set of 1,696 T-I pairs, PRIORITI achieved a ROC-AUC of 0.883 and an expected calibration error (ECE) of 0.023, outperforming both a static target and indication context baseline and a human-curated genetic-evidence reference. On a strictly post-cutoff out-of-time benchmark of 765 T-I pairs, the largest such evaluation cohort reported to date, performance remained robust, with ROC-AUC 0.817, PR-AUC 0.357 and ECE 0.044, exceeding static target and indication context baseline and direct zero-shot LLM forecasting. A label-blinded LLM-based explainer further converted locked predictions into auditable prioritization rationales. Together, PRIORITI provides a calibrated, biology-first probability together with decision-oriented rationales for T-I prioritization before downstream translational investment.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Automating Candidate Gene Prioritization with Large Language Models: From Naive Scoring to Literature-Grounded Validation
Taushif Khan, Mohammed Toufiq, … Damien Chaussabel·BioinformaticsPeer-reviewed·Oct 1, 2025
- Clinical Advancement Forecasting
Eric Czech, Rafal Wojdyla, … Jeff Hammerbacher·medRxiv·Aug 2, 2024
- Predicting clinically promising therapeutic hypotheses using tensor factorization
Jin Jie Yao, Mark R. Hurle, … Pankaj Agarwal·BMC BioinformaticsPeer-reviewed·Feb 8, 2019
- Interpreting Omics Data Analysis with Large Language Models for Disease Target and Drug Discovery
ZIXI XU, Weihang Chen, … Fuhai Li·bioRxiv·May 23, 2026
- MERIT: Mechanism driven model predicts drug outcomes and nominates indications for failed drugs
H.H. Caline Koh-Tan, Ivan Meić, … Gabriel Richman·bioRxiv·Aug 17, 2026
- RAGulate: Retrieval-Augmented Generation for Post-hoc Literature-Grounded Regulatory Assessment
Mehrdad Zandigohar, Yang David Dai·bioRxiv·Jan 21, 2026