Answering clinicians' questions over trial evidence tables with verifiable, feedback-driven language models
Manan Roy ChoudhuryiD, Suparno Roy Chowdhury, Swastik Sahoo, Muhammad Ali Khan, Kaneez Zahra Rubab Khakwani, Mohamad Bassam SonboliD, Irbaz Riaz, Vivek GuptaiD
Abstract
Systematic reviews condense clinical trials into evidence tables, yet clinicians can interrogate these tables only through database queries, and many questions concern attributes that the table does not record, such as a drug's target class or a harmonised endpoint. Here we introduce FD-SCoPE, a language-model framework that answers both kinds of question, exposes the query, the selected trials and the derivation rule behind every answer, and learns from expert corrections. On an oncology evidence table of 159 immune checkpoint inhibitor trial records, FD-SCoPE completed all 140 clinician-style tasks (alternatives, 90.7--97.9%). For questions needing derived attributes it retrieved 99.3% of relevant trial records at a positive predictive value of 89.8% and outperformed four alternative approaches (derived-value F1 77.7% versus 64.8--73.4%). Corrections on 299 questions, simulated from reference answers, raised F1 on 1,201 unseen questions from 77.9% to 84.9%. Language models coupled with executable queries, verified programs and expert feedback can give clinicians auditable access to trial evidence.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Reliable extraction of clinical-trial evidence with provenance, verification, and targeted review
Gaurav Najpande, Prasham Titiya, … Vivek Gupta·bioRxiv·Oct 8, 2026
- ExpertTwins: Auditable Long Horizon Scientific Panels through Grounded Expertise
Ali Foroughi pour, Abbas Shirinifard·bioRxiv·Oct 15, 2026
- Version-aware question answering over living oncology guidelines
Tampu Ravi Kumar, Anirudh Iyengar Kaniyar Narayana Iyengar, … Vivek Gupta·bioRxiv·Oct 11, 2026
- RAPID: Reliable and efficient Automatic generation of submission rePortIng checklists with large language moDels
Zeming Li, Xufei Luo, … Shilin Tang·Journal of the American Medical Informatics AssociationPeer-reviewed·May 27, 2025
- SciRide Finder : citation-based paradigm in biomedical literature search.
Adam Volanakis, Konrad Krawczyk·Scientific ReportsPeer-reviewed·Apr 12, 2018
- Scoping reviews in medical education: A scoping review
L. A. Maggio, K. Larsen, … A. R. Artino·bioRxiv·Jul 23, 2020