bioRxivBioinformaticsPreprint
Reliable extraction of clinical-trial evidence with provenance, verification, and targeted review
Gaurav Najpande, Prasham Titiya, Muhammad Ali Khan, Kaneez Zahra Rubab Khakwani, Mohamad Bassam SonboliD, Irbaz Bin RiaziD, Vivek GuptaiD
Abstract
Reliable extraction of trial characteristics and outcomes is essential for systematic reviews, yet incorrect values can alter evidence synthesis and are difficult to detect without clear source evidence. We evaluate EviSearch, a clinical evidence-curation system that links extracted values to source passages, independently verifies cited evidence, and prioritizes higher-risk cells for review. Using ten trial publications, a 133-column schema, reference annotations, and consistent scoring across model families, we assess answer quality, inter-reading agreement, evidence reproduction, targeted review, and evidence modality. In the Qwen evaluation, EviSearch achieved 91.70% accuracy, cited 100.0% of admitted values, and reproduced 98.9% independently. Reviewing 15.6% of cells increased accuracy to 95.22%.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Overview of biomedical and public health reviews in Ethiopia from 1970 to 2018: trends, methodological qualities, gaps and future directions
Tesfa Dejenie Habtewold, Sisay Mulugeta Alemu, … Balewgizie Sileshi Tegegne·bioRxiv·Sep 4, 2018
- Sysrev: A FAIR Platform For Data Curation And Systematic Evidence Review
T. Bozada, J. Borden, … T. Luechtefeld·bioRxiv·Mar 24, 2021
- Auto-STEED: A data mining tool for automated extraction of experimental parameters and risk of bias items from in vivo publications
Wolfgang Emanuel Zürrer, Amelia Elaine Cannon, … Benjamin Victor Ineichen·bioRxiv·Feb 24, 2023
- Answering clinicians' questions over trial evidence tables with verifiable, feedback-driven language models
Manan Roy Choudhury, Suparno Roy Chowdhury, … Vivek Gupta·bioRxiv·Oct 5, 2026
- An index of the quality of evidence in meta-analysis of randomized controlled trials
Devon D. Brewer·bioRxiv·Mar 8, 2017
- Extracting the Research Goal from Biomedical Abstracts
Mariana Neves, Ines Schadock, … Bettina Bert·bioRxiv·Sep 19, 2025