Arun Isaac

The paper benchmarks frontier and local LLMs on a biomedical knowledge graph using expert-curated questions and a new evaluation metric called psi.

GNQA, a retrieval-augmented GPT question-answering system over 3000 GeneNetwork, aging and diabetes papers, cites source paragraphs; RAGAS rated answer relevance above human thumbs-up ratings (89% vs 76%).