bioRxivBioinformaticsPreprint
GroundAnnot: a closed-vocabulary contract for grounding LLM gene-set annotation in live enrichment backends
Abstract
Motivation: LLM agents increasingly draft functional interpretations of gene lists, but can cite Gene Ontology (GO) terms that no current enrichment backend returned for that list, and can pair real GO accessions with fabricated labels. Results: We present GroundAnnot, a client for PANTHER, Enrichr, and g:Profiler that returns a closed vocabulary of GO term IDs and their backend labels, and enforces two contracts: Contract A (no ID or label outside the backend payload) and Contract B (no enrichment claim outside the backend's significant set). Across three open-weight models (Qwen2.5-7B local; Qwen3.8-27B and GPT-OSS-120B via Groq) on six curated disease gene lists, mean valid-enriched rates were 15.3%, 20.1%, and 35.1%. All unsupported IDs were real GO terms classified by QuickGO as wrong-biology, obsolete, or wrong-branch (zero fabricated accessions). A distinct failure mode emerged: for the Alzheimer's gene list, the local 7B model paired every one of its ten stable picks with a label that does not match the current GO term for that accession (10/10 mismatches), producing a coherent synaptic-signalling narrative that the IDs do not support. Mean overlap with the backends' FDR top-10 union was 0.33-0.67/10. On 50 MSigDB Hallmark gene sets, the strongest model named the defining pathway in 21/44 (47.7%) directly named cases. When an enriched shortlist was placed in the prompt, all three models complied fully (60/60 for each model; 180/180 overall), showing that a bounded vocabulary removes these output classes when the downstream agent is required to use it.
- research focus: benchmarking
- research focus: gene regulatory network inference
- research focus: differential expression
- approach: statistical model
- approach: benchmark study
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Enrich.AI: An Agentic AI Platform for Interactive GeneSet Enrichment Analysis and Biological Interpretation
Dimitrios E. Koumadorakis, Themis P. Exarchos, … Aristidis G. Vrahatis·bioRxiv·Oct 6, 2026
- Automatic Consistency Assurance for Literature-based Gene Ontology Annotation
Jiyu Chen, Nicholas Lewis Geard, … Karin M. Verspoor·BMC BioinformaticsPeer-reviewed·Nov 25, 2021
- LLM-Assisted Functional Gene Annotation
Calvin Boyce, Clara Pereira, … Allegra A. Petti·bioRxiv·Aug 6, 2025
- lisaR: An LLM-Inferred Semantic Annotation of biological categories for gene set enrichment analysis
Claudia Velasco-Lopez, Guillermo de la Vega-Barranco, David Olmeda·bioRxiv·Oct 6, 2026
- GO Bench: Shared-hub for Universal Benchmarking of Machine Learning-Based Protein Functional Annotations
Andrew M. Dickson, Ehsaneddin Asgari, … Mohammad R. K. Mofrad·BioinformaticsPeer-reviewed·Feb 1, 2023
- Application of large language models to the annotation of cell lines and mouse strains in genomics data
Sanja Rogić, Burak Ogan Mancarci, … Paul Pavlidis·DatabasePeer-reviewed·Jan 1, 2026