henhaobio
Sign in

bioRxivBioinformaticsPreprint

SPaRTA: Spatial Reasoning in Text-to-SQL for Omics Analysis

Arka Dutta, Souvik Ghosh, Kenneth Prado, Ashiqur KhudaBukhshiD, Hirak SarkariD

PDFDOI

Abstract

Spatial-omics technologies provide clinicians, pathologists, and biomedical researchers with high-resolution maps of transcriptomic, proteomic, and metabolomic activity within tissues. However, querying these complex datasets often requires specialized computational expertise, limiting their accessibility to domain experts without programming experience. In the current manuscript, we develop SPaRTA (Spatial Reasoning in Text-to-SQL for Omics Analysis), a natural-language interface that translates free-text questions into executable spatial SQL queries over such data. We release SPaRTA-Bench, comprising dataset-specific database schemas, explicit query conventions, and 7,500 question-SQL pairs validated through LLM-assisted verification and targeted human review, spanning breast cancer, pancreatic cancer, and melanoma tissue sections, and identify 15 failure modes in which a query runs but returns a wrong answer. Open-weight large language models (LLMs) of the Llama, Mistral, Qwen, Gemma and Phi families reach 10-40% execution accuracy zero-shot, and at most 61% with reasoning and execution feedback. Fine-tuning raises them to 63-77%, and they lose at most 6 percentage points on a tissue unseen in training. Execution feedback repairs queries that fail to run, but rarely queries that run and return a wrong answer.

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.