bioRxivGenomicsPreprint
Bio-BLIP: A Multimodal Architecture for Transferable Reasoning in Genomic Variant Interpretation
Anvita GuptaiD, Alejandro BuendiaiD, Anshul Bharat KundajeiD, Jure LeskoveciD
Abstract
Developing scientific hypotheses in biology requires integrating heterogeneous evidence across DNA sequence, gene context, protein function, and prior literature. Existing multimodal AI systems expose biological evidence to reasoning models through textification or by projecting biological embeddings into fine-tuned language models. However, these models are typically highly optimized the specific set of tasks for which they are fine-tuned. Here we present Bio-BLIP, a multimodal Q-former based architecture which leverages biological embeddings and a LLM to generalize to complex reasoning tasks without task-specific fine-tuning. The key to Bio-BLIP is a new neural network architecture that integrates four data modalities - DNA, genes, proteins, and text - through a master Qformer model, which integrates the modality-specific information into a fixed-length prefix for the LLM backbone. Bio-BLIP is pretrained on the task of human genetic variant annotation and achieves a 29.8% increase in generating accurate variant features over frontier LLMs. We evaluate Bio-BLIP zero-shot on downstream genomic tasks of variant prioritization and target gene prediction. Bio-BLIP outperforms two alignment-free genomic language models on regulatory variant prioritization for Mendelian disease. Across the target gene prediction task, Bio-BLIP improves accuracy over LLMs by leveraging learned genomic variant knowledge in difficult cases. Our model produces rich, transparent reasoning traces. In biological domains characterized by multiple scales of data and varied downstream tasks, Bio-BLIP offers a step toward natively multimodal, generalizable reasoning.
- organism: human
- assay: DNA methylation
- assay: proteomics
- assay: protein sequence
- assay: GWAS summary statistics
- research focus: variant effect prediction
- research focus: gene regulatory network inference
- approach: deep learning
- approach: transformer / foundation model
- approach: large language model
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- OmniGene-4: A Unified Bio-Language MoE Model with Router-Level Interpretability
Liang Wang·bioRxiv·Jun 4, 2026
- BioToken and BioFM - Biologically-Informed Tokenization Enables Accurate and Efficient Genomic Foundation Models
Александр Владимирович Медведев, Karthik Viswanathan, … Shadab Khan·bioRxiv·Mar 27, 2025
- Out-of-the-box bioinformatics capabilities of large language models (LLMs)
Varsha Rajesh, Maceo Blumberg, … Geoffrey Siwo·BioinformaticsPeer-reviewed·Oct 29, 2026
- MARRVEL-MCP enables natural language variant interpretation through autonomous workflow construction
Zachary Joseph Everton, Jorge Botas, … Hyun-Hwan Jeong·The American Journal of Human GeneticsPeer-reviewed·May 21, 2026
- Genolator: A Multimodal Large Language Model Fusing Natural Language, Genomic, and Structural Tokens for Protein Function Interpretation
Martin Danner, Tanhim Islam, … Jeremias Krause·bioRxiv·Nov 14, 2025
- An Empirical Analysis of Fine-Tuning Large Language Models on Bioinformatics Literature: PRSGPT and BioStarsGPT
Muhammad Muneeb, David Benjamin Ascher·bioRxiv·Dec 30, 2025