A comprehensive benchmark of publicly available image foundation models for their usability to predict gene expression from whole slide images
Abstract
Recent advances in large-scale self-supervised learning have led to the emergence of foundation models capable of extracting transferable visual representations from high-dimensional image data. In computational pathology, such models are increasingly used as feature encoders for molecular prediction tasks. However, systematic benchmarking of publicly available image foundation models for transcriptomic prediction from whole-slide images (WSIs) remains limited. Here, we perform a comprehensive evaluation of five state-of-the-art vision foundation models-DINOv2, Phikon, UNI, H-Optimus-0, and MedSigLIP-for gene expression prediction using the TCGA-BRCA cohort. Tile embeddings extracted from each model were aggregated via attention-based multiple instance learning (MIL), followed by multi-target regression to predict RNA-seq expression profiles. Performance was assessed using gene-level Spearman correlation across samples. Histopathology-specific foundation models consistently outperformed general-purpose encoders, with Phikon achieving the strongest overall performance, followed by UNI and H-Optimus-0. These findings demonstrate that domain-aligned pretraining substantially enhances morphology-to-transcriptome inference and provide a principled benchmark for foundation model selection in molecular pathology.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A foundation model for generalizable cancer diagnosis and survival prediction from histopathological images
Zhaochang Yang, Ting Wei, … Zhangsheng Yu·Nature CommunicationsPeer-reviewed·Mar 10, 2025
- GenBio-PathFM: A State-of-the-Art Foundation Model for Histopathology
Saarthak Kapse, Mehmet Aygün, … Eric P. Xing·bioRxiv·Mar 20, 2026
- Translating Histopathology Foundation Model Embeddings into Cellular and Molecular Features for Clinical Studies
Saishi Cui, Zhining Sui, … Wei Sun·bioRxiv·Mar 23, 2026
- Inferring spatial gene expression from tissue images using large-scale histology foundation model with SpaFoundation
Ning Zhang, Yahui Long, … Min Li·bioRxiv·Aug 7, 2025
- Transformer with Convolution and Graph-Node co-embedding: An accurate and interpretable vision backbone for predicting gene expressions from local histopathological image
Xiao Xiao, Yan Kong, … Hui Juan Lu·Medical Image AnalysisPeer-reviewed·Nov 20, 2023
- Adaptive Integration of Heterogeneous Foundation Models to Find Histologically Predictable Genes in Breast Cancer
Hao N. Nguyen, Chaoyi Li, … Quan Hoang Nguyen·bioRxiv·Apr 8, 2026