SHEST: Single-cell-level artificial intelligence from haematoxylin and eosin morphology for cell type prediction and spatial transcriptomics reconstruction
Hoyeon JeongiD, Junghan OhiD, Donggeon LeeiD, Jae Hwan KangiD, Yoon‐La ChoiiD
Abstract
A comprehensive understanding of cancer progression requires integrating tissue morphol-ogy with spatial molecular profiles. We present SHEST, a multi-task profiling framework that leverages haematoxylin and eosin morphology to predict cellular composition and re-construct spatial gene expression at single-cell resolution. SHEST employs a quadruple-tile input capturing nuclear and contextual information, combined with a neighbourhood-informed clustering algorithm to filter ambiguous cellular signals. It comprises a shared morphological encoder with two task-specific heads: a classifier for cell type prediction and a reconstruc-tor for gene expression. Multi-task optimisation uses cross-entropy and zero-inflated negative binomial losses, specifically addressing the sparsity of spatial transcriptomic data. Evalua-tion on human lung adenocarcinoma datasets demonstrated high accuracy for the principal reciprocal constituents of the tumour-immune axis (F1: 0.97 for tumour cells and 0.91 for lym-phocytes). External validation confirmed its generalisability, revealing alveolar cells and their early neoplastic transitions. Reconstructed gene expression reproduced spatially resolved, cell-type-specific marker patterns--EPCAM in tumour cells, LTBP2 in fibroblasts, and CD3E in lymphocytes--recovering biologically coherent transcriptional architecture. SHEST also pre-served distance-dependent spatial relationships and gene-level autocorrelation, reflecting the multicellular niche structure of the tumour microenvironment. By unifying cell type iden-tification, gene expression reconstruction, and spatial mapping within a single interpretable framework, SHEST provides a synergistic and cost-efficient bridge between histopathology and spatial transcriptomics. This approach facilitates comprehensive tissue characterisation and forms a foundation for precision oncology through spatially informed, cell-level insights into tumour-immune ecosystems.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 2
- FWCI
- 2.05
- Field percentile
- top 19%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- SpatioCell: Deep Integration of Histology and Spatial Transcriptomics for Profiling the Cellular Microenvironment at Single-Cell Level
Naiqiao Hou, Yue Yu, … Jia Song·中国科学通报:英文版Peer-reviewed·Jun 3, 2026
- sCellST: a Multiple Instance Learning approach to predict single-cell gene expression from H&E images using spatial transcriptomics
Loïc Chadoutaud, Marvin Lerousseau, … Thomas Walter·bioRxiv·Nov 7, 2024
- STHELAR, a multi-tissue dataset linking spatial transcriptomics and histology for cell type annotation
Félicie Giraud-Sauveur, Quentin Blampey, … Stergios Christodoulidis·Scientific DataPeer-reviewed·Mar 12, 2026
- Mapping cell types in the tumor microenvironment from tissue images via deep learning trained by spatial transcriptomics of lung adenocarcinoma
- Predicting Spatial Transcriptomics from H&E Image by Pretrained Contrastive Alignment Learning
Jiawei Zou, Kai Xiao, … Luonan Chen·bioRxiv·Jun 15, 2025
- METI: Deep profiling of tumor ecosystems by integrating cell morphology and spatial transcriptomics