Self-Supervised AI Reveals a Hidden Landscape of Prognostic Spatial Patterns in Multiplex Immunofluorescence Images
Lucas FarndaleiD, Kai RakoviciD, Ian R. PowleyiD, Phimmada HatthakarnkuliD, Farzaneh Alsadat Seyedshahi, Sona JesenakovaiD, Leonor Patricia Schubert Santana, Silvia MartinelliiD, Fiona BallantyneiD, Leah Officer-JonesiD, David Moore, Claire WilsoniD, Noori MakaiD, Campbell S.D. RoxburghiD, Crispin J. MilleriD, David Kuang-Fu ChangiD, Joanne EdwardsiD, Edward W. RobertsiD, John P. C. Le QuesneiD, Ke YuaniD, Marco SerenoiD
Abstract
Modern spatial proteomic methods, such as multiplex immunofluorescence (mIF) imaging, offer a data-rich view of spatial biology in intact tissues. However, interpreting its complexity is a major bottleneck, limiting its potential for biological discovery and clinical translation. Current computational methods often rely on segmentation-based approaches that discard crucial morphological information and are limited to testing pre-defined hypotheses. Here, we introduce a self-supervised learning (SSL) framework that enables hypothesis-agnostic, context-aware discovery of biomarkers directly from mIF images. Our approach extracts rich feature representations that capture holistic architectural patterns, which integrate cellular morphology, marker interactions, and microenvironmental context without human supervision. Applying this framework to over 7,000 mIF tissue images from over 1,800 patients in two distinct cancer types, we demonstrate superior prognostic performance over conventional segmentation analyses. The method autonomously identified previously unknown and potentially clinically actionable biological patterns. In lung adenocarcinoma, these include a Ki67-mediated immune evasion phenotype, a subcellular pattern of GLB1 expression which aligns with low-grade EGFR-driven tumours, and distinct modes of tumour-immune interaction in PD-L1+ patients. We also find a regulatory T-cell-mediated immunosupressive environment promoting tumour budding in colorectal carcinoma. Our work establishes SSL as a powerful, scalable, and unbiased platform to decode tissue ecosystems while being fully explainable without pre-defined hypotheses. This paradigm shift transforms high-plex imaging from a hypothesis-testing tool into a hypothesis-generating engine that can accelerate the discovery of next-generation spatial biomarkers.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 1
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Self-supervised learning enables unbiased patient characterization from multiplexed cancer tissue microscopy images
Gantugs Atarsaikhan, Isabel Mogollón, … Lassi Paavolainen·bioRxiv·Mar 5, 2025
- BASSL-MI: Batch-Agnostic Self-Supervised Learning Uncovers Clinically Relevant Tumor Niches in Multiplexed Imaging
Alexander Lin, Shunxing Bao, … Siyuan Ma·IEEE International Symposium on Biomedical Imaging (ISBI)Peer-reviewed·Apr 8, 2026
- Spatial Immunophenotyping from Whole-Slide Multiplexed Tissue Imaging Using Convolutional Neural Networks
Mohammad Yosofvand, Sharon N. Edmiston, … Ronglai Shen·bioRxiv·Aug 16, 2024
- Pan-cancer estimation of prognostic immune biomarkers from histopathology using artificial intelligence
Yijun Li, Abdul Rahman Diab, … William E. Lotter·bioRxiv·Oct 13, 2026
- Spatial Clustering Analysis with Spectral Imaging-based Single-Step Multiplex Immunofluorescence (SISS-mIF) for Assisting Histological Diagnosis
Tomohiko Nakamura, Noe Kaneko, … Kazuhiro Nakagawa·bioRxiv·Jun 17, 2024
- ImmuNet: A Segmentation-Free Machine Learning Pipeline for Immune Landscape Phenotyping in Tumors by Muliplex Imaging
S. Sultan, M. A. J. Gorris, … J. Textor·bioRxiv·Oct 22, 2021