bioRxivBioinformaticsPreprint
Self-supervised learning for a gene program-centric view of cell states
Marie Moullet, Tomoya IsobeiD, Amirhossein VahidiiD, Carlo LeonardiiD, Licyel Paulas-CondoriiD, Christopher J. SoelistyoiD, Lloyd SteeleiD, Kevin Chi Hao LyiD, Mariana Quiroga LondoñoiD, Nicole MendeiD, Emily StephensoniD, Deena IskanderiD, Simone WebbiD, Issac GohiD, M. S. VijayabaskariD, Qi LiuiD, Daniyal J. JafreeiD, Hesam AsadollahzadehiD, Ciro Ramírez-SuásteguiiD, Arpit MerchantiD, Kenny RobertsiD, Benjamin M. RumneyiD, Hon Man Chan, Ash HollandiD, Martin PreteiD, , Mohammad LotfollahiiD
Abstract
Single-cell omics has extended the biological interrogation of cell state from examining the expression of individual genes to unbiased profiling of tens of thousands of genes at once. However, extracting biological insights from such high-dimensional data remains challenging. To enable downstream analyses, many computational approaches compress cell state into a single latent representation. This can obscure the structure of underlying gene programs (GP), defined as coordinated sets of biologically related genes, such as signalling pathway response modules or transcription factor targets. Here, we present Tripso, a self-supervised transformer deep learning model which learns multiple GP-specific embeddings from predefined GPs, while also enabling the discovery of novel, data-driven GPs. Tripso facilitates principled comparisons across development, disease, and experimental systems. Firstly, in a dataset of human hematopoietic cells spanning prenatal development through adulthood and aging and including newly generated data, Tripso resolved age-specific GP patterns, including elevated JAK-STAT activity in pediatric hematopoietic cells and postnatal shifts in IKZF1 GP activity during B cell differentiation. Secondly, leveraging Tripso GP embeddings and comparing in vivo to in vitro data, we hypothesized and experimentally validated that inhibition of the SEC61 translocon improved maintenance of hematopoietic stem cells in culture. Finally, Tripsos capacity for data-driven GP discovery revealed a previously uncharacterized tissue-resident memory T cell GP with increased activity in atopic dermatitis. Its spatial co-localization with sebaceous gland-associated immune niches was demonstrated in spatial transcriptomic and proteomic data. Thus, by moving beyond single embeddings of cellular states, Tripso enables interpretable and actionable discoveries, demonstrating how GP-centric modelling can generate hypotheses with substantial biomedical relevance. By anchoring cellular representations in meaningful GPs, Tripso establishes a principled and biologically grounded framework towards the development of interpretable virtual cell models.
- organism: human
- assay: scRNA-seq
- assay: spatial transcriptomics
- assay: proteomics
- research focus: gene regulatory network inference
- research focus: differential expression
- research focus: cell type annotation
- approach: deep learning
- approach: transformer / foundation model
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- SOMSC: Self-Organization-Map for High-Dimensional Single-Cell Data of Cellular States and Their Transitions
Tao Peng, Qing Hua Nie·bioRxiv·Apr 6, 2017
- Learning interpretable representations of single-cell multi-omics data with multi-output Gaussian Processes
Zahra Moslehi, Sareh AmeriFar, … Florian Buettner·Nucleic Acids ResearchPeer-reviewed·Jul 19, 2025
- SOMSC: Self-Organization-Map for High-Dimensional Single-Cell Data of Cellular States and Their Transitions
- scFormer: A Universal Representation Learning Approach for Single-Cell Data Using Transformers
Haotian Cui, Chloe Wang, … Bo Wang·bioRxiv·Nov 20, 2022
- scRep: A Latent-Space Self-Distilled Foundation Model for Single-Cell Representation Learning
Shengjie Wang, Zongyong Hu, … Qiuyi Li·bioRxiv·Sep 3, 2026
- Inferring virtual cell environments using multi-agent reinforcement learning
Noah Cohen Kalafut, Chenfeng He, … Daifeng Wang·bioRxiv·Nov 21, 2025