Nephrobase Cell+: Multimodal Single-Cell Foundation Model for Decoding Kidney Biology
Chenyu LiiD, Elias Mark Ziyadeh, Yash SharmaiD, Bernhard DumouliniD, Jonathan L. LevinsohniD, Eunji HaiD, Siyu Pan, Vishwanatha Rao, Madhav Subramaniyam, Márió Szegedy, Nancy Ruonan ZhangiD, Katalin SusztákiD
Abstract
BackgroundLarge foundation models have revolutionized single-cell analysis, yet no kidney-specific model currently exists, and it remains unclear whether organ-focused models can outperform generalized models. The kidneys complex cellular architecture and dynamic microenvironments further complicate integration of large-scale single-cell and spatial omics data, where current frameworks trained on limited datasets struggle to correct batch effects, capture cross-modality variation, and generalize across species. MethodsWe developed Nephrobase Cell+, the first kidney-focused large foundation model, pretrained on ~100 billion tokens from ~39.5 million single-cell and single-nucleus profiles across 4,319 samples, four mammalian species (human, mouse, rat, pig), and multiple assay modalities (scRNA-seq, snRNA-seq, snATAC-seq, spatial transcriptomics). Nephrobase Cell+ uses a transformer-based encoder-decoder architecture with gene-token cross-attention and a mixture-of-experts module for scalable representation learning. ResultsNephrobase Cell+ sets a new benchmark for kidney single-cell analysis. It produces tightly clustered, biologically coherent embeddings in human and mouse kidneys, far surpassing previous foundation models such as Geneformer, scGPT, and UCE, as well as traditional methods such as PCA and autoencoders. It achieves the highest cluster concordance and batch-mixing scores, effectively removing donor/assay batch effects while preserving cell-type structure. Cross-species evaluation shows superior alignment of homologous cell types and >90% zero-shot annotation accuracy for major kidney lineages in both human and mouse. Even its 1B-parameter and 500M variants consistently outperform all existing models. ConclusionsWith organ-scale multimodal pretraining and a specialized transformer architecture, Nephrobase Cell+ delivers a unified, high-fidelity representation of kidney biology that is robust, cross-species transferable, and unmatched by current single-cell foundation models, offering a powerful resource for kidney genomics and disease research.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 4
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Large Scale Foundation Model on Single-cell Transcriptomics
Minsheng Hao, Jing Gong, … Le Song·Nature MethodsPeer-reviewed·Jun 6, 2024
- Evaluating the role of pre-training dataset size and diversity on single-cell foundation model performance
Alan DenAdel, Madeline Hughes, … Lorin A. Crawford·Nature MethodsPeer-reviewed·Jun 9, 2026
- Single-cell foundation models benefit from cross-modal training: adding proteomics data beats parameter scaling
Maximilien Burq, Peter Cimermančič, … Dejan Štepec·bioRxiv·Aug 19, 2026
- Fundamental Limitations of Foundation Models in Single-Cell Transcriptomics
Srijan Atti, Shankar Subramaniam·bioRxiv·Jun 26, 2025
- scConcept: Contrastive pretraining for technology-agnostic single-cell representations beyond reconstruction
Mojtaba Bahrami, Alejandro Tejada-Lapuerta, … Fabian Joachim Theis·bioRxiv·Oct 14, 2025
- CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells
Yuansong Zeng, Jiancong Xie, … Yuedong Yang·Nature CommunicationsPeer-reviewed·May 20, 2025