Raw-count embeddings improve single-cell foundation models
Sebastian Schlede, Thulasi Priyadharshini Muruganandam, Santhosh Gojjam Kantharaju, Ilmars Kisis, Maike Boecker, Mira Kim Alves Carpinteiro, Änne Schmitz, Laura M. Buchwald, Vignesh Sakthivelu, Gülce S. Gülcüler Balta, Max Anstötz, Maria Adele Rueger, Roman Kurt Thomas, Filippo Beleggia
This study benchmarks preprocessing strategies for single-cell transformer models and finds that simple log-transformed counts outperform complex methods, leading to a more efficient foundation model.
bioRxiv · Jul 3, 2026 · PreprintBioinformatics