bioRxivBioinformaticsPreprint
Beyond Visual Inspection: Principled Benchmarking of Single-Cell Trajectory Representations with scTRAM
Kemal İnecikiD, Antony RoseiD, Muzlifah A. HaniffaiD, Malte D. LueckeniD, Fabian Joachim TheisiD
Abstract
Single-cell representation learning aims to construct low-dimensional embeddings that preserve biologically salient manifold structures. Yet current evaluation protocols remain inadequate for assessing trajectory fidelity--essential for studying cell differentiation, immune responses, disease progression and perturbation--relying on heuristic visualizations or scalar surrogates that overlook multiscale trajectory geometry. To address this gap, we present scTRAM--single-cell trajectory representation metrics--a principled benchmarking framework that quantitatively evaluates how well single-cell embeddings retain groundtruth trajectories across complementary failure modes, from local neighborhood scrambling to global branch mis-ordering. Through our experiments, we show that scTRAM reveals modelspecific trade-offs in preserving distinct aspects of trajectory structure, with edge-specific decomposition exposing localized representational biases at high resolution. Systematic validation across diverse biological contexts confirms that the metric suite is sensitive to genuine structural properties rather than statistical artifacts. By shifting from qualitative, ad-hoc judgments to quantitative, principled approach, scTRAM enables rigorous comparison of embedding methods and informs downstream analyses where trajectory integrity is essential for biological interpretation.
- Citations
- 2
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Benchmarking zero-shot single-cell foundation model embeddings for cellular dynamics reconstruction
Xueya Zhou, Zihan Wang, … Peijie Zhou·bioRxiv·Mar 12, 2026
- Metric Mirages in Cell Embeddings
Hanchen Wang, Jure Leskovec, Aviv Regev·Nature BiotechnologyPeer-reviewed·Jun 11, 2025
- A comparison of single-cell trajectory inference methods: towards more accurate and robust tools
Wouter Saelens, Robrecht Cannoodt, … Yvan Saeys·Nature BiotechnologyPeer-reviewed·Apr 1, 2019
- The art of seeing the elephant in the room: 2D embeddings of single-cell data do make sense
Jan Lause, Dmitry Kobak, Philipp Berens·PLoS Computational BiologyPeer-reviewed·Oct 2, 2024
- scRepresenter: a workflow for computing, integrating and benchmarking cellular representations in single-cell transcriptomics
Guilherme Pocas, Muhammad Umar, … Muhammad Asif·bioRxiv·Jul 20, 2026
- scE2TM improves single-cell embedding interpretability and reveals cellular perturbation signatures
Hegang Chen, Yuyin Lu, … Yue Li·DOAJ (DOAJ: Directory of Open Access Journals)Peer-reviewed·Aug 17, 2026