Systematic evaluation of integration methods and parameters on single-cell RNA-sequencing biological insights: a case study on cattle embryos.
Abstract
BackgroundSingle-cell RNA sequencing (scRNA-seq) integration methods remove technical variation while preserving biological signal, yet systematic frameworks for evaluating how parameter choices influence biological interpretation remain limited. Traditional benchmarking approaches evaluate single-parameter configurations per method, potentially missing systematic patterns in functional outcomes and method convergence. A framework for systematic integration parameter evaluation was developed and applied to bovine embryo development. ResultsSix integration methods (FastMNN, CCA, RPCA, scVI, Harmony, STACAS) combined with multiple parameters, including those for neighbor identification and clustering, yielded 8232 combinations. The main outputs evaluated were specific cell counts and marker identification. After filtering for extremely poor cell and marker identification, 4,287 integration parameter combinations were retained for analysis. There were three major patterns (clusters) with integration methods distributed non-randomly across clusters and distinct biological outcomes. One pattern emerged, composed of scVI and STACAS integration, dominated by the lack of identification of epiblast cells. Cluster 2 (n=29), also composed of scVI and STACAS integration, identified the most epiblast markers (n=7, 8, or 9) but had a limited number of epiblast cells (median=10). Cluster 1 (n=4,120 combinations) had the highest method diversity. Across clusters, trophoblast and mesoderm showed high functional distinctness, while epiblast and hypoblast showed moderate overlap in gene ontology classes. ConclusionsThe approach reveals that parameter choices influence cell type classification, functional interpretation, and the degree of method convergence, with implications for identifying specific biological inferences for further orthogonal validation. A systematic approach to evaluating integration methods, along with other parameters, is advisable for accurate biological inference.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- FWCI
- 0.00
- Field percentile
- top 29%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Benchmarking deep learning methods for biologically conserved single-cell integration
Chenxin Yi, Jinyu Cheng, … Yixue Li·Genome biologyPeer-reviewed·Nov 20, 2025
- A Benchmark of Semi-Supervised scRNA-seq Integration Methods in Real-World Scenarios
Xiaoyu Shen, Chuan He, Leying Guan·bioRxiv·Aug 23, 2025
- A Systematic Evaluation of Single-Cell Batch Integration Metrics and sBEE, A New Metric
Mekan Myradov, Aissa Houdjedj, … Hilal Kazan·bioRxiv·Aug 9, 2026
- INSCT: Integrating millions of single cells using batch-aware triplet neural networks
Lukas Mikolaj Simon, Yin‐Ying Wang, Zhongming Zhao·Nature Machine IntelligencePeer-reviewed·Jun 21, 2021
- BATMAN: fast and accurate integration of single-cell RNA-Seq datasets via minimum-weight matching
Igor Mandric, Brian L. Hill, … Eran Halperin·iSciencePeer-reviewed·May 20, 2020
- An interpretable meta-clustering framework for single-cell RNA-Seq data integration and evaluation
Zhiyuan Hu, Ahmed A. Ahmed, Christopher Yau·Genome biologyPeer-reviewed·Dec 1, 2021