bioRxivBioinformaticsPreprint
Beyond alignment: synergistic integration is required for multimodal cell foundation models
Till RichteriD, Eric ZimmermanniD, James Hall, Fabian Joachim TheisiD, Srivatsan RaghavaniD, Peter S. WinteriD, Ava P. AminiiD, Lorin A. CrawfordiD
Abstract
The vision of a "virtual cell"--a computational model that simulates biological function across modalities and scales--has become a defining goal in computational biology. While powerful unimodal foundation models exist, the lack of large-scale paired data prohibits the joint training of multimodal approaches. This scarcity favors compositional foundation models (CFMs): architectures that fuse frozen unimodal experts via a learned interface. However, it remains unclear when this multimodal fusion adds task-relevant information beyond the strongest unimodal representation and when it merely aggregates redundant signal. Here, we introduce the Synergistic Information Score (SIS), a metric grounded in partial information decomposition (PID), that quantifies the information gain achievable only through cross-modal interactions. Extending theoretical results from self-supervised learning, we show that standard alignment-based fusion objectives on frozen encoders inherently collapse to detecting linear redundancies, limiting their ability to capture nonlinear synergistic states. This distinction is directly relevant for tasks aiming to link tissue morphology and gene expression. Benchmarking ten fusion methods on spatial transcriptomics datasets, we use SIS to demonstrate that tasks dominated by linear redundancies are sufficiently served by unimodal baselines, whereas complex niche definitions benefit from synergy-aware integration objectives that enable cross-modal interactions beyond linear alignment. Finally, we perform a scaling analysis which highlights that fine-tuning a dominant unimodal expert is the most sample-efficient path for standard tasks, suggesting that the benefits of multimodal frameworks only emerge when tasks depend on information distributed across modalities. Together, these results establish that building towards a virtual cell will require a fundamental shift from alignment objectives that emphasize shared structure to synergy-maximizing integration that preserves and exploits complementary cross-modal signal.
- assay: spatial transcriptomics
- research focus: benchmarking
- research focus: dimensionality reduction
- approach: statistical model
- approach: benchmark study
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- CellOS: Learning a World Model of Cellular State through Joint Embedding Prediction
- Multimodal single cell data integration challenge: results and lessons learned
Christopher Lance, Malte D. Luecken, … Fabian Joachim Theis·bioRxiv·Apr 11, 2022
- Liam tackles complex multimodal single-cell data integration challenges
Pia Rautenstrauch, Uwe Ohler·Nucleic Acids ResearchPeer-reviewed·May 17, 2024
- Multi-task learning for single-cell multi-modality biology
Xin Tang, Jiawei Zhang, … Jia Liu B·bioRxiv·Jun 3, 2022
- scMomer: A modality-aware pretraining framework for single-cell multi-omics modeling under missing modality conditions
Yuhang Liu, Quan Zou, … Leyi Wei·bioRxiv·Aug 4, 2025
- Cycle-consistent deep generative modeling unifies cellular states across unpaired spatial and single-cell modalities
H Zhang, Jeffrey F. Quinn, … Wesley Tansey·bioRxiv·May 26, 2026