Static2Dynamic: Reconstructing videos of unobservable cellular, developmental, and disease processes
Thomas BoyeriD, Elaine Del NeryiD, Nathalie SpasskyiD, Auguste GenovesioiD
Abstract
A fundamental limitation in biology is that many of its most important processes unfold as visual dynamics that cannot be directly observed. Development, tissue remodeling, and disease progression often occur deep in living organisms, over extended timescales, and at cellular resolution beyond the reach of current live imaging technologies. As a result, much of biology remains accessible only through static snapshots, while the underlying phenotypic trajectories and visual transformations remain hidden. Here, we introduce Static2Dynamic, a general framework to reconstruct unseen biological dynamics from sets of cross-sectional image data. Starting from time-unpaired static samples, Static2Dynamic first recovers a continuous pseudotime for individual images in a time-discriminative deep representation space, then learns a generative model of images conditionally to the underlying process, and finally reconstructs temporally coherent videos initialized from real samples. This makes it possible to infer past and future visual states of a static image and to simulate complete trajectories of cellular, developmental, and disease processes that were never directly recorded. We quantitatively validate Static2Dynamic on two large-scale experimental microscopy video datasets generated specifically for benchmarking, enabling direct comparison of inferred pseudotime trajectories and reconstructed videos against ground-truth biological dynamics. We further show that the framework generalizes across biological scales, organisms, and imaging modalities, including processes inaccessible to continuous live observation. More broadly, Static2Dynamic establishes the foundations of pseudotime microscopy, a new paradigm for reconstructing the visual and temporal dynamics of biological processes directly from static imaging data, thereby expanding the observable space of living systems beyond current experimental limits.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Visualizing and quantifying data from timelapse imaging experiments
E. K. Mahlandt, J. Goedhart·bioRxiv·Feb 24, 2021
- Real-Time Multi-Angle Projection Imaging of Biological Dynamics
B.-J. Chang, E. Sapoznik, … R. P. Fiolka·bioRxiv·Oct 29, 2020
- Neural space-time model for dynamic scene recovery in multi-shot computational imaging systems
R. Cao, N. S. Divekar, … L. Waller·bioRxiv·Jan 16, 2024
- But, what are the cells doing? Image Analysis pipeline to follow single cells in the zebrafish embryo
Arianne Bercowsky-Rama, Olivier F. Venzin, … Andrew C. Oates·bioRxiv·Jun 1, 2023
- Observing the Cell in Its Native State: Imaging Subcellular Dynamics in Multicellular Organisms
Tsung-Li Liu, Srigokul Upadhyayula, … Eric Betzig·bioRxiv·Jan 9, 2018
- Unsupervised temporal consistency improvement for microscopy video segmentation with Siamese networks
Akhmedkhan Shabanov, Daja Schichler, … Anna Kreshuk·bioRxiv·Mar 25, 2021