Label-free multiplex microscopic imaging by image-to-image translation overcoming the trade-off between pixel- and image-level similarity

Abstract

Establishment of multiplex microscopic imaging without labeling is indispensable for understanding complex interactions of subcellular components. Toward the establishment of label-free multiplex microscopic imaging, image-to-image translation models that extract images of multiple subcellular components from bright-field images via nonlinear processing have attracted attention. However, the performance of conventional models is limited by a trade-off relationship between pixel- and image-level similarity, which degrades imaging performance. Here, we developed an image-to-image Wasserstein Schrodinger Bridge model to achieve high-performance image-to-image translation at the pixel level using Schrodinger Bridge while minimizing Wasserstein distance at the image level. Our model dramatically outperformed the conventional models at both levels simultaneously, reducing the mean squared error by 410-fold and improving the structural similarity index measure by 17.1-fold. Label-free multiplex microscopic imaging based on our model paves a way for the analysis of the interactions of subcellular components.