bioRxivBiochemistryPreprint
A multi-modal image fusion workflow incorporating MALDI imaging mass spectrometry and microscopy for the study of small pharmaceutical compounds
Zhongling Liang, Yingchan Guo, Abhisheak SharmaiD, Christopher R. McCurdyiD, Boone M. PrenticeiD
Abstract
Multi-modal imaging analyses of dosed tissue samples can provide more comprehensive insight into the effects of a therapeutically active compound on a target tissue compared to single-modal imaging. For example, simultaneous spatial mapping of pharmaceutical compounds and endogenous macromolecule receptors is difficult to achieve in a single imaging experiment. Herein, we present a multi-modal workflow combining imaging mass spectrometry with immunohistochemistry (IHC) fluorescence imaging and brightfield microscopy imaging. Imaging mass spectrometry enables direct mapping of pharmaceutical compounds and metabolites, IHC fluorescence imaging can visualize large proteins, and brightfield microscopy imaging provides tissue morphology information. Single-cell resolution images are generally difficult to acquire using imaging mass spectrometry, but are readily acquired with IHC fluorescence and brightfield microscopy imaging. Spatial sharpening of mass spectrometry images would thus allow for higher fidelity co-registration with higher resolution microscopy images. Imaging mass spectrometry spatial resolution can be predicted to a finer value via a computational image fusion workflow, which models the relationship between the intensity values in the mass spectrometry image and the features of a high spatial resolution microscopy image. As a proof of concept, our multi-modal workflow was applied to brain tissue extracted from a Sprague Dawley rat dosed with a kratom alkaloid, corynantheidine. Four candidate mathematical models including linear regression, partial least squares regression (PLS), random forest regression, and two-dimensional convolutional neural network (2-D CNN), were tested. The random forest and 2-D CNN models most accurately predicted the intensity values at each pixel as well as the overall patterns of the mass spectrometry images, while also providing the best spatial resolution enhancements. Herein, image fusion enabled predicted mass spectrometry images of corynantheidine, GABA, and glutamine to approximately 2.5 m spatial resolutions, a significant improvement compared to the original images acquired at 25 m spatial resolution. The predicted mass spectrometry images were then co-registered with an H&E image and IHC fluorescence image of the - opioid receptor to assess co-localization of corynantheidine with brain cells. Our study also provides insight into the different evaluation parameters to consider when utilizing image fusion for biological applications.
- organism: rat
- assay: imaging
- assay: fluorescence / live-cell microscopy
- assay: spatial transcriptomics
- research focus: spatial domain detection
- approach: deep learning
- approach: statistical model
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Iterative Spatial Resolution Enhancement in Imaging Mass Spectrometry via Hydrogel Tissue Expansion and Multimodal Image Fusion
Elijah D Mayo, Jacob M Samuel, … Boone M. Prentice·bioRxiv·Jun 8, 2026
- Predicting High-Resolution Spatial and Spectral Features in Mass Spectrometry Imaging with Machine Learning and Multimodal Data Fusion
Md Inzamam Ul Haque, Ramakrishnan Kannan, … Debangshu Mukherjee·Advanced Intelligent DiscoveryPeer-reviewed·Jun 18, 2025
- High Spatial Resolution Ambient Ionization Mass Spectrometry Imaging Using Microscopy Image Fusion Determines Tumor Margins
Li‐En Lin, Chih‐Lin Chen, … Cheng‐Chih Hsu·Analytica Chimica ActaPeer-reviewed·Nov 13, 2019
- RaMALDI: enabling simultaneous Raman and MALDI imaging of the same tissue section
- Multimodal Imaging of the Cellular and Extracellular Microenvironment on the Same Formalin-Fixed Paraffin-Embedded Tissue Section
Jade K. Macdonald, Thai H. Pham, … Jeffrey M. Spraggins·bioRxiv·Aug 24, 2026
- In tissue spatial single-cell metabolomics by coupling mass spectrometry imaging and immunofluorescences
Landry Blanc, Florent Grélard, … Nicolas Desbenoît·bioRxiv·Mar 22, 2024