Analysis of Longitudinal Change Patterns in Developing Brain Using Functional and Structural Magnetic Resonance Imaging via Multimodal Fusion

Functional and structural magnetic resonance imaging (fMRI and sMRI) are complementary approaches that can be used to study longitudinal brain changes in adolescents. Each individual modality offers distinct insights into the brain. Each individual modality may overlook crucial aspects of brain analysis. By combining them, we can uncover hidden brain connections and gain a more comprehensive understanding. In previous work, we identified multivariate patterns of change in whole-brain function during adolescence. In this work, we focus on linking functional change patterns (FCPs) to brain structure. We introduce two approaches and applied them to data from the Adolescent Brain and Cognitive Development (ABCD) dataset. First, we evaluate voxelwise sMRI-FCP coupling to identify structural patterns linked to our previously identified FCPs. Our approach revealed multiple interesting patterns in functional network connectivity (FNC) and gray matter volume (GMV) data that were linked to subject level variation. FCP components 2 and 4 exhibit extensive associations between their loadings and voxel-wise GMV data. Secondly, we leveraged a symmetric multimodal fusion technique called multiset canonical correlation analysis (mCCA) + joint independent component analysis (jICA). Using this approach, we identify structured FCPs such as one showing increased connectivity between visual and sensorimotor domains and decreased connectivity between sensorimotor and cognitive control domains, linked to structural change patterns (SCPs) including alterations in the bilateral sensorimotor cortex. Interestingly, females exhibit stronger coupling between brain functional and structural changes than males, highlighting sex-related differences. The combined results from both asymmetric and symmetric multimodal fusion methods underscore the intricate sex-specific nuances in neural dynamics. By utilizing two complementary multimodal approaches, our study enhances our understanding of the dynamic nature of brain connectivity and structure during the adolescent period, shedding light on the nuanced processes underlying adolescent brain development.