Preferred visual experiences provide intuitive descriptions of the functional properties of the cortical navigation network

Abstract

Complex, high-dimensional brain representations are often difficult to understand intuitively. Recent advances in generative neural networks have made it possible to predict the optimal stimulus that maximizes the activity in a specific brain region. Because these stimuli are in image space, they provide an intuitive understanding of the functional properties of that region. Previous work on optimized stimuli has focused on passive perceptual tasks. Yet real-world perception operates in a closed loop with cognition and action, and so passive stimuli are unlikely to be optimal for many brain regions. In a previous study, we used fMRI to record BOLD activity from participants actively navigating through a virtual world. We identified a network of 11 cortical regions that support active navigation and are tuned for complex feature combinations. Here, we used a variational autoencoder to generate video clips predicted to correspond to maximal activity in each region. These preferred visual experiences capture dynamic scenes that incorporate both world events and participant actions. These preferred visual experiences provide intuitive descriptions of the functional properties of each region, and suggest that these regions are more engaged during dynamic than static scenes. These patterns also generate novel, data-driven hypotheses for future study.