Dynamic Electrode-to-Image (DETI) Mapping Reveals the Human Brain's Spatiotemporal Code of Visual Information

Abstract

A chief goal of systems neuroscience is to understand how the brain encodes information in our visual environments. Understanding that neural code is crucial to explaining how visual content is transformed via subsequent semantic representations to enable intelligent behavior. Although the visual code is not static, this reality is often obscured in voxel-wise encoding models of BOLD signals due to fMRIs poor temporal resolution. We leveraged the high temporal resolution of EEG to develop an encoding technique based in state-space theory. This approach maps neural signals to each pixel within a given image and reveals location-specific transformations of the visual code, providing a spatiotemporal signature for the image at each electrode. This technique offers a spatiotemporal visualization of the evolution of the neural code of visual information thought impossible to obtain from EEG and promises to provide insight into how visual meaning is developed through dynamic feedforward and recurrent processes.