Identifying task-relevant spectral signatures of perceptual categorization in the human cortex

Abstract

Human brain has developed mechanisms to efficiently decode sensory information according to perceptual categories of high prevalence in the environment, such as faces, symbols, objects. Neural activity produced within localized brain networks has been associated with the process that integrates both sensory bottom-up and cognitive top-down information processing. Yet, how specifically the different types and components of neural responses reflect the local networks selectivity for categorical information processing is still unknown. By mimicking the decoding of the sensory information with machine learning we can obtain accurate artificial decoding models. Having the artificial system functionally on par with the biological one we can analyze the mechanics of the artificial system to gain insights into the inner workings of its biological counterpart. In this work we train a Random Forest classification model to decode eight perceptual categories from visual stimuli given a broad spectrum of human intracranial signals (4 - 150 Hz) obtained during a visual perception task, and analyze which of the spectral features the algorithm deemed relevant to the perceptual decoding. We show that network selectivity for a single or multiple categories in sensory and non-sensory cortices is related to specific patterns of power increases and decreases in both low (4 - 50 Hz) and high (50 - 150 Hz) frequency bands. We demonstrate that the locations and patterns of activity that are identified by the algorithm not only coincide with the known spectro-spatial signatures, but extend our knowledge by uncovering additional spectral signatures describing neural mechanisms of visual category perception in human brain.\n\nSignificance statementPrevious works have shown where and when perceptual category information can be decoded from the human brain, our study adds to that line of research by allowing to identify spectrotemporal patterns that contribute to category decoding without the need to formulate a priori hypothesis on which spectral components and at which times are worth investigating. Application of this method to an extensive dataset of human intracerebral recordings delineates the locations that are predictive of several perceptual categories from the locations that are have narrow specialization, identifies spectral signatures characteristic of each of 8 perceptual categories and allows to observe global and category-specific patterns of neural activity pertinent to functional perceptual categorization.