Emergent Neuronal Mechanisms Mediating Covert Attention in Convolutional Neural Networks

Abstract

Covert visual attention allows the brain to select different regions of the visual world without eye movements. Predictive cues of a target location orient covert attention and improve perceptual performance. In most computational models, researchers explicitly incorporate an attentional mechanism that alters processing at the attended location (gain, noise reduction, divisive normalization, biased competition, Bayesian priors). Here, we assess the emergent neuronal mechanisms of Convolutional Neural Networks (CNNs) that exhibit behavioral signatures of covert attention, despite lacking a built-in attention mechanism. We use neuroscience-inspired approaches to analyze 1.8M units of CNNs trained on the cueing paradigm. Consistent with neurophysiology, we show early layers with retinotopic neurons separately tuned to the target or cue, and later layers with neurons with joint tuning and increased cue influence on target responses. CNN computational stages mirror a Bayesian ideal observer (BIO), but with more gradual transitions. The cue influences the target sensitivity through four mechanisms. A BIO-like cue-weighted location summation, and three mechanisms absent in the BIO: an opponency across locations, a summation/opponency location combination, and interaction with the thresholding Rectified Linear Unit (ReLU). Re-analyses of mices superior colliculus neuronal activity during a cueing task show CNN-predicted but previously unreported cue-inhibitory, location- summation, and location-opponent cells in addition to the commonly reported cue (attention) excitatory cells. The novel single-unit CNN analysis approach establishes a likely system-wide characterization mediating covert attention and a framework to identify new neuron types and emergent computational mechanisms contributing to perceptual behavior. Significance StatementCues predictive of a target location orient covert attention and improve perceptual performance. Studies have focused on how attention influences neural activity, but how cues activate attention and how entire neuronal populations result in behavioral signatures of attention is not understood. Using neuroscience-inspired approaches to characterize properties of 1.8M CNN neurons, we predict new neuron types and emergent mechanisms. A re-analysis of mices superior colliculus activity shows new neuron types predicted by the CNN. The findings might explain how organisms, from primates and crows to insects, show behavioral signatures of covert attention using a variety of cue-target-location neuronal properties. The new CNN single-neuron analysis can guide neurophysiological studies to identify potential new neuron types and their computational contributions to perception.