Sharpening of hierarchical visual feature representations of blurred images

Abstract

The robustness of the visual system lies in its ability to perceive degraded images. This is achieved through interacting bottom-up and top-down pathways that process the visual input in concordance with stored prior information. The interaction mechanism by which they integrate visual input and prior information is still enigmatic. We present a new approach using deep neural network (DNN) representation to reveal the effects of such integration on degraded visual inputs. We transformed measured human brain activity resulting from viewing blurred images to the hierarchical representation space derived from a feedforward DNN. Transformed representations were found to veer towards the original non-blurred image and away from the blurred stimulus image. This indicated deblurring or sharpening in the neural representation, and possibly in our perception, from top-down modulation. We anticipate these results will help unravel the interplay mechanism between bottom-up and top-down pathways, leading to more comprehensive models of vision.