Sign in
NeuroscienceNature Communications
Peer-reviewed journal article

Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks

Hojin JangiD, Frank TongiD

Abstract

Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide novel neurocomputational evidence that blurry visual experiences are very important for conferring robustness to biological visual systems.

PDFDOI

02 /Specification & Classification

Click any tag to browse matching papers
Citations
51
FWCI
12.39
Field percentile
top 1%

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISYoshihara '22Jang '21Entezari '19Muratore '25Malhotra '22Kong '22
88% semantic matchNeuroscience
Sou Yoshihara, Taiki Fukiage, Shin’ya Nishida·bioRxiv·Jun 13, 2022· 2 citations