Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
Abstract
Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide novel neurocomputational evidence that blurry visual experiences are very important for conferring robustness to biological visual systems.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 51
- FWCI
- 12.39
- Field percentile
- top 1%
- Organism
- Assay
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Do training with blurred images make convolutional neural networks closer to humans concerning object recognition performance and internal representations?
Sou Yoshihara, Taiki Fukiage, Shin’ya Nishida·bioRxiv·Jun 13, 2022
- Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
Hojin Jang, Frank Tong·Journal of VisionPeer-reviewed·Nov 12, 2021
- Artiphysiology reveals visual preferences underlying V4-like blur selectivity in a deep convolutional neural network
Saba Entezari, Wyeth Bair·bioRxiv·Dec 24, 2019
- Unraveling the complexity of rat object vision requires a full convolutional network - and beyond
Paolo Muratore, Alireza Alemi, Davide Zoccolan·PatternsPeer-reviewed·Jan 18, 2025
- Feature blindness: a challenge for understanding and modelling visual object recognition
Gaurav Malhotra, Marin Dujmović, Jeffrey S. Bowers·PLoS Computational BiologyPeer-reviewed·May 13, 2022
- Increasing neural network robustness improves match to macaque V1 eigenspectrum, spatial frequency preference and predictivity
Nathan C. L. Kong, Eshed Margalit, … Anthony M. Norcia·PLoS Computational BiologyPeer-reviewed·Jan 7, 2022