Object-zoomed training of convolutional neural networks inspired by toddler development improves shape bias
Niklas MülleriD, Cees G. M. SnoekiD, Iris I. A. GroeniD, H. Steven ScholteiD
Abstract
Convolutional Neural Networks (CNNs) surpass human-level performance on visual object recognition and detection, but their behavior still differs from human behavior in important ways. One prominent example is that CNNs trained on ImageNet exhibit an image texture bias, while humans exhibit a strong bias toward object shape. Although CNN shape bias can be increased in various ways, e.g., using data augmentation or additional training techniques, it remains unclear what causes the strong discrepancy between human and CNN object recognition strategies. Developmental research suggests that one factor driving human shape bias is that during early childhood, toddlers tend to fill their field-of-view with close-up objects. Here, we operationalize this close-up as a zoom-in on objects during CNN training which we show increases shape bias without any additional training or data augmentation. We provide further evidence for the advantage of closeup object vision by systematically manipulating the background-object ratio during CNN training, and demonstrate a strong (inverse) correlation with shape bias. Moreover, zooming-in on objects, thereby more closely emulating child vision, not only increases shape bias but also concurrently aligns classification accuracy and shape bias between humans and CNNs. Finally, we achieve a near human-like shape bias when using a developmentally-inspired background-object ratio for training and shape bias assessment. In sum, from a simple adjustment to common image datasets - zooming-in on objects - human-like shape bias can emerge. These results suggest that taking inspiration from human learning strategies is a promising avenue for building human-aligned, efficient, and more robust vision CNNs.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 1
- FWCI
- 2.86
- Field percentile
- top 7%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Feature blindness: a challenge for understanding and modelling visual object recognition
Gaurav Malhotra, Marin Dujmović, Jeffrey S. Bowers·PLoS Computational BiologyPeer-reviewed·May 13, 2022
- Do training with blurred images make convolutional neural networks closer to humans concerning object recognition performance and internal representations?
Sou Yoshihara, Taiki Fukiage, Shin’ya Nishida·bioRxiv·Jun 13, 2022
- Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
Hojin Jang, Frank Tong·Journal of VisionPeer-reviewed·Nov 12, 2021
- Human shape representations are not an emergent property of learning to classify objects
Gaurav Malhotra, Marin Dujmović, … Jeffrey S. Bowers·Journal of Experimental Psychology GeneralPeer-reviewed·Sep 11, 2023
- Teaching deep networks to see shape: Lessons from a simplified visual world.
Christian Jarvers, Heiko Neumann B·PLoS Computational BiologyPeer-reviewed·Nov 11, 2024
- Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
Hojin Jang, Frank Tong·Nature CommunicationsPeer-reviewed·Mar 5, 2024