Comparison of visual quantities in untrained deep neural networks

Abstract

The ability to compare quantities of visual objects with two distinct measures, proportion and difference, is observed in newborn animals. Nevertheless, how this function originates in the brain, even before training, remains unknown. Here, we show that neuronal tuning for quantity comparison can arise spontaneously in completely untrained deep neural networks. Using a biologically inspired model neural network, we found that units selective to proportions and differences between visual quantities emerge in randomly initialized networks and that they enable the network to perform quantity comparison tasks. Further analysis shows that two distinct tunings to proportion and difference both originate from a random summation of monotonic, nonlinear responses to changes in relative quantities. Notably, we found that a slight difference in the nonlinearity profile determines the type of measure. Our results suggest that visual quantity comparisons are primitive types of functions that can emerge spontaneously in random feedforward networks. One sentence summaryThe ability to compare visual quantities arises spontaneously in untrained deep neural networks. Research HighlightsO_LIThe ability to compare visual quantity arises spontaneously in untrained networks C_LIO_LIDistinct tunings to measure proportion and difference of quantities are observed C_LIO_LIRandom wiring of monotonic, nonlinear activity induces quantity-comparison units C_LIO_LIThe nonlinearity pattern of the source unit determines the type of target measure C_LI