From Tasks to Topology: Dorsal and Ventral Streams Emerge in Optimized Neural Networks

Abstract

The primate visual system is organized into dorsal and ventral pathways, classically linked to visuomotor control and perception. A long-standing question is whether this division reflects intrinsic architectural priors or emerges from task demands. We trained a single convolutional network to perform classification and grasp prediction of 3D objects, without imposing modular structure. Dual-stream topology - functionally distinct visuomotor and perceptual pathways - emerged spontaneously with rich cross-communication. Shapley value analyses revealed that action- and perception-selective features developed progressively across depth, reflecting task-driven hierarchical specialization. Time-resolved EEG showed that model activity mapped onto dissociable temporal components in human cortex: ventral-aligned signals emerged early and late, where dorsal- and ventral-aligned responses coincided in the intervening interval. These results demonstrate that task optimization alone can explain core features of dorsal-ventral organization, and that distinct temporal roles for perception and action arise naturally atop a shared feedforward scaffold, without requiring architectural hard-coding or recurrence.