Wayne Wah Ming Soo

Training biologically plausible recurrent neural networks on cognitive tasks with long-term dependencies

This paper trains biologically plausible RNNs on cognitive tasks with long-term dependencies using specialized skip-connections, achieving faster training and better performance than conventional methods.

Training stochastic stabilized supralinear networks by dynamics-neutral growth

This paper trains a biologically realistic neural network model, the stabilized supralinear network, on challenging tasks using a dynamics-neutral growth method during training.