NeurosciencebioRxivPreprint
Learning to live with Dale's principle: ANNs with separate excitatory and inhibitory units
Jonathan H. Cornford, Damjan Kalajdzievski, Marco Leite…·Blake A. Richards
Splitting network units into excitatory and inhibitory populations need not cost learning: initialize inhibition to centre and standardize excitatory activity, and scale inhibitory updates by Fisher information.
43 citations