Learning better with Dale's Law: A Spectral Perspective
Pingsheng Li, Jonathan H. Cornford, Arna Ghosh, Blake Richards
This paper investigates how incorporating Dale's Law into recurrent neural networks affects learning, finding that spectral properties of the weight matrix are more critical than sign constraints for performance.
neural information processing systems · Jan 1, 2023Peer-reviewedNeuroscience