Reviews: Surround Modulation: A Bio-inspired Connectivity Structure for Convolutional Neural Networks

Neural Information Processing Systems 

This paper adds static linear surround modulation to deep convolutional networks. The authors show that this improves the speed and performance of the networks. They also show that it (but also batch normalization) increases sparsity of neural activity. The performance gains seem to be reduced on larger problems which limited projected significance and excitement in the paper. Limiting suppression to only identical features was also seen as limiting.