Why Spectral Normalization Stabilizes GANs: Analysis and Improvements

Motivated by newer initialization techniques [13, 17], we propose BSSN to further improve SN. In this paper, we show that SN controls two important failure modes of GAN training: exploding gradients and vanishing gradients.