r/MachineLearning - [P] Visualisation of a GAN learning to generate a circle

White means real and Black means fake. Note that all of the code was written by hand (no ML frameworks used) so there might be some bugs, I especially doubt my GAN implementation (the neural network layers are well tested though). EDIT: I tried using pure SGD (no momentum) with a carefuly picked lr and some lr decay, but it always end up exploding.. https://gfycat.com/SeveralUnfinishedBuck EDIT2: If the lr is too high you see what happens above, and if the lr is too low it converges very slowly but the discriminator still has a lot of work to do.