[R] Variational Approaches for Auto-Encoding Generative Adversarial Networks • r/MachineLearning

I just want to emphasise for any readers that the density ratio approximation is tight only when the discriminator is optimal. Given that they update the discriminator even less than the generator they are essentially optimising a quite loose approximation to a likely loose bound on the data log likelihood.