[1610.09038] Professor Forcing: A New Algorithm for Training Recurrent Networks • /r/MachineLearning
First of all, the discriminator never contains an embedding and I think there is a general confusion about the terms GAN and adversarial training. The embedding is part of the generator in GANs, but adversarial training is more general than GANs. It only means that there are two neural networks that are trained to find a Nash equilibrium in a non-cooperative game. Whether G is a neural network that maps an embedding space to some target space is not specified. In professor forcing, G is simply an RNN that is trained to predict the next element in a sequence and D a discriminative bi-directional RNN.
Jan-29-2017, 08:55:04 GMT
- Technology: