Guiding Time-Varying Generative Models with Natural Gradients on Exponential Family Manifold