Reviews: Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Model

Neural Information Processing Systems 

A new energy-based generative model for images is proposed. The paper suggests to run Langevin dynamics in the data domain to create artificial samples, and updating the model parameters based on these synthesized images in an'analysis by synthesis' framework. The generative model allows for unconditional generation and interpolation. It is interesting that short-run MCMC can be used in this context despite not being converged. The effect of the hyperparameter K (number of MCMC steps) could have been more explored.