vq-draw
VQ-DRAW: A Sequential Discrete VAE
VQ-DRAW leverages a vector quantization effect to adapt the sequential generation scheme of DRAW [1] to discrete latent variables. I show that VQ-DRAW can effectively learn to compress images from a variety of common datasets, as well as generate realistic samples from these datasets with no help from an autoregressive prior.