PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs

Neural Information Processing Systems 

The predictive learning of spatiotemporal sequences aims to generate future images by learning from the historical frames, where spatial appearances and temporal variations are two crucial structures.