Appendix

For Neural transition, we trained a network with 1x1 1D-convolutions that inputs Φ(s) in the past to produce the latent tensor in the next time step; for instance, Ht+1 = 1DCNN(Φ(st),Φ(st 1)) when Tc = 2.