Towards Scalable and Structured Spatiotemporal Forecasting