Foundations of Sequence-to-Sequence Modeling for Time Series