A Appendix

Remark 4. The result of Theorem 2 also holds for unstable orbits Remark 5. F or RNNs with ReLU activation functions there are finite compartments in the phase Assume for the sake of contradiction that k W k 1 . There is a direct link between the norms of the Jacobians of the RNN along trajectories and the EVGP . Note that this system is non-autonomous, that is externally forced due to the r.h.s. of eqn. Rössler system Another prime textbook example for a chaotic system is the Rössler system [76] This strongly suggests that the dynamics governing the time series are chaotic. All datasets used were standardized (i.e., centered with unit variance) prior to training.