Uncovering the Origins of Instability in Dynamical Systems: How Attention Mechanism Can Help?