Physics-Inspired Neural Graph ODE for Long-term Dynamical Simulation