Solving Continuous Mean Field Games: Deep Reinforcement Learning for Non-Stationary Dynamics