Exploring Complex Dynamical Systems via Nonconvex Optimization