Autonomous Navigation with Convergence Guarantees in Complex Dynamic Environments