TANGO: Traversability-Aware Navigation with Local Metric Control for Topological Goals