Seeing through Uncertainty: Robust Task-Oriented Optimization in Visual Navigation