One-4-All: Neural Potential Fields for Embodied Navigation