Visual Memory for Robust Path Following