Less Redundancy: Boosting Practicality of Vision Language Model in Walking Assistants