Divert More Attention to Vision-Language Tracking