Making Vision Transformers Efficient from A Token Sparsification View