So-ViT: Mind Visual Tokens for Vision Transformer