Accelerating Sparse Convolution with Column Vector-Wise Sparsity