Channel Permutations for N: M Sparsity