1$\times$N Block Pattern for Network Sparsity