Efficient and Effective Quantization for Sparse DNNs