PDP: Parameter-free Differentiable Pruning is All You Need

Hence, a desirable pruning algorithm should achieve high accuracy and accelerate inference for various types of networks without significant training overheads in costs and complexity.