Sparse Training via Boosting Pruning Plasticity with Neuroregeneration

Perhaps most impressively, its sparse-to-sparse version for the first time boosts the sparse-to-sparse training performance over various dense-to-sparse methods with ResNet-50 on ImageNet without extending the training time.