Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm

Open in new window