Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training

We show that both techniques can be well incorporated into the sparse training algorithm to form a generic framework, which we dub SpFDE.