DominoSearch: Findlayer-wisefine-grainedN: M sparseschemesfromdenseneuralnetworks-SupplementaryMaterial

Results are shown inTable 3. Figure 1 and 2 illustrate the differences between 1:2 and 2:4 with the same dense weight matrix and sparsity (i.e. For every four elements, two will be removed based on the magnitude criterion. We first apply DominoSearch to search the layer-wise schemes from pre-trained dense models. For ResNet18/50 [4], the pre-trained models have been downloaded from Pytorch Model zoo1.