A Preliminaries

A.1 Preliminaries on Comparison of Exploration Space The size of exploration space for the layer-wise manner in SET algorithm is: null N When the corresponding exploration region of each group is defined as in Section 3.4, the exploration EEG2 datasets are shown in Figure 9, Figure 10 and Figure 11, respectively. The eNRF sizes shown in a sub-figure are from the first dynamic sparse CNN layer with a specific sparsity ratio (e.g. Figure 10: The statistics of eNRF sizes for the Daily Sport dataset.The eNRF sizes shown in a S = 50% (left), S = 70% (middle), and S = 90% (right)). Figure 11: The statistics of eNRF sizes for the EEG2 dataset.The eNRF sizes shown in a sub-figure To demonstrate the advantage of various eNRF coverage, we compare the performances in terms of test accuracy between DSN models with various eNRF coverage and optimal NRF. However, when the kernel size is oversized (e.g. As discussed in 4.5 and B.1, grouping the kernels in each dynamic sparse CNN layer The corresponding exploration regions for each group are shown in the red boxes.