6 APPENDIX

According to Kolda and Bader [11], the definition of n-mode product is multiplying each mode-n fiber of tensorX by the matrixU. For simple notation, letW0 = Wi+1,N0 = Ni+1 and subscript i is omitted. Thex-axis represents the position of the layer in the model. For example, '1-1' indicates the first pruned layer in the first residual block. This level of cosine similarity might seem too low to be meaningful.