We sincerely thank the anonymous reviewers for their supports and constructive comments

We sincerely thank the anonymous reviewers for their supports and constructive comments. Q1: Compare with vanilla ANN with dropout. The knowledge from CNN will help ANN to find the correct optimization direction. The experimental results on CIFAR-10 are shown in Table 1 column 2 and 4. Q2: Does PKKD change the inference process? We will further emphasize this in the final version.