Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets-Supplementary Materials

In the input encoder layer, i.e. the 1st layer, all the tokens focus on themselves and the head tokens. And in the early stage, i.e. from the 2nd to 6th layers, all the tokens focus more on themselves and do