Goto

Collaborating Authors

 Asia




Q-ViT: AccurateandFully QuantizedLow-bitVision Transformer

Neural Information Processing Systems

Wethen develop an information rectification module (IRM) and a distribution guided distillation (DGD) scheme for fully quantized vision transformers (Q-ViT) to effectively eliminate such distortion, leading to a fully quantized ViTs.







de7858e3e7f9f0f7b2c7bfdc86f6d928-Supplemental-Conference.pdf

Neural Information Processing Systems

Inourexperiments, we visualize images for the mini-ImageNet dataset, and thus we utilize the image generator from the work [10] asG, which is pre-trained on ImageNet, and we pre-trainf on the mini-ImageNet dataset.