DeSparsify: Adversarial Attack Against Token Sparsification Mechanisms

Vision transformers have contributed greatly to advancements in the computer vision domain, demonstrating state-of-the-art performance in diverse tasks ( e.g.,