EfficientFormer: Vision Transformers at MobileNet Speed Y anyu Li

Then we introduce a dimension-consistent pure transformer (without MobileNet blocks) as a design paradigm. Finally, we perform latency-driven slimming to get a series of final models dubbed EfficientFormer.