Accelerating Augmentation Invariance Pretraining Jinhong Lin Cheng-En Wu

Neural Information Processing Systems 

In ImageNet, our method achieves speedups of 4 in MoCo, 3.3 in SimCLR, and 2.5 in DINO, demonstrating substantial efficiency gains.