We observe that MAE can outperform supervised pre-training by large margins.

As aresult, there is aproliferation of distinct architectures and loss functions for different vision tasks.

UOTA adaptively searches for the most important sampling region to produce views, and provides viable choice for outlier-robust self-supervised learning approaches.

Somelaterapproaches [40, 28, 23, 22, 38, 43] try to explicitly model this relationship in a learnable fashion.

A.1 NASSearchSpaces NASBench-1011 introduces a large and expressive search space with 423k unique convolutional neural architectures and training statistics on CIFAR-10. NASBench-2012 contains the training statistics of15,625 architectures across three different datasets, including CIFAR-10, CIFAR-100, and Tiny-ImageNet-16. NASBench-NLP5 [10] is an NLP neural architecture search space, including 14k recurrent cells trained on the Penn Treebank (PTB)[11]dataset. Thegenerated noise maps aredirectly multiplied bythelevelwhich canbeselected from 0 to 1 with a step of 0.1. Other settings are already described in Section 3.1.2.

It explores two essential properties, namelydataset-level uniqueness and transformation equivariance, of the relation between queries and instances.

Semi-supervised learning aims to leverage alarge amount of unlabeled data for performance boosting. Existing works primarily focus on image classification. Inthispaper,wedelveintosemi-supervised learning forobject detection, where labeled data are more labor-intensive to collect.

NAS-based methods (e.g., Auto-NL [3], OFA [1]) and GhostNetV2 actually focus on different aspects of designing architectures. WhileGhostNetV2focuses on how to design a hardware-friendly attention mechanism, which doesn't optimize the network architecture and training recipe. Feature pyramid networks for object detection.

The performance of object detectors has been considerably improved by various designs ofarchitecture, lossfunctionetc.

Weintroduce verification tasksintothelocalization prediction ofRepPoints, producing RepPoints v2,whichprovidesconsistent improvements of about 2.0 mAP over the original RepPoints on the COCO object detection benchmark using different backbones and training methods.