2 Approach 2.1 ProblemFormulation MostofexistingNASmethodscanbeformulatedasaconstrainedoptimizationproblemas: α A=argmin

Remarkably, the searched models, named S3 (short forSearching the Search Space), from the searched space achievesuperior performance torecently proposed models, such as Swin, DeiT and ViT, when evaluated on ImageNet.