Organization

The intermediate residual blocks have convolution layers with the stride 2 for down-sampling. Specifications of reference devices used in the paper. Now, we describe the latency measurement pipeline for desktop GPUs, Jetson, server CPUs, and mobile phone. Spearman's rank correlation coefficient of collected latencies among 8 representative devices in As shown in Table A.3, the measured latencies on the same set of architectures Visualization of 10 reference neural architectures we used for NAS-Bench-201 search space. Architecture indices of NAS-Bench-201 are 11982, 13479, 14451, 1462, 431, 55, 6196, 8636, 9, 9881 in order of left top to right bottom.