aba53da2f6340a8b89dc96d09d0d0430-Supplemental.pdf

A.1 NASSearchSpaces NASBench-1011 introduces a large and expressive search space with 423k unique convolutional neural architectures and training statistics on CIFAR-10. NASBench-2012 contains the training statistics of15,625 architectures across three different datasets, including CIFAR-10, CIFAR-100, and Tiny-ImageNet-16. NASBench-NLP5 [10] is an NLP neural architecture search space, including 14k recurrent cells trained on the Penn Treebank (PTB)[11]dataset. Thegenerated noise maps aredirectly multiplied bythelevelwhich canbeselected from 0 to 1 with a step of 0.1. Other settings are already described in Section 3.1.2.