MathNAS: If Blocks Have a Role in Mathematical Architecture Design

However, designing large models by NAS is challenging due to the dramatical increase of search space and the associated huge performance evaluation cost.