Scaling Up Deep Neural Network Optimization for Edge Inference