Review for NeurIPS paper: Structured Convolutions for Efficient Neural Network Design

Weaknesses: The major weaknesses of this paper are the soundness and significance. In terms of soundness, the biggest issue is the way the empirical evaluation was designed and executed. Firstly, it's extremely odd that the authors decided to implement the structured convolution as a post-training conversion, rather than directly implementing the structured convolution as a trainable architectural feature (e.g. Otherwise, the authors should demonstrate the feasibility of performing Eq (3) as quick fine-tuning for fully trained (regular) networks to justify their approach. Secondly, although the reduction in numbers of operations and parameters is overall impressive, the decrease in accuracies compared to baselines (Table 1 to 5) is also non-negligible, especially for more recent networks like EfficientNet and MobileNetV2.