Review for NeurIPS paper: How to Characterize The Landscape of Overparameterized Convolutional Neural Networks

This paper studies the landscape of overparametrized convolutional networks and argues that their training dynamics can be analyzed by comparing the trajectories of feature distributions. Using "network grafting" as a metric, it shows feature distribution trajectories of two networks with the same architecture but different initializations remain close during training. The paper also shows that although the landscape is non-convex with respect to the trainable parameters, it can be reformulated as a convex function with respect to the features. They find that the paper is well written and proposes a novel and appealing perspective for analyzing training dynamics. However, there was lack of clarity about the claim of convexity, which the authors clarified in the rebuttal. I think adding those clarifications to the paper is needed.