Re Reviewer 1

About ResNets' using convolutional layers (Conv) and batch norms(BN) in practice: we acknowledge that Conv and BN Thank you for the positive comments. About generalizability: considering kernel ridge regression, one can show that the generalization error is "continuous" The same applies to the poor generalization of deep FFNets. About our motivation: our increasing depth analysis is a common practice in theoretical research. This is because the infinite-depth behavior is very similar to the large-depth behavior of NNs. Moreover, we highlight that existing results are not limited to 50 and 100 layers.