Convergence of Adversarial Training in Overparametrized Neural Networks

We show that the VC-Dimension of the model class which canrobustlyinterpolate any n samples is lower bounded byΩ(nd) where d is the dimension. In contrast, there are neural net architectures that can interpolaten samples with onlyO(n) parameters and VC-Dimension atmostO(nlogn).