Almost Linear VC Dimension Bounds for Piecewise Polynomial Networks

Neural Information Processing Systems 

We compute upper and lower bounds on the VC dimension of feedforward networks of units with piecewise polynomial activa(cid:173) tion functions. We show that if the number of layers is fixed, then the VC dimension grows as W log W, where W is the number of parameters in the network.