ExtrapolationandSpectralBiasofNeuralNetswith HadamardProduct:aPolynomialNetStudy

Neural Information Processing Systems 

Weprovetheir equivalence to the kernel regression predictor with the associated NTK, which expands the application scope of NTK. Based on our results, we elucidate the separation ofPNNs overstandard neural networks with respect toextrapolation andspectralbias.