HardnessofNoise-FreeLearningfor Two-Hidden-LayerNeuralNetworks

Neural Information Processing Systems 

We give superpolynomial statistical query (SQ) lower bounds for learning twohidden-layer ReLU networks with respect to Gaussian inputs in the standard (noise-free)model.