Review for NeurIPS paper: Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains

Using NTK theory the authors show that a standard multilayer perceptron fails to learn high frequencies both in theory and in practice. The authors then use a Fourier feature mapping to transform to overcome this bias. The experimental results also demonstrate that, with the same amount of training points (e,g. All reviewers thought the paper contains a very rich set of experiments and interesting numerical results. The reviewers raised various technical concerns in their reviews but thought that the authors' response adequately addressed these concerns and multiple reviewers raised their score.