Review for NeurIPS paper: Neural Networks Fail to Learn Periodic Functions and How to Fix It

Weaknesses: A significant shortcoming in the approach is the lack of proper and thorough validation with recurrent neural networks. The stated problem (i.i.d. in fourier space, restricted to a compact region in R d) can be tackled with the auto-regressive approach provided by RNNs. However this is not mentioned, or compared against in the paper. I note that RNNs are somewhat compared against in the appendix, but this is with respect to RNN Snake vs RNN. Above all this paper needs a comparison showing the ability of feedforward Snake networks to outperform vanilla RNNs.