Reviews: On Exact Computation with an Infinitely Wide Neural Net

The claim of this paper is clear and easy to read. Although the composition of CNTK is straightforward and its exact computation in ReLU networks seems to be a bit trivial, this is a natural direction to be explored and some researchers will be interested in experimental results reported in this paper. The non-asymptotic proof is also a novel contribution and will be helpful to further develop the theory of NTK. Basically, I believe that this paper is worth to be published. I think that clarifying the following points will further increase the significance of this paper.