Finally, we provide experiments on real data comparing NTK and the Laplace kernel, along with a larger class ofฮณ-exponential kernels. We show that these perform almost identically.
We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers.