Goto

Collaborating Authors

 Technology






ErrorCompensatedDistributedSGD canbeAccelerated

Neural Information Processing Systems

In this work, we show for the first time that error compensated gradient compression methods can be accelerated. In particular, we propose and study the error compensated loopless Katyusha method, and establish an accelerated linear convergence rate under standard assumptions.


48aedb8880cab8c45637abc7493ecddd-AuthorFeedback.pdf

Neural Information Processing Systems

Infact,ourexperiments are35 designed todemonstrate thatthevGraph frameworkenables community detection andnode representation learning36 to benefit one other, not to prove that it outperforms all existing studies. Therefore, we decided to choose certain37 representativemethods(i.e.,matrixfactorization-based methods,generativemodels,andK-Meansafternodeembed-38 dings) which help validate this point. We will discuss more studies in the revised draft.(2)AboutchoosingK. In39 practice, when the trueK is not given, we can still chooseK according to the performance on validation set (as in40 [14,36]).